-- Logs begin at Mon 2022-10-31 13:25:33 UTC, end at Mon 2022-10-31 16:11:14 UTC. -- Oct 31 13:55:12.012298 n-d-863055-2 systemd[1]: Starting Devstack devstack@keystone.service... Oct 31 13:55:12.021293 n-d-863055-2 devstack@keystone.service[82118]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 13:55:12 2022] *** Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: nodename: n-d-863055-2 Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: machine: x86_64 Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: clock source: unix Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: pcre jit disabled Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: detected number of CPU cores: 4 Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: current working directory: / Oct 31 13:55:12.023362 n-d-863055-2 devstack@keystone.service[82118]: detected binary path: /usr/bin/uwsgi-core Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: your processes number limit is 47680 Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: your memory page size is 4096 bytes Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: detected max file descriptor number: 2048 Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: lock engine: pthread robust mutexes Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: thunder lock: enabled Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 31 13:55:12.023918 n-d-863055-2 devstack@keystone.service[82118]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 13:55:12.064074 n-d-863055-2 devstack@keystone.service[82118]: Python main interpreter initialized at 0x55db3e9e79c0 Oct 31 13:55:12.064074 n-d-863055-2 devstack@keystone.service[82118]: python threads support enabled Oct 31 13:55:12.064074 n-d-863055-2 devstack@keystone.service[82118]: your server socket listen backlog is limited to 100 connections Oct 31 13:55:12.064074 n-d-863055-2 devstack@keystone.service[82118]: your mercy for graceful operations on workers is 90 seconds Oct 31 13:55:12.064443 n-d-863055-2 devstack@keystone.service[82118]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 13:55:12.064517 n-d-863055-2 devstack@keystone.service[82118]: *** Operational MODE: preforking *** Oct 31 13:55:12.064773 n-d-863055-2 devstack@keystone.service[82118]: *** uWSGI is running in multiple interpreter mode *** Oct 31 13:55:12.064773 n-d-863055-2 devstack@keystone.service[82118]: spawned uWSGI master process (pid: 82118) Oct 31 13:55:12.064974 n-d-863055-2 systemd[1]: Started Devstack devstack@keystone.service. Oct 31 13:55:12.067465 n-d-863055-2 devstack@keystone.service[82118]: spawned uWSGI worker 1 (pid: 82161, cores: 1) Oct 31 13:55:12.067465 n-d-863055-2 devstack@keystone.service[82118]: spawned uWSGI worker 2 (pid: 82163, cores: 1) Oct 31 13:55:12.067465 n-d-863055-2 devstack@keystone.service[82118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 13:55:16.400214 n-d-863055-2 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:55:16.400214 n-d-863055-2 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Oct 31 13:55:16.401003 n-d-863055-2 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:55:16.401003 n-d-863055-2 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Oct 31 13:55:16.401112 n-d-863055-2 devstack@keystone.service[82163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:55:16.401112 n-d-863055-2 devstack@keystone.service[82163]: from cryptography.utils import int_from_bytes Oct 31 13:55:16.401516 n-d-863055-2 devstack@keystone.service[82163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 13:55:16.401516 n-d-863055-2 devstack@keystone.service[82163]: from cryptography.utils import int_from_bytes Oct 31 13:55:16.450520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 13:55:16.450723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 13:55:16.450808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 13:55:16.450895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 13:55:16.450975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] command line args: [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 13:55:16.451082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] command line args: [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 13:55:16.451171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 13:55:16.451337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ================================================================================ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 13:55:16.451422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 13:55:16.451497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ================================================================================ {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 13:55:16.451592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.451742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] admin_token = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.451827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_dir = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.451985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] config_dir = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_source = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] debug = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] config_source = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] debug = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.452952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.453699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_config_append = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_config_append = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.454968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_dir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_dir = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_file = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.455972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.456993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.457854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.458950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] publish_errors = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] publish_errors = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.459950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] standard_threads = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] standard_threads = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.460971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] use_journal = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_journal = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] use_json = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_json = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_stderr = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] use_stderr = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] use_syslog = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_syslog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.461859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 13:55:16.462025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.462851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.463958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.464989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.465909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.466972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.467876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.468906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.469892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.470969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.471984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.472984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.473989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.474947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.475873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.476964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.477994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.478996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.479955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.480950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.481866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.482994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.483996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.484897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.485866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.external = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.486999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.external = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.password = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.487958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.token = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.password = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] auth.token = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.488964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.489883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.490860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.491971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.492927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.493888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.494964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.495839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.496946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.497950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.498959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.499839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.500001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.500081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.500242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.500329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.500485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.501977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.502908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.503907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.504998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.505989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.506966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.507986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.508931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.509875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.510851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.511953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.512907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.513997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.514945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.515967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.516114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.516801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.516905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.516986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.517910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.518869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.519974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.520982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] role.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] role.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.521922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.522899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.523993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.524856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.525885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.526862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.527928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.528962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.529881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.530851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.531984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.532935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.533986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.connection = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.534943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.535937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.536938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.537943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.538017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 13:55:16.538089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 13:55:16.538232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 13:55:16.567433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.567590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.567665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.567725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.567875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.567959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.576098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.576185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.604234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.604453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.604540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.604686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.658044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.658218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.708648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.708878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.709946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.710186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.864835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.865928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.866057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.889555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.889719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.889820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.889950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.890950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.891104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.901923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.902180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.914581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.914797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.915922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.916066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.916274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 13:55:16.933202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.933308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.933412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 13:55:16.933497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 13:55:16.933752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.933836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.933952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 13:55:16.934034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 13:55:16.934222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.934312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.934482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.934564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.934769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.934853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.935026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.935119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.945952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.946035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.952888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.952976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.955824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.955911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.956104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.956938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.957985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.958068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.958253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.958335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.958515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.958605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.981014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.981161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.982463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.982640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.982765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.982925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.987994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.988117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.988273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.988400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.988547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.988680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.994894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.995139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:16.995222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:16.995421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.001403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.001672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.001757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.001961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.002920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.003088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.003169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.003351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.003432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.003642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.019430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.019524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.019702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.019785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.023539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.023661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.026758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.026872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.027052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.027214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.031245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.031358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.034421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.034807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.037609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.037907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.038941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.039058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.039228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.039515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.055487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.055768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.055853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.056029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.056113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.056285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.056368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.056555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.063134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.063463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.064676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.065002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.066210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.066487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.066581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.066832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.069168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.069453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.069536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.069730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.069813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.070008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.070094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.070290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.070371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.070711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.082087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.082339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.082424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.082648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.082745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.082927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.083956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.084157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.099705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.099978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.102586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.102887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.105475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.105745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.106995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.107212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.108455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.108677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.108759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.108957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.109106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.109353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.115463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.115750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.116909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.117209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.119774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.120781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.121042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.128484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.128769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.128900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.129042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.129189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.129470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.136137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.136412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.136600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 13:55:17.136682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.136885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.136979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.137977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.138886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.139917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.140194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 13:55:17.174423 n-d-863055-2 devstack@keystone.service[82163]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db3e9e79c0 pid: 82163 (default app) Oct 31 13:55:17.174947 n-d-863055-2 devstack@keystone.service[82161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db3e9e79c0 pid: 82161 (default app) Oct 31 13:55:17.177680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb863-9db7-4e5d-b851-27a522f0c775 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:17.177962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb863-9db7-4e5d-b851-27a522f0c775 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:17.178231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb863-9db7-4e5d-b851-27a522f0c775 None None] PATH_INFO: `/v3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:17.182314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon Oct 31 13:55:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:24.629649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:24.630161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:24.630263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:24.634749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:24.640250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:24.640680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:24.640773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:24.713621 n-d-863055-2 devstack@keystone.service[82163]: INFO dbcounter [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] Registered counter for database keystone Oct 31 13:55:24.733197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG oslo_db.sqlalchemy.engines [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:55:24.739549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writer thread running {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:55:24.918115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG passlib.handlers.bcrypt [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82163) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 13:55:24.918423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG passlib.handlers.bcrypt [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82163) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 13:55:24.975980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:24.977542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:25.101632 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:55:25.576254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:25.645589 n-d-863055-2 devstack@keystone.service[82161]: INFO dbcounter [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] Registered counter for database keystone Oct 31 13:55:25.667008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG oslo_db.sqlalchemy.engines [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 13:55:25.673695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writer thread running {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 13:55:25.792604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a8891-8e96-4784-b9d1-66bcd7b7c46f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:25.796832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:25.797490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:25.797769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:25.798040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:25.806063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:25.857277 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 13:55:25.857563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976554be-dcad-4aa8-830e-a2aeaa8906fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:25.866680 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Oct 31 13:55:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 13:55:25.872640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:25.889278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c85c2-cb0f-43df-853f-3035704ffe42 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:25.894102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:25.895230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:25.895514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:25.895795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] PATH_INFO: `/v3/projects/90ee3928a7cf4c8590e1103847faa6a2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:25.897365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] RBAC: Authorizing `identity:get_project(project_id=90ee3928a7cf4c8590e1103847faa6a2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:25.949779 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 13:55:25.950124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ba54e-1575-421c-a7e9-4404b4a8771e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:25.955084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:55:25 2022] GET /identity/v3/projects/90ee3928a7cf4c8590e1103847faa6a2 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:28.062914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498488-2869-4602-8aae-25591757b6cf None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:28.063400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498488-2869-4602-8aae-25591757b6cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:28.063400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e498488-2869-4602-8aae-25591757b6cf None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:28.067454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:28.072745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:28.073106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:28.073297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:28.093293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:28.095468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:28.103114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:55:28.369004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e498488-2869-4602-8aae-25591757b6cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:28.380833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e498488-2869-4602-8aae-25591757b6cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:28.385212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:28.385796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:28.386074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:28.386342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:28.394281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:28.396066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3545d99-c496-4eff-95c3-5b1defe2ab49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:28.404444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Oct 31 13:55:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 13:55:28.410279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:28.419337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72757b9-0b60-4745-bf7f-1ec2179d2d7a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:28.423651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:28.424265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:28.424544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:28.424817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] PATH_INFO: `/v3/users/a7bb3a54d28948f4a1c81eb298884942` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:28.426153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3a54d28948f4a1c81eb298884942)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:28.428006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260c1eb-2918-4a2c-b8b3-90c69e1989e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:28.429498 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Oct 31 13:55:28 2022] GET /identity/v3/users/a7bb3a54d28948f4a1c81eb298884942 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:30.636795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec3c-29b7-468f-990f-c57d82a2cffe None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:30.637351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec3c-29b7-468f-990f-c57d82a2cffe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:30.637351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec3c-29b7-468f-990f-c57d82a2cffe None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:30.638669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:30.643850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:30.644535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:30.644814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:30.645471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862052-eff7-4efe-ab19-d73d9fa87107 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:30.645751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862052-eff7-4efe-ab19-d73d9fa87107 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:30.646021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862052-eff7-4efe-ab19-d73d9fa87107 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:30.647250 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:30.652332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:30.652613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:30.652884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:30.663681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:30.664840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:30.694407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82161) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 13:55:30.694838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82161) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 13:55:30.747219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:30.749732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:30.753093 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:30.869164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:31.036266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.061133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.144335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a1500-fa51-44c1-82c5-7d629cfd5592 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.179548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.180182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.180457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.180943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.192666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:31.196551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:31.201652 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:31.202601 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:31.204144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:31.209474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.295888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.304778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e53e-79d3-45a2-bff9-6f415ac26ea1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.308445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.315552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5cca-0ddf-42b0-bfa6-d8e0a8488cc6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.346749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.347615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.347895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.348161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.349133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.350566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.350847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.351458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.351727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.351998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.352712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:31.353011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.355185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.369089 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:31.374821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.386880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:55:31.386880 n-d-863055-2 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:55:31.386880 n-d-863055-2 devstack@keystone.service[82161]: [parameters: {'id': '89cbfe3700494079a619554b14a9db90', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 13:55:31.386880 n-d-863055-2 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:55:31.405964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 13:55:31.407625 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 13:55:31.408750 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 13:55:31.409814 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 13:55:31.410961 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:55:31.411852 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '89cbfe3700494079a619554b14a9db90', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 13:55:31.413392 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:31.414794 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 8/16] 10.222.0.13 () {60 vars in 1137 bytes} [Mon Oct 31 13:55:31 2022] POST /identity/v3/domains => generated 190 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:55:31.419611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.490398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ca9b-2a0e-4bcc-89e5-05526b03b0a0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.520271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05507c-be21-4f8a-a880-9983cd169d24 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.527045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.527769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.528044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.528311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] PATH_INFO: `/v3/users/a7bb3a54d28948f4a1c81eb298884942` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.529469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3a54d28948f4a1c81eb298884942)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.530959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.532512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/users/a7bb3a54d28948f4a1c81eb298884942 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:31.537853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.551956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.553227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.554074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.554351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.554638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.572528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.573974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:55:31.589964 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:31.590848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:55:31.591736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:55:31.591736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:55:31.591736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:31.591736 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:55:31.596935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.618067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.637346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c1d7-b0f7-4700-92c0-35174dc2e105 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.672864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.673475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.673749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.674012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.675165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.676602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.678116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:31.683810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:31.695861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50a93-8c04-45ff-8cd1-b0b9a8ee43f1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.733725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.734347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.735210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.735482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.736114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:31.736438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.737818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfd77-81bd-4c16-8805-b19acfbb8b78 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:31.754392 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:31.763910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:31.787415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207e1e7-5f08-4da2-a09d-49dc03e3bece None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:31.824102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:31.824692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:31.824970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:31.825242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] PATH_INFO: `/v3/domains/default/users/a7bb3a54d28948f4a1c81eb298884942/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:31.827250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7bb3a54d28948f4a1c81eb298884942, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:31.829285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cad9f-69a6-4ab4-a749-6fa9500d1c11 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:32.004817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Mon Oct 31 13:55:31 2022] PUT /identity/v3/domains/default/users/a7bb3a54d28948f4a1c81eb298884942/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 13:55:34.362760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90d17-bf00-4723-9ca7-2497303bbaf2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.363377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90d17-bf00-4723-9ca7-2497303bbaf2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.363377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90d17-bf00-4723-9ca7-2497303bbaf2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.364654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:34.373334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7dde-0e89-499f-aeeb-55d61f9d8099 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.378764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7dde-0e89-499f-aeeb-55d61f9d8099 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.378764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7dde-0e89-499f-aeeb-55d61f9d8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.380198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfccb2-a59f-4b95-914d-6939755932ce None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.380487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfccb2-a59f-4b95-914d-6939755932ce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.380760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfccb2-a59f-4b95-914d-6939755932ce None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.382042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:34.387246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308a05-4443-45f7-8400-b143db048700 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.387527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308a05-4443-45f7-8400-b143db048700 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.387803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308a05-4443-45f7-8400-b143db048700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.412124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-90dd7dde-0e89-499f-aeeb-55d61f9d8099 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:34.415239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-90dd7dde-0e89-499f-aeeb-55d61f9d8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:34.415339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad308a05-4443-45f7-8400-b143db048700 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:34.416528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad308a05-4443-45f7-8400-b143db048700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:34.502743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 31 13:55:34.525699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:34.760193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f462f1-8364-4716-bd7b-60f39aaf58c6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.760528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f462f1-8364-4716-bd7b-60f39aaf58c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.760753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f462f1-8364-4716-bd7b-60f39aaf58c6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.762218 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 14/26] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:34.768524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:34.768808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:34.769114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:34.795614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:34.796799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:34.875716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:34.883910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 13/27] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:34.887076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f462f1-8364-4716-bd7b-60f39aaf58c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:34.900111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:35.001850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f462f1-8364-4716-bd7b-60f39aaf58c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.038098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.039117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.039606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.040079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.040944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:35.042531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3ea68-ba2d-4385-ad39-e6787af2cb5f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:35.085274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.238637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206fd7-dfb4-48c9-ada7-990c526f5075 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.274009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 15/28] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 31 13:55:34 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:35.275603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df2cf-8b15-4706-a729-fc67c00ff7c2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.275899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df2cf-8b15-4706-a729-fc67c00ff7c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.276179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df2cf-8b15-4706-a729-fc67c00ff7c2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.277677 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 16/29] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:35.288096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.288405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.288658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.322554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.323227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.323513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.323794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.326932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:35.328564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:35.350267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:35.352046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:55:35.386633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:35.388346 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:55:35.389178 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:55:35.389178 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:55:35.389178 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:35.389338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:35.391137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.463062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:35.488642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:35.496822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:35.497969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.549223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206fb13-1a6b-42ac-8bed-a55acb045fbb None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.607051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ae3d-fdcf-4257-9e90-2aaa22b4330c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.645552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.646522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.647037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.647504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.648345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:35.648635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.649104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:35.649278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.649571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.649853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.651519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:35.664662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 18/32] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:35.674959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:35.675561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:35.680444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:35.681281 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:35.682012 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 15/33] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:35.689230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.796006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:35.854214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ae26e-7bc1-49fb-a5c9-d692a98491c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.856083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4b10-f0f4-4743-ac25-0e4582e1fcc9 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:35.873557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:35.896691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.897333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.897615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.897802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:35.897912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.898401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:35.898570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:35.898790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:35.899064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:35.899747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:35.900053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:35.900170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:35.901487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:35.920571 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 16/34] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:35.921557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:35.973006 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 19/35] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:55:35 2022] POST /identity/v3/projects => generated 301 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:35.974165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.063433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d24f9-80f5-4b93-a85c-4ffb68cb9e16 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.115991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.116532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.116639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e520e-1df3-4d4f-aa7a-097e2d3c256c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.116816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.117085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.117778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.120521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb9746-35ad-40dd-98a6-7026711bda47 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.143964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:36.155332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.155987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.156292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.156567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] PATH_INFO: `/v3/users/a7bb3a54d28948f4a1c81eb298884942` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.157975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3a54d28948f4a1c81eb298884942)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.159509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e205683-9504-40bf-a862-68cbd7741084 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.161443 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 20/36] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:35 2022] GET /identity/v3/users/a7bb3a54d28948f4a1c81eb298884942 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:36.162393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9283e-30e2-40c2-a0fb-3a6d5cddd959 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.167157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9283e-30e2-40c2-a0fb-3a6d5cddd959 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.167494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9283e-30e2-40c2-a0fb-3a6d5cddd959 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.170830 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 21/37] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:36.170830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9283e-30e2-40c2-a0fb-3a6d5cddd959 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.212080 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 17/38] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 31 13:55:35 2022] POST /identity/v3/roles => generated 225 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:36.213754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a622-7a40-47d3-a36c-9689e6eafcb8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.214206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a622-7a40-47d3-a36c-9689e6eafcb8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.216345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a622-7a40-47d3-a36c-9689e6eafcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.239754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-17b9a622-7a40-47d3-a36c-9689e6eafcb8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:36.240990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17b9a622-7a40-47d3-a36c-9689e6eafcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:36.278847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:36.319869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9283e-30e2-40c2-a0fb-3a6d5cddd959 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.332799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 18/39] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:36.337160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ead-930f-413f-8ce3-f932b860eb61 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.343941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ead-930f-413f-8ce3-f932b860eb61 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.343941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a7ead-930f-413f-8ce3-f932b860eb61 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.343941 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 19/40] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:36.348618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.349416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.350367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.363952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.364313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.364509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.364785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.366406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.367923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.374575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 22/41] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:36.376218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.382597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:36.385536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:36.442243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:36.506746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c0973-76b5-4896-ab4f-c5bc789dfc0c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.542336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.542992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.543273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.543548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.544280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.domain.id=default, user.id=a7bb3a54d28948f4a1c81eb298884942) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:36.544594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.546061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.557559 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 23/42] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Oct 31 13:55:36 2022] GET /identity/v3/role_assignments?user.id=a7bb3a54d28948f4a1c81eb298884942&scope.domain.id=default&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 530 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:36.582661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:36.609201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.725524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca6c28-16b4-4686-b22d-b7bef6e47c29 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.740866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:36.762990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.763628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.763921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.764203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.765315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.767797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.773806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 24/44] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:36.775138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.849186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:36.873961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:36.881261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb7b04-ca78-4df1-97bd-1d241567d361 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.915734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.916343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.916619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.916888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.917527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.918997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aadc4-27fa-41a7-a326-bfe99d5766be None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.947730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f62aa0-8037-47e9-b50f-9151be76b3d8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:36.980001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:36.980537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:36.980816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:36.981089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:36.981749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:36.983140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873c00-cb39-488f-8bc4-56538970e51f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:36.999189 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 21/45] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:55:36 2022] POST /identity/v3/projects => generated 312 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:37.084596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 25/46] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 31 13:55:36 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:55:39.162004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2d55-a5b4-4e40-b296-e449ca39b6fd None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:39.162515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2d55-a5b4-4e40-b296-e449ca39b6fd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:39.162603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e2d55-a5b4-4e40-b296-e449ca39b6fd None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:39.163920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 22/47] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:39.169024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d2611-4503-4863-9266-670e88286bae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:39.169420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d2611-4503-4863-9266-670e88286bae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:39.169568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d2611-4503-4863-9266-670e88286bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:39.187677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e72d2611-4503-4863-9266-670e88286bae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:39.188847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e72d2611-4503-4863-9266-670e88286bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:39.222034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:39.252806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 26/48] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:39.528263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e2d55-a5b4-4e40-b296-e449ca39b6fd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:39.627927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e2d55-a5b4-4e40-b296-e449ca39b6fd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:39.661371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:39.661977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:39.662254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:39.662525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:39.663653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:39.665080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e651fc-cd5b-4aa5-8709-a3df4909b416 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:39.666723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 23/49] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:39.672307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d2611-4503-4863-9266-670e88286bae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:39.768835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d2611-4503-4863-9266-670e88286bae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:39.800690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418175b2-6153-4a62-b683-271360d2304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:39.801231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418175b2-6153-4a62-b683-271360d2304e None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:39.801511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418175b2-6153-4a62-b683-271360d2304e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:39.801781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418175b2-6153-4a62-b683-271360d2304e None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:39.802414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418175b2-6153-4a62-b683-271360d2304e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:39.803876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418175b2-6153-4a62-b683-271360d2304e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:39.907057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 27/50] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Oct 31 13:55:39 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:42.038878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aac29-02ab-415d-adfd-fe69d17277c3 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:42.039375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aac29-02ab-415d-adfd-fe69d17277c3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:42.039375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aac29-02ab-415d-adfd-fe69d17277c3 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:42.040679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 24/51] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:42.045769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:42.046171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:42.046327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:42.064912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:42.066090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:42.082527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:42.130013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 28/52] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:42.406240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aac29-02ab-415d-adfd-fe69d17277c3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:42.422842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:42.506454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aac29-02ab-415d-adfd-fe69d17277c3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:42.538910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:42.539527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:42.539807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:42.540078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:42.541171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:42.542605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e72cf-ca57-4799-b268-477573c35f54 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:42.544186 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 25/53] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:42.550251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:42.645839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710936f-4228-4797-90b9-916d0e6ea093 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:42.678792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:42.679327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:42.679604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:42.679874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:42.680518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:42.681958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281284-98c2-425a-8597-26ccfd0776b0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:42.774683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 29/54] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:55:42 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:46.026649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff260-b8f3-4bab-b73f-4e93a3d26798 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.027650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff260-b8f3-4bab-b73f-4e93a3d26798 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.028152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff260-b8f3-4bab-b73f-4e93a3d26798 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.029701 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 26/55] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:46.035055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537c7a-3554-4768-9e81-b75122b85d9c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.035865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537c7a-3554-4768-9e81-b75122b85d9c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.036348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537c7a-3554-4768-9e81-b75122b85d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.187972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80537c7a-3554-4768-9e81-b75122b85d9c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:46.189591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80537c7a-3554-4768-9e81-b75122b85d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:46.192139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:46.288049 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 30/56] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:46.313910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e074-1747-4ecf-9024-a04c1490440b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.314551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e074-1747-4ecf-9024-a04c1490440b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.315059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9e074-1747-4ecf-9024-a04c1490440b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.316605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 27/57] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:46.322383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd04a3-076d-475a-bcba-812d10d8a17a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.322996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd04a3-076d-475a-bcba-812d10d8a17a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.323494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd04a3-076d-475a-bcba-812d10d8a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.347661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00cd04a3-076d-475a-bcba-812d10d8a17a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:46.349198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00cd04a3-076d-475a-bcba-812d10d8a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:46.363536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c2e-3a8e-4bd0-90fb-29e9afd48340 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.363823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c2e-3a8e-4bd0-90fb-29e9afd48340 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.364284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29c2e-3a8e-4bd0-90fb-29e9afd48340 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.365782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 28/58] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:46.370990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.371432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.371853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.398089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:46.399733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:46.461601 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:46.463192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70890-88e2-404b-9c17-da00fb28b537 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.463625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70890-88e2-404b-9c17-da00fb28b537 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.464047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70890-88e2-404b-9c17-da00fb28b537 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.465455 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 32/60] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:46.471935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.472388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.472807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.491242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:46.492850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:46.532897 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 29/61] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:46.579843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:46.583398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 33/62] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:46.586668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:46.605918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:46.728331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b18dc-2686-4c8a-a286-3783570fe540 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:46.766138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:46.766808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.767090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.767363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.777582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:46.782571 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:46.783631 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:46.784431 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 30/63] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:46.791715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:46.821236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:46.915048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:46.923402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5046-d8ab-43c1-8148-9e74c2527735 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:46.949806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c335e4-9a84-430b-ba6e-9b23e7d04981 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:46.964955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:46.965825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.966339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.967098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.968411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:46.968724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:46.970117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc397d-28dc-4a3a-b90a-8f577cf69b1b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:46.982743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 34/64] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:46.983923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717519d0-0215-4460-8c91-f409bea018fc None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.984738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717519d0-0215-4460-8c91-f409bea018fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.984944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:46.985056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717519d0-0215-4460-8c91-f409bea018fc None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.985576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:46.985858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:46.986362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:46.986459 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 35/65] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:46.986905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717519d0-0215-4460-8c91-f409bea018fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.001161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:47.005971 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:47.007045 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 31/66] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:55:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:47.011444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.052740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.094608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717519d0-0215-4460-8c91-f409bea018fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.107008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a386f-9f20-46d7-b88f-8961ffe63b01 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.127861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.128482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.128759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.129029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.136958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.140387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:47.142001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.142716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.148320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.148320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:47.148474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:47.149294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 36/67] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:47.150032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.157950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-ac9167f8-772c-48ca-9f68-8749434ed40b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:47.163031 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:47.164030 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:47.164954 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 32/68] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:47.169811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.170043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.170324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.188651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:47.189821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:47.251287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976b89-d971-475c-b4df-4a4a444cf8ce None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.255747 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 33/69] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:47.256547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.270377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.285018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.286718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.286718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.286718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] PATH_INFO: `/v3/users/a7bb3a54d28948f4a1c81eb298884942` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.287349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3a54d28948f4a1c81eb298884942)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.288826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.290384 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 37/70] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/users/a7bb3a54d28948f4a1c81eb298884942 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.291170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.380166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3225db-0456-4a30-979e-40ea5c1673c3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.397056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b827ec-3acb-4aec-8021-fd3bde6753aa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.402947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.415461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.416072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.416351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.416628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.417343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:47.417744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.419184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.428541 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 34/71] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.429261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.438719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.439329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.439611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.440255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.440925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:47.441536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.442951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.451979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 38/72] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.452374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.506464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.538183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a072c-d594-492a-8bbd-70f9b71f19dc None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.557162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee972c-276f-4e15-8b08-edc5715daf9c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.571273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.571870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.572148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.572417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.573067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:47.573365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.574772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.583196 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 35/73] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.583965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.591714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.592346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.592627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.592903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.594636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.596100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.597746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 39/74] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.598496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.633354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.686431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31548e3-38b5-4aee-9309-a2d6d5662f80 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.694251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41285dc-8f4a-4aec-8642-d77ecbc321c8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.711758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.722072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.722723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.723003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.724446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.729523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.730159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.730439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.730813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.736606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.738056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.739691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 36/75] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.740448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.746907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.748361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.750022 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 40/76] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.750809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.838044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb3dd3-b3e7-405e-acba-ad3484eaa761 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.840277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.850234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d54b-e51c-401a-83cb-169e0dfeb7b5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.871083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.871701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.872101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.872374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.873490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.874978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.876598 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 37/77] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.877360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.883130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:47.883761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:47.884040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:47.884313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:47.885700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:47.887177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:47.893846 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 41/78] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:47.893846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:47.934746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:47.975854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748422c-d0ba-465a-9c12-4593bc31f854 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:47.986600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ce69-eefd-4394-b0a2-83c9be5483c3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.008270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.008913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.009195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.009468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/a7bb3a54d28948f4a1c81eb298884942/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.011645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, user_id=a7bb3a54d28948f4a1c81eb298884942, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.013094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.020323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.020946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.021231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.021507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.022653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.024085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.027639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 42/79] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:47 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:48.027639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.077323 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:47 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/a7bb3a54d28948f4a1c81eb298884942/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:48.090911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.124335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:48.161050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8a596-d8a9-470c-8156-a7d49bbcc1a7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.179052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:48.202668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.204187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.204619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.204892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.206064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a3710-7b12-46ee-acd1-57b1e5d00f29 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.206262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.207759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.214575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 43/81] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:48 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:48.214575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.254335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.254514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.254821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.255106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.256315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.258156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.316646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398435b4-7d3e-4035-85c6-18fd1bffa126 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.335808 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 39/82] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:55:48 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:48.336815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.363004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.363662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.363948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.364226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] PATH_INFO: `/v3/projects/f483b36d886f4819b95ff3ea9b13a547` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.366139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] RBAC: Authorizing `identity:get_project(project_id=f483b36d886f4819b95ff3ea9b13a547)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.368126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.375634 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 44/83] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:48 2022] GET /identity/v3/projects/f483b36d886f4819b95ff3ea9b13a547 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:48.376673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.445912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:48.471103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:48.479090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ffeda-5707-49e1-936c-f434280b3833 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.509929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e697fa-de09-4a6e-a831-3923e1be28ed None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.530567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.531357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.531638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.532108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.535486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, user_id=181b6bd00bde47c9ad4268d2ba2962c2, role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.537438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.554348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.555124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.555498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.555842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.558357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, user_id=181b6bd00bde47c9ad4268d2ba2962c2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.559898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b2e3-e9e4-44c4-8d62-ed281c8e911d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.632925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 40/84] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:48 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:48.633896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:48.656882 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 45/85] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:48 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:48.772754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e830cb-0897-477f-a628-fc23f02a99b3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:48.821647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:48.822347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:48.822647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:48.822928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] PATH_INFO: `/v3/projects/f483b36d886f4819b95ff3ea9b13a547/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:48.825020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] RBAC: Authorizing `identity:create_grant(project_id=f483b36d886f4819b95ff3ea9b13a547, user_id=181b6bd00bde47c9ad4268d2ba2962c2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:48.826523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034073-3321-48b5-9a1a-963d6ae47183 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:48.913476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 41/86] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:48 2022] PUT /identity/v3/projects/f483b36d886f4819b95ff3ea9b13a547/users/181b6bd00bde47c9ad4268d2ba2962c2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:50.768269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e60a6-022d-45c2-b19a-f7c6abea7a58 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:50.769295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e60a6-022d-45c2-b19a-f7c6abea7a58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:50.769784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e60a6-022d-45c2-b19a-f7c6abea7a58 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:50.771463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 46/87] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:50.784257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae92e-616b-43cd-a975-ebea36976350 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:50.784655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae92e-616b-43cd-a975-ebea36976350 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:50.784818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae92e-616b-43cd-a975-ebea36976350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:50.811886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8c6ae92e-616b-43cd-a975-ebea36976350 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:50.813613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c6ae92e-616b-43cd-a975-ebea36976350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:50.815587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:50.920078 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 42/88] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:51.461188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e60a6-022d-45c2-b19a-f7c6abea7a58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:51.488437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768211c-8b65-44ad-bb8f-5b7b33fde78d None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.489049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768211c-8b65-44ad-bb8f-5b7b33fde78d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.489341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768211c-8b65-44ad-bb8f-5b7b33fde78d None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.491137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 43/89] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:51.496549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bf16-1e9e-471c-b461-968355e7803b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.496967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bf16-1e9e-471c-b461-968355e7803b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.497242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35bf16-1e9e-471c-b461-968355e7803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.542600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3c35bf16-1e9e-471c-b461-968355e7803b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:51.543837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c35bf16-1e9e-471c-b461-968355e7803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:51.653362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e60a6-022d-45c2-b19a-f7c6abea7a58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:51.668411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:51.690765 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:51.694143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc348c-0e39-46f6-8d0a-8f59ec16be17 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.694431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc348c-0e39-46f6-8d0a-8f59ec16be17 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.694824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc348c-0e39-46f6-8d0a-8f59ec16be17 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.697359 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 45/91] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:51.703407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638cf8-eb07-443e-9986-944bd32f6e55 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.703728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638cf8-eb07-443e-9986-944bd32f6e55 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.704002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638cf8-eb07-443e-9986-944bd32f6e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.724219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:51.724865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.725149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.725422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.743729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a9638cf8-eb07-443e-9986-944bd32f6e55 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:51.744922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a9638cf8-eb07-443e-9986-944bd32f6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:51.771786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:51.777635 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:51.778562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:51.779360 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:51.781841 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 47/92] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:51.788665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:51.853439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:51.868268 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 46/93] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:51.895306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1532f-abd6-4eec-bd7f-2fa5603e1fc3 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.895597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1532f-abd6-4eec-bd7f-2fa5603e1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.895854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1532f-abd6-4eec-bd7f-2fa5603e1fc3 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.897340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 47/94] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:51.902268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.902550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.902853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.917748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce3b7-43d8-4331-8cb6-253638dbeae9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:51.939617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:51.940815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:51.952635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:51.953768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:51.954100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:51.954379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:51.955132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:51.955494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:51.956892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:51.965862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 48/95] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:51.971778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.003014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.083220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa31778-ad37-47d2-95e6-689257e2433b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.124152 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 48/96] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:52.125757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.138007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.138666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.138949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.139219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] PATH_INFO: `/v3/users/a7bb3a54d28948f4a1c81eb298884942` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.140380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3a54d28948f4a1c81eb298884942)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.141815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.145991 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:51 2022] GET /identity/v3/users/a7bb3a54d28948f4a1c81eb298884942 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:52.149042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.286739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.294279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740677-c22c-4c11-8321-99e338112f99 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.307822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230af46a-5fa6-42be-9278-2f138bf25471 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.330860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.331805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.332311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.332845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.344242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.354026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.355005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.360873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.360873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.371348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-1934e042-b82f-459a-8a1e-a750ac9af883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:52.379072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:52.379926 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:52.381160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 49/98] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:52.381786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583cb2-2223-40a5-8573-b4ee81f28c63 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.381786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583cb2-2223-40a5-8573-b4ee81f28c63 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.381896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52583cb2-2223-40a5-8573-b4ee81f28c63 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.386768 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 50/99] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:52.387856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52583cb2-2223-40a5-8573-b4ee81f28c63 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.419141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.421126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.520332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52583cb2-2223-40a5-8573-b4ee81f28c63 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.523516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.533205 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 50/100] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:52.533205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.556005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.556572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.556847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.557118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.566847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-a661fe65-c86d-4f6a-838c-b1f0ef77f377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:52.571693 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:52.572760 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:52.573523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 51/101] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:52.574498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.574874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.574965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.591310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:52.592484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:52.631226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ec32-fe4b-4489-a585-33031ca6acdf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.635311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.657757 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 52/102] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:52.658569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.672046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.672657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.672938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.673211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.673865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:52.674170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.675615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.688007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 51/103] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:52.688007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.747890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.769064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade48c9-44f7-4e2d-8eac-c83366e26501 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.790392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958aa6b-2778-4271-b755-21905f89f1ac None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.803566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.804489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.804489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.804730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.805827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.807374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1feefc-49cb-4378-8faf-4db598731a0e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.809176 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 53/104] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:52.810287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25b76-4d65-4f12-9f08-d04b8d46b315 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.810564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25b76-4d65-4f12-9f08-d04b8d46b315 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.810858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25b76-4d65-4f12-9f08-d04b8d46b315 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.812181 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 54/105] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:52.812724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25b76-4d65-4f12-9f08-d04b8d46b315 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.831742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.832654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.833131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.833621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.834960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.836537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.838241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 52/106] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:52.844225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.861480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.923128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25b76-4d65-4f12-9f08-d04b8d46b315 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.951774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478011d3-6778-412a-8185-34d798af1ae3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:52.957016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.957615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.957894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.958163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.958842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:52.959153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.960538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.969392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 55/107] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:52.970225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:52.979262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:52.986534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:52.987150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0751b1-09b5-49ce-b541-b6604cba58bd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 53/108] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:52 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:52.994127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:52.994592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:52.994592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.011311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:53.012489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:53.071472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761be34-56e4-42e0-b2f3-df01058f61c4 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.078684 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 54/109] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:53.079509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.081493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.106867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.107476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.107756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.108033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.108684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.110161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.188027 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 56/110] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:55:52 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:53.189120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.201796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8485-c15d-4a64-ba66-465d2a5338b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.238045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.248989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.250184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.250464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.250767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.251921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3, user.id=a7bb3a54d28948f4a1c81eb298884942) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:53.252153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.254860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.266655 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 55/111] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/role_assignments?user.id=a7bb3a54d28948f4a1c81eb298884942&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:53.266655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.384499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf96d-0d6d-494e-b085-9abe0142d00a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.438252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.438960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.439243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.439520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.447300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95349e-c73c-4ea0-b212-b0c6649a1d26 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.453679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:53.459994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:53.460901 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 57/112] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:53.462091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.487905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.496845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.497558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.497844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.498119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.499304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.501485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.508006 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 56/113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:53.508006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.578249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.600742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82671145-9d6d-4397-a47c-4852d738389f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.629856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba49faa-fc64-4245-8833-28feeea30f3a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.636612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.637172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.637489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.637768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.667411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.668041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.668324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.668594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.680912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:53.686461 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:53.688079 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 57/114] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:53.688949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.717091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.719870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.744024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.793735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786476-981b-4f94-b704-ac09490e675b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.811411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.829250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.829856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.830135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.830407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.831100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:53.831404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.831955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:53.832698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.835871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.845380 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 58/116] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:53.846452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:53.944785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aecf6e-fc95-4340-9942-0eecb489202d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.951223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6351e-dad1-48ca-bf80-590c06e614a6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:53.965770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:53.981380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.982045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.982326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.982598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.986305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:53.986950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:53.987228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:53.987501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:53.988169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:53.988474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:53.989855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:53.998196 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 59/117] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:53.998873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.049581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.061195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.062752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.107424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0376d4-105e-4f27-aeeb-c32e565f7c77 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.142876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.143511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.143794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.144078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.145182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.146642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.148279 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 60/118] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.153283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.166695 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 59/119] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:54.172250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.195621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.266549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a407a7-4c2f-4534-9496-8c4b005ad0a8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.276856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.280124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fcd4b-f75d-4f47-8dbe-daed9d941e93 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.303639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.304272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.304559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.304836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] PATH_INFO: `/v3/users/7ac00bd1ae46418ea2dab2663fa8befe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.317599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.318019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.318298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.318570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] PATH_INFO: `/v3/users/181b6bd00bde47c9ad4268d2ba2962c2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.319725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] RBAC: Authorizing `identity:get_user(user_id=181b6bd00bde47c9ad4268d2ba2962c2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.320086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] RBAC: Authorizing `identity:get_user(user_id=7ac00bd1ae46418ea2dab2663fa8befe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.321195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.321537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.330744 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 60/120] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/users/181b6bd00bde47c9ad4268d2ba2962c2 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.330877 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 61/121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/users/7ac00bd1ae46418ea2dab2663fa8befe => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.330949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.331037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.422423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.434467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b670ea-8b3a-4fb8-9a14-70d64dc32d38 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.435120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11af12-7498-411f-add9-75bf06c989ff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.470036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.470442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.470657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.470902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.471090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.471180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] PATH_INFO: `/v3/projects/f483b36d886f4819b95ff3ea9b13a547` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.471370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.471688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.472290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] RBAC: Authorizing `identity:get_project(project_id=f483b36d886f4819b95ff3ea9b13a547)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.472389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] RBAC: Adding query filter params (role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3, user.id=181b6bd00bde47c9ad4268d2ba2962c2) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:54.472701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.473748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.474134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.475584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 62/122] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/projects/f483b36d886f4819b95ff3ea9b13a547 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.480911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.481482 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 61/123] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/role_assignments?user.id=181b6bd00bde47c9ad4268d2ba2962c2&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.483786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.535042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.605021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0b23-c12d-4cb5-949b-c712d3120905 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.617582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562b0d-0f3b-48a5-adcc-8f10751056bf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.644503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.645534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.646015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.646487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.647957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.649644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.656984 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 62/124] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.658303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.661890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.662633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.663042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.663324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.682974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.761796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.763706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.783234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265633f-4c07-4c7b-a491-8c1bc3cc2e45 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:54.800002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.819299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:54.820014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:54.820292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:54.820568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:54.821296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] RBAC: Adding query filter params (role.id=f1546c42bfde496495dd863a8eb29ff1, scope.project.id=f483b36d886f4819b95ff3ea9b13a547, user.id=181b6bd00bde47c9ad4268d2ba2962c2) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:54.821616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:54.823099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:54.838660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 63/125] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/role_assignments?user.id=181b6bd00bde47c9ad4268d2ba2962c2&scope.project.id=f483b36d886f4819b95ff3ea9b13a547&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:54.838660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.890732 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 63/126] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:54.897259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:54.940226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:54.962653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271445d-3558-42cd-ba6d-468a717bb2b5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:55.006325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:55.007451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:55.007931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:55.008404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/7ac00bd1ae46418ea2dab2663fa8befe/roles/0250e4e5b08c4c418b2e179db4f9a5f6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:55.011065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, user_id=7ac00bd1ae46418ea2dab2663fa8befe, role_id=0250e4e5b08c4c418b2e179db4f9a5f6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:55.012878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed441-e02b-4a94-91ce-8d5251957757 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:55.027430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82533802-1b0a-4f86-955e-8b1a0022fee1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:55.065265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:55.065899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:55.066179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:55.066452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:55.067625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:55.069306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:55.070982 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 64/127] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:54 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:55.073471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 64/128] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:54 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/users/7ac00bd1ae46418ea2dab2663fa8befe/roles/0250e4e5b08c4c418b2e179db4f9a5f6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:55.077266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:55.082565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:55.189556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98264d9-91b0-466b-b71c-46ea87d22291 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:55.227186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:55.227809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:55.228089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:55.228360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:55.229091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] RBAC: Adding query filter params (role.id=f1546c42bfde496495dd863a8eb29ff1, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3, user.id=181b6bd00bde47c9ad4268d2ba2962c2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:55.229398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:55.230948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811ba6-406d-4dba-85e6-6eb2eab96681 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:55.237850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 65/129] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:55:55 2022] GET /identity/v3/role_assignments?user.id=181b6bd00bde47c9ad4268d2ba2962c2&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:55.500547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51eb3d-49ea-4f52-b8d2-d57e73527ebe None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:55.500837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51eb3d-49ea-4f52-b8d2-d57e73527ebe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:55.501115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51eb3d-49ea-4f52-b8d2-d57e73527ebe None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:55.502471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 65/130] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:55.507797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:55.508094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:55.508372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:55.526401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:55.527611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:55.588148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:55.593934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 66/131] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:55.864781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51eb3d-49ea-4f52-b8d2-d57e73527ebe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:55.964918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51eb3d-49ea-4f52-b8d2-d57e73527ebe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:56.001275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:56.001907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:56.002188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:56.002466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:56.003603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:56.005051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e084a-df5b-4f47-8348-d0c9af5e5031 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:56.006607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 66/132] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:56.012496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:56.105390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e9d-2102-4af5-9783-c763b64e94f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:56.138035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:56.138644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:56.138930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:56.139200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:56.139840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:56.141303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22665e8a-9f61-4f8a-8813-94c3a90ec833 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:56.243297 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 67/133] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:55:56 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:57.261189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d874-4c36-47eb-98a7-6819a37df835 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:57.261737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d874-4c36-47eb-98a7-6819a37df835 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:57.261737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1d874-4c36-47eb-98a7-6819a37df835 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:57.263128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 67/134] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:57.269022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:57.269419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:57.269579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:57.288156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:57.289341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:57.338400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:57.361472 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 68/135] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:57.639073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d874-4c36-47eb-98a7-6819a37df835 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:57.655104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:57.747911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1d874-4c36-47eb-98a7-6819a37df835 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:57.783549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:57.784181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:57.784458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:57.784726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:57.795217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:57.800528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:57.801365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:55:57.802136 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 68/136] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:57.809431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:57.909937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a616-d2cb-4366-893b-7c490c50529b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:57.944343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:57.944948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:57.945230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:57.945505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:57.946172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:57.946477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:57.947901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:57.956881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 69/137] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:55:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:57.962293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:58.035290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.067830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288ab7-f111-4e86-8d19-f607434df962 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:58.103152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:58.104145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.104647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.105153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] PATH_INFO: `/v3/users/7ac00bd1ae46418ea2dab2663fa8befe` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.106537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] RBAC: Authorizing `identity:get_user(user_id=7ac00bd1ae46418ea2dab2663fa8befe)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:58.108231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:58.114522 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 69/138] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:57 2022] GET /identity/v3/users/7ac00bd1ae46418ea2dab2663fa8befe => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:58.116702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:58.166437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.224586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab056fba-3323-4b6c-a227-c41d03ca08c1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:58.261000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:58.261618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.261913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.262195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.331528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:58.333014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1ec28-6def-4963-97d0-237bf312d8f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:58.379480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.437972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:55:58.443717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:58.537214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df3114-975a-4c99-a9d5-562f6079c73b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.537537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df3114-975a-4c99-a9d5-562f6079c73b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.537762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df3114-975a-4c99-a9d5-562f6079c73b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.539140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 71/140] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:55:58.544155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73032-5766-4144-b544-9faeb34c9d4c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.544433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73032-5766-4144-b544-9faeb34c9d4c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.544709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e73032-5766-4144-b544-9faeb34c9d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.551121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b92d5b-8af1-4fc4-a463-f038c5400376 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:58.565021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09e73032-5766-4144-b544-9faeb34c9d4c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:58.566337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09e73032-5766-4144-b544-9faeb34c9d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:58.595697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:58.596686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.597418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.598407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.600295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:58.603058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:58.605079 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 70/141] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:58 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:58.613351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:58.630965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:58.650164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 72/142] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:58.724554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91b4a-bb01-4276-b2d4-232ab4ade519 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.724838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91b4a-bb01-4276-b2d4-232ab4ade519 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.725109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de91b4a-bb01-4276-b2d4-232ab4ade519 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.726808 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 73/143] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:58.731684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.732744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.733726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.736790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa551-9c54-4757-965a-eb48d186b6f8 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:58.752864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:58.754076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:58.781824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:58.782858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.783416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.783689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.784741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] RBAC: Adding query filter params (role.id=0250e4e5b08c4c418b2e179db4f9a5f6, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3, user.id=7ac00bd1ae46418ea2dab2663fa8befe) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:58.785051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:58.786498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b91aa-951c-4f95-ac34-3c6512700c82 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:58.792482 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 71/144] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:55:58 2022] GET /identity/v3/role_assignments?user.id=7ac00bd1ae46418ea2dab2663fa8befe&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=0250e4e5b08c4c418b2e179db4f9a5f6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:58.795909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03b5d-fca8-4c68-8b99-47f6ae06da6f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.796299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03b5d-fca8-4c68-8b99-47f6ae06da6f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.796646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03b5d-fca8-4c68-8b99-47f6ae06da6f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.798106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 72/145] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:55:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:55:58.804135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:58.804715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:58.805223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:58.826893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:55:58.829343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:55:58.833940 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 74/146] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:55:58.915363 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 73/147] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:55:58.936670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:58.945768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.040290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560fe7-9d16-456f-a45e-85e37acd477c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.073474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.074097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.074371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.074653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.084898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:59.089653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:59.090933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:59.092229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 75/148] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:55:59.097033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.099607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.114197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.179899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.203663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56546a-a852-4b00-8892-e1f77ea4a152 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.215567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02b5c-3757-401d-8f7a-9037ee97ac8c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.237202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.237792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.238074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.238350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.239057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:59.239364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.240732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.248653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 74/149] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.249961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.250976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.251601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.251878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.252148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.262406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:55:59.267849 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:55:59.268787 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:55:59.269542 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 76/150] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:55:59.270162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.310120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.347086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47dac6-d2d8-4ff8-8ecd-7131edbea4f1 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.367329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83afd1-72b9-4374-af7d-734db015ff33 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.381624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.382253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.382535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.382832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.383930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.385616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.387309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 75/151] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.388064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.396616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.404813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.405429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.405736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.406007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] PATH_INFO: `/v3/users/672a38a64190494ba451e41602be3570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.419892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] RBAC: Authorizing `identity:get_user(user_id=672a38a64190494ba451e41602be3570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.421389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.423029 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 77/152] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/users/672a38a64190494ba451e41602be3570 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.423761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.485278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f35a-223f-420e-a7e7-184459172ffb None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.514596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.519959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.520560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.520836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.521105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.521431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a927038-7870-45e5-b05f-62f9ba4bf05a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.521759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:55:59.522055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.523454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.531505 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 76/153] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.532279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.555705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.556303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.556576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.556843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.557505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.558958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.627913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf839-b476-41e0-ab2f-53b43bcb021a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.649114 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 78/154] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:55:59 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:55:59.650092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.677668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.678430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.678745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.679071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.680287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.682030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.684011 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 77/155] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.690591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.697301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.765303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c051e-9d1d-46cc-adaf-cf384fe917e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.767159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.803667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.804316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.804595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.804872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] PATH_INFO: `/v3/users/672a38a64190494ba451e41602be3570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.806061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] RBAC: Authorizing `identity:get_user(user_id=672a38a64190494ba451e41602be3570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.807560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.809511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 79/156] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/users/672a38a64190494ba451e41602be3570 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:55:59.810265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc8a2-e821-4b5e-a2f5-d6f9ccc91e22 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.816058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:55:59.849147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.849814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.850096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.850370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/users/672a38a64190494ba451e41602be3570/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.852566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, user_id=672a38a64190494ba451e41602be3570, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.854045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.920005 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 78/157] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:59 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/users/672a38a64190494ba451e41602be3570/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:55:59.934147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256fd48-65de-492a-80bc-ebaf6eb70de1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:55:59.946058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:55:59.977589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:55:59.978243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:55:59.978523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:55:59.978823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:55:59.980041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:55:59.981525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16e8b0-6c65-4fb8-b282-b6157a712ce1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:55:59.983515 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 80/158] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:55:59 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:55:59.990041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:00.106611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fedf9-e8a8-4291-8895-0234af7742d2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:00.132597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:00.144997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:00.148772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:00.148772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:00.148772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/users/672a38a64190494ba451e41602be3570/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:00.148772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, user_id=672a38a64190494ba451e41602be3570, role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:00.150085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90e56e-1886-43a2-8cc6-9ca8c6cf2b5e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:00.216794 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 79/159] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:55:59 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/users/672a38a64190494ba451e41602be3570/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:01.992862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434d739-3581-462d-86f6-465fc255cf51 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:01.993356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434d739-3581-462d-86f6-465fc255cf51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:01.993356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434d739-3581-462d-86f6-465fc255cf51 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:01.994798 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 81/160] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:02.000315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03957c3e-97ec-4475-96b3-708a1d793673 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.000733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03957c3e-97ec-4475-96b3-708a1d793673 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.000923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03957c3e-97ec-4475-96b3-708a1d793673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.021401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-03957c3e-97ec-4475-96b3-708a1d793673 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:02.022605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-03957c3e-97ec-4475-96b3-708a1d793673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:02.088990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff6d-c406-4583-a69b-e58221a71ec7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.089588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff6d-c406-4583-a69b-e58221a71ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.090132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff6d-c406-4583-a69b-e58221a71ec7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.091820 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 82/161] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:02.096419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 80/162] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:02.097335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.097618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.098009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.116212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:02.117379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:02.142093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3392-3b49-4236-a8ae-3caf07d3ca3c None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.142380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3392-3b49-4236-a8ae-3caf07d3ca3c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.142706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3392-3b49-4236-a8ae-3caf07d3ca3c None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.144039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 81/163] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:02.148889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62194d-69ec-4f86-8b60-34a4be5563c6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.149178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62194d-69ec-4f86-8b60-34a4be5563c6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.149455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62194d-69ec-4f86-8b60-34a4be5563c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.167836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4a62194d-69ec-4f86-8b60-34a4be5563c6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:02.169019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a62194d-69ec-4f86-8b60-34a4be5563c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:02.193318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 83/164] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:02.248517 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 82/165] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:02.365607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.384407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23379a7-d42b-4ca7-b1b2-52d051fb74b5 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.384693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23379a7-d42b-4ca7-b1b2-52d051fb74b5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.392224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23379a7-d42b-4ca7-b1b2-52d051fb74b5 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.392224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 83/166] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:02.392224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.392501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.392773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.410685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:02.411855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:02.543064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9f1df-ed71-4bbc-b06f-67120f5b5aaa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:02.547424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:02.550911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:02.577102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:02.577779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.578023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.578286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.579756 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 84/167] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:02.580427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.589520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:02.594520 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:02.595640 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:02.596535 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:02.602775 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 84/168] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:02.603794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.695365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb9d3d-7ec1-4d7e-b3a8-bf5b88b98776 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:02.714661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b33b-ceb7-47ac-86ce-eac081c2b6b5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:02.736126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:02.736753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.737025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.737289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.738835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:02.740285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:02.741997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 85/169] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:02.742680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.757545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:02.758558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.758871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.759307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.769829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:02.774628 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:02.775491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 85/170] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:02.777019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.791723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:02.805875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:02.849906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22bab-6feb-44d7-87fc-0db84fd40af0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:02.879453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7cd6-4af2-4f7d-ad3c-4615dc011179 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:02.884487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:02.885409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.885744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.886074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.886786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] RBAC: Adding query filter params (name=member) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:02.887083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:02.888500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:02.896399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 86/171] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:02.899536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.914720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:02.915329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:02.915645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:02.916134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:02.916802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:02.918257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:02.997475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 86/172] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:02 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:02.998293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:02.999116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44356d-ba39-47ae-b389-ce048ead74ed None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.000706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.041864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.043437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.043998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.044476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.046071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:03.047225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.048667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.060538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 87/173] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.065271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.107044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.127383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3ac9-9ef9-40e3-884f-cb48c850cf22 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.169869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.170073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.170381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.170773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.179792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e5c0-7524-4e19-8fb5-2c9e066df469 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.187219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:03.192194 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:03.193069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:03.193822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 87/174] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:56:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:03.194465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.221987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.222667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.222951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.223224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] PATH_INFO: `/v3/users/7b87876ec2d34ddebbcebd0ce6fc591c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.237505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] RBAC: Authorizing `identity:get_user(user_id=7b87876ec2d34ddebbcebd0ce6fc591c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.239000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.240652 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 88/175] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/users/7b87876ec2d34ddebbcebd0ce6fc591c => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.242480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.272796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.315028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a87f-a016-45f7-996f-a1c6ad59a65e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.362153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.363614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.363614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.363614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] PATH_INFO: `/v3/users/672a38a64190494ba451e41602be3570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.364328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57d56-29d8-4513-b856-36fd3f28ff2f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.365004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] RBAC: Authorizing `identity:get_user(user_id=672a38a64190494ba451e41602be3570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.368004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.368127 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 88/176] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/users/672a38a64190494ba451e41602be3570 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.369543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.385398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.407637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.408247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.408566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.408838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.409500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:03.409801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.411364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.421857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 89/177] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.427554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.487603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef1d97-e18b-4e9f-93a1-692885b54a9d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.518919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.532443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.533078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.533391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.533676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.534854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.536309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.538224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c890a7-07a2-4e6e-ba03-70a1a28a1459 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.542807 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 89/178] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.543754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.574930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.575670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.576045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.576416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.633656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.653171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.654882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.665825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529fed-a999-4c33-9d6f-b9c2630b46f3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.714164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.715109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.715533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.715953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] PATH_INFO: `/v3/users/672a38a64190494ba451e41602be3570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.717251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] RBAC: Authorizing `identity:get_user(user_id=672a38a64190494ba451e41602be3570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.719953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.721057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 90/179] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/users/672a38a64190494ba451e41602be3570 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:03.723149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.758558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.776199 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 90/180] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:03.777391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:03.862036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28330d-1807-4e91-a8e4-1ec0de573d60 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.898733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.899790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.900271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.900752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eefbdc-2cd4-40b9-b1fe-0bcb7476aa65 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:03.900985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/users/7b87876ec2d34ddebbcebd0ce6fc591c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.903155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, user_id=7b87876ec2d34ddebbcebd0ce6fc591c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:03.904906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:03.936642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:03.937831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:03.938109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:03.938431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:03.993078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:03.996505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 91/181] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:03 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/users/7b87876ec2d34ddebbcebd0ce6fc591c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:03.998192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:04.012938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:04.027388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:04.028771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:04.134078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3150-b1d0-4161-85cc-3bd75ba776d6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:04.178984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:04.180887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:04.181401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:04.181871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:04.183579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:04.185412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:04.188123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 92/182] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:04.194079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:04.263301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 91/183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:04.269073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:04.319990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:04.365390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2fe8-ac33-406c-a476-4fabe8b7c51c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:04.427360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:04.428573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:04.429733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:04.430369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:04.432488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=03987805056b4979958a5c3c4655b4f4, user.id=672a38a64190494ba451e41602be3570) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:04.433453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:04.435818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:04.441834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:04.449309 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 93/184] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:04 2022] GET /identity/v3/role_assignments?user.id=672a38a64190494ba451e41602be3570&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:04.472265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebee674-026c-4050-8f00-91d461445dac None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:04.522903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:04.523924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:04.524402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:04.524870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:04.526360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:04.528081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd51649-257a-4f28-8758-0ddae6d312f5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:04.530356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 92/185] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:04 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:04.537583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:04.682568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07591279-a6bd-4b85-bc1f-45c41b19f8d6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:04.731762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:04.732371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:04.732644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:04.732913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:04.733697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] RBAC: Adding query filter params (role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9, scope.project.id=03987805056b4979958a5c3c4655b4f4, user.id=672a38a64190494ba451e41602be3570) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:04.734498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:04.735963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb03784-cfd1-47fa-bd8e-6037e1f9b365 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:04.743016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 94/186] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:04 2022] GET /identity/v3/role_assignments?user.id=672a38a64190494ba451e41602be3570&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:05.375904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f298b-4c53-4dac-8584-194e30458db3 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:05.382796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f298b-4c53-4dac-8584-194e30458db3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:05.382796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f298b-4c53-4dac-8584-194e30458db3 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:05.382796 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 93/187] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:05.383125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8615ea-88a2-4c1c-9210-ec9ad609cbf4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:05.383514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8615ea-88a2-4c1c-9210-ec9ad609cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:05.383600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8615ea-88a2-4c1c-9210-ec9ad609cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:05.390717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:05.402999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb8615ea-88a2-4c1c-9210-ec9ad609cbf4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:05.404183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb8615ea-88a2-4c1c-9210-ec9ad609cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:05.472761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 95/188] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:05.611376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9c83d-89e4-472b-a3c7-fa9671944172 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:05.611752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9c83d-89e4-472b-a3c7-fa9671944172 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:05.611933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9c83d-89e4-472b-a3c7-fa9671944172 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:05.613405 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 94/189] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:05.618398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:05.618714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:05.618987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:05.638133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:05.639263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:05.704794 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 96/190] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:05.748982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9c83d-89e4-472b-a3c7-fa9671944172 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:05.852336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9c83d-89e4-472b-a3c7-fa9671944172 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:05.887723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:05.888423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:05.888624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:05.888903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:05.899506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:05.904640 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:05.906050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:05.906911 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:05.910954 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 95/191] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:05.912239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:05.975150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:05.977746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:05.994573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:06.014465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ba627-a3ef-4649-8a82-e04bbbe3016d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.050740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.051348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.051630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.051933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.052589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:06.052895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.054272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.062550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 97/192] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:06.067858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:06.090516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644aef0-aae2-47ce-ad55-23f3e3f079b7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.126447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.127115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.127398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.127663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.128780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.130220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.136453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 96/193] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:06.137601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:06.177855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fc7be-27aa-4e7b-a462-a3e4be94be26 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.203026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:06.214054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.217116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.217116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.217116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] PATH_INFO: `/v3/users/8725f4e0be6d42a986da90c4b514a6b2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.222775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:06.233203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] RBAC: Authorizing `identity:get_user(user_id=8725f4e0be6d42a986da90c4b514a6b2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.235695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.242195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 98/194] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:06 2022] GET /identity/v3/users/8725f4e0be6d42a986da90c4b514a6b2 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:06.243442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:06.248932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133beaa-ef11-4a91-b00c-adb0ce6eb544 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.283517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.284127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.284406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.284677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.285329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.286831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce6a7a-3b54-433d-b702-f0b6b1677c56 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.348075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926ca8-bcf7-465e-8b3a-0a0d726385fa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.363740 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 97/195] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:06 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:06.364970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3ebc-864f-4110-b541-bace46b74e8d None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.365331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3ebc-864f-4110-b541-bace46b74e8d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.365574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3ebc-864f-4110-b541-bace46b74e8d None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.366957 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 98/196] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:06.372568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.372899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.373118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.386886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.387567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.387813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.388087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.389300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.391453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.393519 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 99/197] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:06 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:06.393727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:06.394970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:06.399288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:06.455788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:06.474669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 99/198] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:06.515535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20bc1-049d-4c9e-a4bd-2e77f85399f9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.552533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.553195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.553471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.553746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/users/8725f4e0be6d42a986da90c4b514a6b2/roles/0250e4e5b08c4c418b2e179db4f9a5f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.555877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, user_id=8725f4e0be6d42a986da90c4b514a6b2, role_id=0250e4e5b08c4c418b2e179db4f9a5f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:06.557362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:06.615568 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 100/199] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:06 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/users/8725f4e0be6d42a986da90c4b514a6b2/roles/0250e4e5b08c4c418b2e179db4f9a5f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 13:56:06.744084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:06.817975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:06.853832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445be3e7-ec2c-4db7-8b7f-8e07eaceb45f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:06.889692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:06.890899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:06.891172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:06.891430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:06.902568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:06.907593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:06.908662 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:06.909629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:06.913861 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 100/200] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:06.920259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:07.029613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b03c3-ce92-4900-8377-6377aabd8cea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:07.040289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:07.065639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:07.066260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:07.066539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:07.066843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:07.067512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:07.067818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:07.069210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:07.077658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 101/201] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:07.083446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:07.188976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32467e-22c0-4011-a166-8436667b1f17 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:07.214686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:07.223240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:07.223873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:07.224149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:07.224420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] PATH_INFO: `/v3/users/7b87876ec2d34ddebbcebd0ce6fc591c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:07.225563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] RBAC: Authorizing `identity:get_user(user_id=7b87876ec2d34ddebbcebd0ce6fc591c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:07.227036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:07.232229 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 101/202] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:07 2022] GET /identity/v3/users/7b87876ec2d34ddebbcebd0ce6fc591c => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:07.234982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:07.338270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa674857-5cd0-4e41-a802-3a197d301b94 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:07.372678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:07.373282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:07.373549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:07.373819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:07.444634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:07.475221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:07.476689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:07.575171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 102/203] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:07.581088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:07.681837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d3b0-ba05-4049-9b3f-537dd6713da5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:07.720017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:07.720928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:07.721416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:07.721948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:07.723297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:07.724971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab0502-2451-4cd9-80dc-8cb23561f03f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:07.726862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 102/204] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:07 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:07.732938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:07.803790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:07.833786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c90c8-199a-441e-a88f-6cee6346378f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:07.868388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:07.868989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:07.869266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:07.869578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:07.870355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] RBAC: Adding query filter params (role.id=f1546c42bfde496495dd863a8eb29ff1, scope.project.id=03987805056b4979958a5c3c4655b4f4, user.id=7b87876ec2d34ddebbcebd0ce6fc591c) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:07.870682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:07.872178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600661-262d-4382-bd2e-75515f980ba8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:07.882753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 103/205] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:07 2022] GET /identity/v3/role_assignments?user.id=7b87876ec2d34ddebbcebd0ce6fc591c&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:08.750696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb85b-389f-4287-97b7-f6ede5cf2e54 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.751220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb85b-389f-4287-97b7-f6ede5cf2e54 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.751220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afb85b-389f-4287-97b7-f6ede5cf2e54 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.752753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 103/206] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:08.757720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fc61d-7dd1-4f5e-b6aa-b19166223b78 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.758114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fc61d-7dd1-4f5e-b6aa-b19166223b78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.758525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fc61d-7dd1-4f5e-b6aa-b19166223b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.759725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea42844-562f-42ee-bc61-a8a4d0c709b8 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.760009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea42844-562f-42ee-bc61-a8a4d0c709b8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.760548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea42844-562f-42ee-bc61-a8a4d0c709b8 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.761946 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 104/207] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:08.767615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a3fc-64e7-41fb-aa1f-d2988e2ab695 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.767915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a3fc-64e7-41fb-aa1f-d2988e2ab695 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.768159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a3fc-64e7-41fb-aa1f-d2988e2ab695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.778083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-281fc61d-7dd1-4f5e-b6aa-b19166223b78 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:08.779342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-281fc61d-7dd1-4f5e-b6aa-b19166223b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:08.788545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b5c7a3fc-64e7-41fb-aa1f-d2988e2ab695 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:08.789765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b5c7a3fc-64e7-41fb-aa1f-d2988e2ab695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:08.851777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:08.854996 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 104/208] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:08.866031 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 105/209] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:08.895772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c86b0-f758-4ab6-92f2-fda58fe0ee0c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.896053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c86b0-f758-4ab6-92f2-fda58fe0ee0c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.896335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c86b0-f758-4ab6-92f2-fda58fe0ee0c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.897803 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 105/210] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:08.902760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:08.903044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:08.903315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:08.922044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:08.924008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:08.995173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 106/211] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:09.126969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c86b0-f758-4ab6-92f2-fda58fe0ee0c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.137025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.198094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.235433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c86b0-f758-4ab6-92f2-fda58fe0ee0c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.239763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f1a96-3efe-49b2-a74f-7d00682fec4a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.264398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.270846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.271471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.271746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.272012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.273095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.274515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.276223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 106/212] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:09.276540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.276901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.277242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.277526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.277797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.288454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:09.293925 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:09.294975 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 107/213] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:09.295927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.379050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75545-07c1-42ad-93ad-983f56aa0a00 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.394983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e8ef-6e3f-4498-a586-f286ef193e55 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.414132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.414785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.415055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.415319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.417080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.426207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:09.428389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.429735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.429735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.429735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.430120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:09.430982 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:09.431925 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:09.432718 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:09.433326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.433404 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 107/214] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:09.433752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.511753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 108/215] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:09 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:09.511753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.532332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d99b-0fad-4b56-ac0e-916db970ac8f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.572005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.572630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.572906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.573171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.573843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:09.574145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.575613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.577793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.585763 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 108/216] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:09.591941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.651552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700bca-7370-47d0-a9fd-74c09a9b77fb None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.656644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.690225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.691662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.691662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.691662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.692048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] RBAC: Adding query filter params (name=reader) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:09.692331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.694598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.702433 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 109/217] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:09.709322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ab6e-773d-4256-bd31-957e37538426 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.709490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.752585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.753226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.753507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.753778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] PATH_INFO: `/v3/users/0477070e4bb143d5ad2e9c43894b3e20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.768938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] RBAC: Authorizing `identity:get_user(user_id=0477070e4bb143d5ad2e9c43894b3e20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.770553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.772406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 109/218] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/users/0477070e4bb143d5ad2e9c43894b3e20 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:09.778092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.831383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.834694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5ef49-6858-4bc0-91c8-85fef81f074c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.877991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.878654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.878926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.879206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] PATH_INFO: `/v3/users/8725f4e0be6d42a986da90c4b514a6b2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.880355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] RBAC: Authorizing `identity:get_user(user_id=8725f4e0be6d42a986da90c4b514a6b2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.881809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.883476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 110/219] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/users/8725f4e0be6d42a986da90c4b514a6b2 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:09.889188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:09.901607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e132af-03f2-43d0-aab2-f697a6f7b772 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:09.917607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:09.940615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:09.941559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:09.942100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:09.942637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:09.943641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] RBAC: Adding query filter params (role.id=f1546c42bfde496495dd863a8eb29ff1, user.id=0477070e4bb143d5ad2e9c43894b3e20, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:09.944177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:09.945871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:09.951436 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 110/220] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/role_assignments?user.id=0477070e4bb143d5ad2e9c43894b3e20&scope.system=all&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:10.009263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d510-3f43-4665-aeb8-03ad59b214ff None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:10.047671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:10.048286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:10.048562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:10.048832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:10.086364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:10.122549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:10.124112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:10.237545 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 111/221] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 13:56:10.244091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:10.352164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df8a51-2801-435b-bce8-27f65069789a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:10.392200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:10.392827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:10.393103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:10.393369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:10.394474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:10.395940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94812e5-0726-42ae-8aec-56639ef8e1c5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:10.402323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 111/222] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:10 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:10.404446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:10.500050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:10.536637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c370-ff2a-45c5-ae02-80e92eabc0b7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:10.575669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:10.576276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:10.576549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:10.576816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:10.578121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] RBAC: Adding query filter params (role.id=0250e4e5b08c4c418b2e179db4f9a5f6, scope.project.id=03987805056b4979958a5c3c4655b4f4, user.id=8725f4e0be6d42a986da90c4b514a6b2) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:10.578424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:10.579957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0aef-7c5d-4cf6-9f24-1875914a0fe7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:10.586331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 112/223] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:10 2022] GET /identity/v3/role_assignments?user.id=8725f4e0be6d42a986da90c4b514a6b2&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=0250e4e5b08c4c418b2e179db4f9a5f6 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:11.837533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fb4f-4108-4f5c-8ded-15f1d83108e9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:11.838072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fb4f-4108-4f5c-8ded-15f1d83108e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:11.838072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fb4f-4108-4f5c-8ded-15f1d83108e9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:11.839445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 112/224] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:11.844771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:11.845265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:11.845431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:11.863676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:11.864864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:11.913396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8491-2ec0-4b89-9db5-56bf7199f2e7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:11.913966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8491-2ec0-4b89-9db5-56bf7199f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:11.914342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8491-2ec0-4b89-9db5-56bf7199f2e7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:11.915906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 113/225] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:11.920458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f5f7-eb3e-430d-bb90-07f60e40335a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:11.920732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f5f7-eb3e-430d-bb90-07f60e40335a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:11.921612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f5f7-eb3e-430d-bb90-07f60e40335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:11.934466 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 113/226] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:11.940203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ab7f5f7-eb3e-430d-bb90-07f60e40335a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:11.941375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ab7f5f7-eb3e-430d-bb90-07f60e40335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:11.982590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.006437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 114/227] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:12.204838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.210736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a3b7-b13c-4bc2-a1c4-469aa8eec4da None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.211022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a3b7-b13c-4bc2-a1c4-469aa8eec4da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.211294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a3b7-b13c-4bc2-a1c4-469aa8eec4da None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.212787 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 115/228] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:12.217293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.217569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.218376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.236707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:12.237783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:12.268634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.307027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e9f0-5be5-4d12-bc69-3b58e81cef25 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.308442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 116/229] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:12.311559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.344593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.345427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.345892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.346161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.356328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:12.361134 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:12.362007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:12.362811 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 114/230] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:12.367767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.424353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b982a49-0da4-47cc-9bd5-8d4bb5aa9dd5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.433537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.463275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.463900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.464178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.464452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.465533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:12.466992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:12.469103 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 117/231] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:12.471206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60051a-ff43-4e28-a495-c1d85da17b33 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.474410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.496399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.507772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.510990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.510990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.510990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.510990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:12.510990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:12.511522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:12.520077 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 115/232] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:12.525454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.579552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe84287-409c-4f11-82cf-268e6e47069d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.613521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.614121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.614395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.614689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.615312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:12.616746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:12.628372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf0767-5580-43b6-acff-2463ed52c577 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.661179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.661787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.662060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.662323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] PATH_INFO: `/v3/users/8152db57f66844b0bcb80f7f94207a63` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.676755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] RBAC: Authorizing `identity:get_user(user_id=8152db57f66844b0bcb80f7f94207a63)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:12.678195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:12.679820 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 116/233] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/users/8152db57f66844b0bcb80f7f94207a63 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:12.680568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.720862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 118/234] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Oct 31 13:56:12 2022] POST /identity/v3/groups => generated 229 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:12.721564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.721678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.761433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:12.794556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b359-abd8-4629-9066-2b32ae5fa884 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.835984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c709e3-ca2d-4586-81d2-bd29de5aeb68 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.837151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.839174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.839335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.839610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.852063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:12.857106 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:12.858000 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:12.859739 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 117/235] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:12.864877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:12.876488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:12.877532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:12.877810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:12.878079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:12.879167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] RBAC: Adding query filter params (role.id=0250e4e5b08c4c418b2e179db4f9a5f6, user.id=8152db57f66844b0bcb80f7f94207a63, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:12.879649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:12.881197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:12.887032 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 119/236] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/role_assignments?user.id=8152db57f66844b0bcb80f7f94207a63&scope.system=all&role.id=0250e4e5b08c4c418b2e179db4f9a5f6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:12.986331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b7b7-7e3f-4b82-85ba-1aca9471ae10 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:12.988115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:13.024034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:13.024566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:13.024845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:13.025118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:13.025787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] RBAC: Adding query filter params (name=member) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:13.026091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:13.027536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:13.037789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 118/237] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:13.043408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:13.140798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:13.146946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51015f-ab70-432b-82fb-23ff7590827c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:13.181622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:13.182246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:13.182523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:13.182822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] PATH_INFO: `/v3/users/0477070e4bb143d5ad2e9c43894b3e20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:13.183942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] RBAC: Authorizing `identity:get_user(user_id=0477070e4bb143d5ad2e9c43894b3e20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:13.185397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10f7a9-b0d2-44ff-8119-6c2235dbf638 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:13.187253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 120/238] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:13 2022] GET /identity/v3/users/0477070e4bb143d5ad2e9c43894b3e20 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:13.192618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:13.295769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc48a-44ff-44f9-990f-123946017168 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:13.329286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:13.329931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:13.330209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:13.330481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] PATH_INFO: `/v3/system/users/0477070e4bb143d5ad2e9c43894b3e20/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:13.331915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0477070e4bb143d5ad2e9c43894b3e20, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:13.333307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f69ad0-c107-4637-9c1c-751db6962d1e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:13.422318 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 119/239] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Oct 31 13:56:13 2022] PUT /identity/v3/system/users/0477070e4bb143d5ad2e9c43894b3e20/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:14.949016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ac4a-ea5a-4858-97af-642274091f61 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:14.949545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ac4a-ea5a-4858-97af-642274091f61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:14.949545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ac4a-ea5a-4858-97af-642274091f61 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:14.954661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 121/240] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:14.957400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbcd7-1434-4172-a110-131f2bbc27ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:14.957865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbcd7-1434-4172-a110-131f2bbc27ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:14.957938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbcd7-1434-4172-a110-131f2bbc27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:14.978973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f5fcbcd7-1434-4172-a110-131f2bbc27ae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:14.980055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5fcbcd7-1434-4172-a110-131f2bbc27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:15.003602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:15.046647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 120/241] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:15.053143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2078b8-adbe-4c0c-b97a-bd9c1fcc3c0b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.053427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2078b8-adbe-4c0c-b97a-bd9c1fcc3c0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.053697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2078b8-adbe-4c0c-b97a-bd9c1fcc3c0b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.055177 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 122/242] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:15.059975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.060264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.060537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.079425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:15.080594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:15.148765 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 121/243] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:15.315197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2078b8-adbe-4c0c-b97a-bd9c1fcc3c0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.417863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2078b8-adbe-4c0c-b97a-bd9c1fcc3c0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:15.418595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.460984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:15.465962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.465962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.465962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.465962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:15.466282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:15.467757 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 123/244] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:15.473130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.509190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:15.522902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:15.534657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41195b3-25ca-4eb2-842f-830dff4aeb93 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:15.571725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:15.572277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.572552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.572820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.579360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559b66-1bca-49df-b07d-4ce599710a73 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:15.582764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0a303552-d9d7-48d4-a959-f8cf74dcef86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:15.587576 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:15.588581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 122/245] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:15.589790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132188-8718-4da6-a610-cb595972af90 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.590704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132188-8718-4da6-a610-cb595972af90 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.590704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132188-8718-4da6-a610-cb595972af90 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.591672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 123/246] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:15.594230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a132188-8718-4da6-a610-cb595972af90 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.616678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:15.617391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.617670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.617935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.618554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:15.620014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d8d18-11f7-4ced-80e1-8649613d5f08 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:15.693803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a132188-8718-4da6-a610-cb595972af90 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:15.708745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 124/247] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Oct 31 13:56:15 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:56:15.708745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.708745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.708745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.732388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:15.734354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:15.738584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:15.739227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.739504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.739771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.740476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:15.740749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:15.742156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:15.752245 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 124/248] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:15.758653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.773908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:15.819113 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 125/249] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:15.876571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054ef2-918a-479a-9d20-87664cc22d79 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:15.913007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:15.913625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:15.913903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:15.914184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] PATH_INFO: `/v3/users/8152db57f66844b0bcb80f7f94207a63` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:15.915568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] RBAC: Authorizing `identity:get_user(user_id=8152db57f66844b0bcb80f7f94207a63)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:15.917038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:15.918781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 125/250] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:15 2022] GET /identity/v3/users/8152db57f66844b0bcb80f7f94207a63 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:15.925059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:15.953685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:16.036943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c3f83-befc-4291-8aa1-06a8b52270a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:16.072117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:16.072769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:16.073044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:16.073314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] PATH_INFO: `/v3/system/users/8152db57f66844b0bcb80f7f94207a63/roles/0250e4e5b08c4c418b2e179db4f9a5f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:16.074721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8152db57f66844b0bcb80f7f94207a63, role_id=0250e4e5b08c4c418b2e179db4f9a5f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:16.076094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:16.090274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:16.154010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Oct 31 13:56:15 2022] PUT /identity/v3/system/users/8152db57f66844b0bcb80f7f94207a63/roles/0250e4e5b08c4c418b2e179db4f9a5f6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:16.182107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:16.210248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d5d44-9470-4d6d-9560-e2389a551a2c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:16.251599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:16.252358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:16.252696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:16.253016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:16.265653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:16.271279 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:16.272204 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:16.272978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 126/252] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:16.279941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:16.378721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:16.391678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd63a6-e09b-4631-b09a-5a70ddad300b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:16.426469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:16.427023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:16.427297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:16.427564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:16.428283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:16.428575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:16.430047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:16.444612 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 127/253] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:16.446132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:16.554987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbca21c-7f9d-41c9-b7a6-edb33da484f9 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:16.591186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:16.591813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:16.592090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:16.592347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] PATH_INFO: `/v3/users/0477070e4bb143d5ad2e9c43894b3e20` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:16.593623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=0477070e4bb143d5ad2e9c43894b3e20)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:16.595129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f54b9e-11e9-49fc-9cf8-2c85aa8a1ec4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:16.596771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 127/254] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:16 2022] GET /identity/v3/users/0477070e4bb143d5ad2e9c43894b3e20 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:16.602812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:16.713834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17041-01e9-4e3b-b59a-77117a75fbb3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:16.759161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:16.759787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:16.760059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:16.760321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:16.761329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] RBAC: Adding query filter params (role.id=f1546c42bfde496495dd863a8eb29ff1, user.id=0477070e4bb143d5ad2e9c43894b3e20, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:16.761634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:16.763222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba447f0-450d-4902-bca5-a6c67b775bf2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:16.782821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 128/255] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 31 13:56:16 2022] GET /identity/v3/role_assignments?user.id=0477070e4bb143d5ad2e9c43894b3e20&scope.system=all&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:18.273577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effaaaa-3dd0-4cfa-bd3b-ccf67d393fdd None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.274087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effaaaa-3dd0-4cfa-bd3b-ccf67d393fdd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.274087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effaaaa-3dd0-4cfa-bd3b-ccf67d393fdd None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.275797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 128/256] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:18.280790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a295b-a1cc-4834-a6b2-1b9b3fea8785 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.281206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a295b-a1cc-4834-a6b2-1b9b3fea8785 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.281374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a295b-a1cc-4834-a6b2-1b9b3fea8785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.307416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-260a295b-a1cc-4834-a6b2-1b9b3fea8785 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:18.308598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-260a295b-a1cc-4834-a6b2-1b9b3fea8785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:18.313611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:18.372954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:56:18.649818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a861e-04a6-4185-839e-86d8799c55a2 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.650185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a861e-04a6-4185-839e-86d8799c55a2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.650355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a861e-04a6-4185-839e-86d8799c55a2 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.651997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 129/258] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:18.657481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.657771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.658042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.687683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:18.688924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:18.696689 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:56:18.851624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a861e-04a6-4185-839e-86d8799c55a2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:18.868762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a861e-04a6-4185-839e-86d8799c55a2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:18.877030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:18.877664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.877937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.878205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.880231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:18.894025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:18.899037 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:18.899927 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:18.900721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 130/260] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:18.906823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:18.920537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307df229-790c-4dae-ae3f-4a2b9cca4f20 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:18.930790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:18.931406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.931684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.931951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.932620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:18.932917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:18.934736 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:18.934736 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 13:56:18.934736 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 13:56:18.935650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:18.950285 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 131/261] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:18.955521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:18.965629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3a11-fe69-493f-aef0-e1a7e93c2d58 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:18.975608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:18.976553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:18.976831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:18.977140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:18.989943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:18.991764 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:18.991764 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 13:56:18.991764 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 13:56:18.993000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:18.994978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 131/262] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 31 13:56:18 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:19.000492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.015738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f5ea8-b6bd-4ed6-8f28-7091f4657cb0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.024619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.025299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.025624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.025897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.027539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.029761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.032097 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 132/263] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:56:18 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:19.037890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.047856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095983-84b7-48eb-b29f-409092e30547 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.057553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.058221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.058497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.058795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/groups/445ca5c882404bd891b3a238f7f77422/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.063862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, group_id=445ca5c882404bd891b3a238f7f77422, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.064899 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:19.064899 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 13:56:19.064899 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 13:56:19.066887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.088540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.100986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48950f6f-34b0-4665-b69a-b7cf90a698fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.107550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.108197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.108543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.108815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.121844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:19.127280 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:19.129292 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:19.131229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 133/264] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:56:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:19.138892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.143621 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 132/265] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 31 13:56:19 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/groups/445ca5c882404bd891b3a238f7f77422/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:19.151932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0d7e-90fa-40df-85b4-59f917626476 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.220809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.221420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.221755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.222029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.222722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:19.223023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.224727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.234990 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 134/266] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 31 13:56:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:19.240960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.257546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61863-75b2-4f6c-834d-ee2ee20ff836 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.263825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.264467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.265284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.265554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.271482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.273444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.275505 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 133/267] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 31 13:56:19 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:19.282257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.296092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2e8c-3b98-49ba-a806-5d8b7e5705fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.306668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.307725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.308201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.308667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.315631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.318143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fc7d5-99ca-4bbc-afb1-5f8126540351 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.320170 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 135/268] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:56:19 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:19.326200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:19.341973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f019-4584-4d97-ae41-366d8da5ab82 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:19.349650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:19.350328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.350604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.350900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/groups/445ca5c882404bd891b3a238f7f77422/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.356965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c233d0ba5d4202b0c0434fdfa514a3, group_id=445ca5c882404bd891b3a238f7f77422, role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:19.360005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827799c2-c4bf-46fa-9ea1-cd908c41953e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:19.446346 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 134/269] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 31 13:56:19 2022] PUT /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3/groups/445ca5c882404bd891b3a238f7f77422/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:19.587633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576d55-2b77-452f-b825-d16cd87836cb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.588324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576d55-2b77-452f-b825-d16cd87836cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.588797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576d55-2b77-452f-b825-d16cd87836cb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.590542 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 136/270] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:19.596453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.597047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.597512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.604496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7d22-a52f-4209-ba5f-1623ff3c48f6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.605079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7d22-a52f-4209-ba5f-1623ff3c48f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.605572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c7d22-a52f-4209-ba5f-1623ff3c48f6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.607169 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 137/271] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:19.612901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:19.613480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:19.613942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:19.629535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:19.630821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:19.639663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:19.641671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:19.771020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:19.773204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 135/272] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:56:19.784517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 138/273] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:20.078692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.087736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28741-5107-4b2c-80a1-1410074b29c1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.094715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.095352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.095627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.095897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.111119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:20.115992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:20.116854 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:20.117620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 136/274] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:20.125236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.139193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0464-91d5-4f33-94ce-1c93eb40e095 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.148152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.148783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.149067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.149313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.149987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:20.150288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.151958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.165574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 139/275] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:20.171742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.187679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c61f79-eacd-4d9d-af0b-16635514ee84 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.194659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.195292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.195565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.195837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.196721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.196978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.199062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.200914 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 137/276] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:20.206259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.219101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688986-e416-4b96-b31f-1773bbe31a65 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.236050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.236693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.236968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.237238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.239588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.241688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.247984 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 138/277] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:20.255204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.272128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341f1a-e7c5-4c3c-a2c8-b683d8c610e4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.292314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.293144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.293300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.293507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/groups/445ca5c882404bd891b3a238f7f77422/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.295520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, group_id=445ca5c882404bd891b3a238f7f77422, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.298753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50800cbc-deba-46be-8743-e49b761e1aaa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.385749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709b8a2-d15d-468d-affc-1c5ab1c57a11 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.389699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 139/278] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 31 13:56:20 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/groups/445ca5c882404bd891b3a238f7f77422/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:20.390435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce835f2-07ea-4fee-aed3-12734c23c44e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.390769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce835f2-07ea-4fee-aed3-12734c23c44e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.391048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce835f2-07ea-4fee-aed3-12734c23c44e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.392420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 140/279] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:20.398132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.398421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.398749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.432375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:20.433569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.433770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:20.434248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.434527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.434883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.449494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:20.455605 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:20.457646 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:20.459681 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 140/280] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:20.469958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.547303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:20.582169 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 141/281] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:56:20.645014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cfd43-ff32-4bf0-b90e-ad4fcde5acc0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.695094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.695714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.695992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.696262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.696936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:20.697238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.698758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.718644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 141/282] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:20.727795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.757613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:20.853943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc0ce-0869-4ff7-92df-eb5e58fe7447 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:20.891062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:20.891698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:20.891972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:20.892236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] PATH_INFO: `/v3/users/8152db57f66844b0bcb80f7f94207a63` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:20.893383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] RBAC: Authorizing `identity:get_user(user_id=8152db57f66844b0bcb80f7f94207a63)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:20.894863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:20.896799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 142/283] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/users/8152db57f66844b0bcb80f7f94207a63 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:20.902535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.975710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:20.999623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6015da-f0a2-4fd9-ad29-121f08b7b486 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.012259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.013018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.013392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.013761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.043393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:21.049057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:21.050186 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:21.051277 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:21.056969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9a98e-9aba-45d0-a171-6d7f1f53d864 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.057508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 143/284] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:21.059025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:21.063033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:21.078140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61ee6-7377-4ebc-a7ef-f0c2d4374539 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.092151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.093438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.093836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.094176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.095023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:21.095422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:21.096534 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:21.096534 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 13:56:21.096534 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 13:56:21.097653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:21.100761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.101555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.102052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.102459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.103365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] RBAC: Adding query filter params (role.id=0250e4e5b08c4c418b2e179db4f9a5f6, user.id=8152db57f66844b0bcb80f7f94207a63, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:21.104301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:21.105932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:21.118035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 144/285] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 31 13:56:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:21.122483 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 142/286] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 31 13:56:20 2022] GET /identity/v3/role_assignments?user.id=8152db57f66844b0bcb80f7f94207a63&scope.system=all&role.id=0250e4e5b08c4c418b2e179db4f9a5f6 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:21.126832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:21.140518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f67c71-9152-4f72-8aa6-4178a1b482d1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.157333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.158062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.158442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.158839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.163478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:21.165598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:21.167453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 145/287] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 31 13:56:21 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:21.173902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:21.192811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68f9e-271b-44ee-bda2-d5024aa68445 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.197804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.198801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.199235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.202651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.204604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:21.207071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72843cc9-8206-4759-88fc-369b6a997075 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:21.215200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 143/288] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:56:21 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:21.221372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:21.241241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913cd4-9bad-4a60-90d6-44af075edf87 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:21.251005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:21.251818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.252197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.252589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4/groups/445ca5c882404bd891b3a238f7f77422/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.260931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03987805056b4979958a5c3c4655b4f4, group_id=445ca5c882404bd891b3a238f7f77422, role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:21.263826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0a36-6853-4182-85ae-bd2f4e406954 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:21.355131 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 146/289] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 31 13:56:21 2022] PUT /identity/v3/projects/03987805056b4979958a5c3c4655b4f4/groups/445ca5c882404bd891b3a238f7f77422/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:21.564504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100fec-b9aa-4657-8181-32d1fb53f5a0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.565368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100fec-b9aa-4657-8181-32d1fb53f5a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.565859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100fec-b9aa-4657-8181-32d1fb53f5a0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.567469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 144/290] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:21.573173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:21.573739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:21.574211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:21.601002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:21.602632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:21.658663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:21.672525 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 147/291] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 13:56:22.022131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d100fec-b9aa-4657-8181-32d1fb53f5a0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.039856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d100fec-b9aa-4657-8181-32d1fb53f5a0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:22.044347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:22.044972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.045244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.045510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.059607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:22.065564 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:22.066442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:22.067266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 145/292] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:22.074165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.084825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce1ebb-49ee-4ba5-b21e-bb0882dddee7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:22.095022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:22.095913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.096396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.096867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.097736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:22.098254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:22.100086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:22.113905 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 148/293] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:22.119865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.137240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e1f3-a5e0-4cb9-9965-ce2f2babe61f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:22.147249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:22.147888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.148159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.148423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] PATH_INFO: `/v3/groups/95465a5f94744d7685a4b68b7effd159` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.159240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] RBAC: Authorizing `identity:get_group(group_id=95465a5f94744d7685a4b68b7effd159)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:22.160265 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:22.160265 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 13:56:22.160265 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 13:56:22.161467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:22.163484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 146/294] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Oct 31 13:56:22 2022] GET /identity/v3/groups/95465a5f94744d7685a4b68b7effd159 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:22.169096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.180501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b7ff8-f1cd-4443-b960-dd5e887f4653 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:22.185445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:22.186408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.187492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.187977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] PATH_INFO: `/v3/projects/90ee3928a7cf4c8590e1103847faa6a2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.189344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] RBAC: Authorizing `identity:get_project(project_id=90ee3928a7cf4c8590e1103847faa6a2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:22.191503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072cef5-cb5e-41da-a28d-fcd439e2cceb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:22.198488 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 149/295] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Oct 31 13:56:22 2022] GET /identity/v3/projects/90ee3928a7cf4c8590e1103847faa6a2 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:22.199225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.212204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a320c-ac7a-428f-9002-4c8f5b194759 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:22.223111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:22.223797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.224074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.224338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] PATH_INFO: `/v3/projects/90ee3928a7cf4c8590e1103847faa6a2/groups/95465a5f94744d7685a4b68b7effd159/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.232163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ee3928a7cf4c8590e1103847faa6a2, group_id=95465a5f94744d7685a4b68b7effd159, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:22.233197 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 13:56:22.233197 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 13:56:22.233197 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 13:56:22.235701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63177ae5-f865-4606-9025-8d3374e83ab4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:22.307348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 147/296] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Oct 31 13:56:22 2022] PUT /identity/v3/projects/90ee3928a7cf4c8590e1103847faa6a2/groups/95465a5f94744d7685a4b68b7effd159/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 13:56:22.506638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af6f3-7999-4055-a663-c0049d5bb60f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.507131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af6f3-7999-4055-a663-c0049d5bb60f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.507203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950af6f3-7999-4055-a663-c0049d5bb60f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.508843 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 150/297] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:22.517700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e32f-ca0a-4160-a722-05f3957b3bbf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.518007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e32f-ca0a-4160-a722-05f3957b3bbf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.518254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e32f-ca0a-4160-a722-05f3957b3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.540050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f02e32f-ca0a-4160-a722-05f3957b3bbf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:22.541252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f02e32f-ca0a-4160-a722-05f3957b3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:22.619396 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 148/298] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:22.906175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af6f3-7999-4055-a663-c0049d5bb60f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:22.932605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff684-e0fb-4484-b22e-7f31ef939ac0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.933361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff684-e0fb-4484-b22e-7f31ef939ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.933901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff684-e0fb-4484-b22e-7f31ef939ac0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.936189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 149/299] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:22.946894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:22.947822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:22.948462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:22.991808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:22.993025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:23.086250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950af6f3-7999-4055-a663-c0049d5bb60f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:23.110987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.129117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 150/300] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:23.147491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:23.148120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.148396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.148663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.161316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:23.166568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:23.167468 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:23.168340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 151/301] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:23.175019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.297332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c65c3-29d1-439c-bebf-1bfd1263ce50 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:23.341315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:23.342303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.342864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.343350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.344372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:23.344878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:23.346444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:23.358386 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 151/302] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:23.364054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.419594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.486837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82af9-b5c9-43f7-99a9-e7a5c1ecf692 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:23.518285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.540040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:23.540726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.540929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.541197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.607314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.643704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:23.645182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f2e7-f9cc-4fcf-8f01-95019f00f9d4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:23.692007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca3b2-eb15-498d-9d7a-9703042bf642 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:23.692924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.732973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:23.734154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.734431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.734727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.750017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-40f926bc-9f40-4b31-8272-8ed361691775 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:23.755885 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:23.756829 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:23.757862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 152/303] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:23.758698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c480-f193-4f26-9d77-16537a225aa8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.763444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c480-f193-4f26-9d77-16537a225aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.763444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7c480-f193-4f26-9d77-16537a225aa8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.765000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 153/304] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:23.766943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c480-f193-4f26-9d77-16537a225aa8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.771502 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 152/305] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:23.773025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.773519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.773981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.797919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:23.799474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:23.875475 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 153/306] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:23.876848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.890926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7c480-f193-4f26-9d77-16537a225aa8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:23.898801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.929550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:23.930506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:23.930819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:23.931096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:23.932055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:23.932361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:23.933748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:23.943062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 154/307] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:23.949786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:23.957297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:23.992955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89e9e7-60ad-4ef0-89d9-f711a5d8d1d0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.040822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.040822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.040822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.041180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.042695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.044159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.047575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 154/308] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:24.052933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.074000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1978be-dc24-4a97-82c6-bd3cf2eb8e0a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.112247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.113549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.114057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.114540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.166989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.200035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c2049-3ea2-4825-900e-a8e7d060951a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.200212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.200212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de49aa-1de6-4cca-b352-2ccdd1e87521 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.256094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.256464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.256739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.257005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.264138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.267050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014281bc-ffeb-4359-84ce-599c33ec529b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.269435 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 155/309] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:24.271722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a94a-6a88-45a9-ae7e-3312fea20033 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.272225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a94a-6a88-45a9-ae7e-3312fea20033 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.272692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a94a-6a88-45a9-ae7e-3312fea20033 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.275142 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 156/310] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:24.276960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8a94a-6a88-45a9-ae7e-3312fea20033 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.294162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.324947 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 155/311] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:24.324947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.324947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.324947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.351839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:24.353153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:24.426685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8a94a-6a88-45a9-ae7e-3312fea20033 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.433180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.440773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 156/312] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:24.441489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.468642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.469330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.469754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.470121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.471051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] RBAC: Adding query filter params (group.id=445ca5c882404bd891b3a238f7f77422, role.id=f1546c42bfde496495dd863a8eb29ff1, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:24.471494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.473970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.479975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/role_assignments?group.id=445ca5c882404bd891b3a238f7f77422&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:24.480862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.568439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b291e-53a5-4d1a-bdb3-7c553def62a2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.639899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.640444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.640896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.641084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.641357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] PATH_INFO: `/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.644147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] RBAC: Authorizing `identity:get_project(project_id=e1c233d0ba5d4202b0c0434fdfa514a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.645604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.652306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 157/314] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/projects/e1c233d0ba5d4202b0c0434fdfa514a3 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:24.657575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.697378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b3506-7b69-4690-98bf-3f6374afdbd7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.751654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.752292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.752565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.752833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.765896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:24.775056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:24.775557 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:24.776593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 13:56:24.777464 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:24.779789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 158/315] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:24.786144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.816055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d3fd-bddf-4d37-abbf-32aca7aada4e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.860220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.860956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.861228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.861609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.862813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.864361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.866203 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 158/316] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:24.866826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.919935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd8a41-905f-4e25-bce1-b3529b737cbd None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:24.955002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:24.960964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:24.961579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:24.961862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:24.962131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:24.962852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] RBAC: Adding query filter params (name=member) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:24.963155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:24.964896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:24.975186 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 159/317] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:24.976031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:24.996524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b71a0-318e-4f94-b07a-4b61ee8382fc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.046724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.047359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.047687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.047955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.049902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.065854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:25.071272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:25.072143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:25.072905 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:25.075749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 159/318] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:25.077570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.098729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f2a06-5005-4ed4-a453-a3ad40b57d62 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.137244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.137846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.138119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.138385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.140082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] RBAC: Adding query filter params (group.id=445ca5c882404bd891b3a238f7f77422, role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9, scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:25.140082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.141704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.149090 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 160/319] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 31 13:56:24 2022] GET /identity/v3/role_assignments?group.id=445ca5c882404bd891b3a238f7f77422&scope.project.id=e1c233d0ba5d4202b0c0434fdfa514a3&role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:25.149933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.215014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f2c80-79ac-4d67-8e59-5ef265eb4a32 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.231675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.261766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.262387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.262690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.262963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.301008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ecb58-215a-4173-9a52-1c6f9c846df5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.343957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.352237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.353401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.353649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.353985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.354394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.355308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:25.359985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c0b58-9a72-4c38-a5f4-a3e16ae06134 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.360106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.360106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.368570 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 161/320] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:25.375841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.483540 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 160/321] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:25.484712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8506-aea0-4aea-9045-619e55e13d01 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.484985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8506-aea0-4aea-9045-619e55e13d01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.485250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8506-aea0-4aea-9045-619e55e13d01 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.490785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 161/322] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:25.491968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.492251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.492522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.512185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:25.513356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:25.516944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97bab-c9df-4fce-9bab-1a9b33b546c6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.535792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.559338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.559952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.560223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.560488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.593938 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 162/323] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:25.594647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.628249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.651888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.653994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.730160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564261e-37b5-4269-93b7-b4d5d491aaa0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.777421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.778013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.778283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.778559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.779825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.781300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.784716 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 163/324] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:25.788528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:25.791486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.794427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.817647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.909015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:25.912399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30fcf-c0f8-46eb-9445-fd18e0eb7f86 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.919427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78257fb8-fcfa-4f18-9b07-62f7b7f8fe89 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:25.950238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.950906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.951279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.951459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] PATH_INFO: `/v3/projects/03987805056b4979958a5c3c4655b4f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.952567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] RBAC: Authorizing `identity:get_project(project_id=03987805056b4979958a5c3c4655b4f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.953993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.955949 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 163/326] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/projects/03987805056b4979958a5c3c4655b4f4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:25.956717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:25.959570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:25.959570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:25.959570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:25.959837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:25.960985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:25.962410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:25.966706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 164/327] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:25.966706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.052599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.070531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64831949-0fe9-45e3-b925-3a9053e711a6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.086072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f65a7-c964-423a-87a2-bef52455f619 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.109232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.110206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.110206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.110388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.121128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:26.125774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.126399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:26.126568 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:26.127423 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:26.128196 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:26.129744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.129744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] PATH_INFO: `/v3/groups/445ca5c882404bd891b3a238f7f77422` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.129864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 164/328] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:26.129864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.131551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] RBAC: Authorizing `identity:get_group(group_id=445ca5c882404bd891b3a238f7f77422)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.132224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.133918 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 165/329] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 31 13:56:25 2022] GET /identity/v3/groups/445ca5c882404bd891b3a238f7f77422 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.134714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.175090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.245073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439322c5-30f7-43eb-8fcc-9738f7fabd60 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.249889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c59b1-b733-4e70-a90c-7a459c809621 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.278325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.278949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.279223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.279493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.280787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] RBAC: Adding query filter params (group.id=445ca5c882404bd891b3a238f7f77422, role.id=f1546c42bfde496495dd863a8eb29ff1, scope.project.id=03987805056b4979958a5c3c4655b4f4) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:26.281093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.282654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.282934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.283529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.283806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.284076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.284727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:26.285024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.286374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.288320 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 165/330] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/role_assignments?group.id=445ca5c882404bd891b3a238f7f77422&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=f1546c42bfde496495dd863a8eb29ff1 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.289208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.296791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 166/331] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.302474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.307057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.409727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929940b-80bb-4551-9c4d-35d7ce30c210 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.410260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.420717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb62b-a6c2-4a05-9fa0-6618d3b5e14b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.450905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.451515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.451819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.452196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.453039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] RBAC: Adding query filter params (group.id=445ca5c882404bd891b3a238f7f77422, role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9, scope.project.id=03987805056b4979958a5c3c4655b4f4) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:26.453337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.455018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.457825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.458947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.459227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.459866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.461524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 166/332] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/role_assignments?group.id=445ca5c882404bd891b3a238f7f77422&scope.project.id=03987805056b4979958a5c3c4655b4f4&role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.542505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.544036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.651028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.662091 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 167/333] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 13:56:26.667796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.754809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:26.780739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee0531-80e6-4e58-bbd8-a6c245a0482f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.814610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.815264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.815544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.816104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] PATH_INFO: `/v3/projects/90ee3928a7cf4c8590e1103847faa6a2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.817225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] RBAC: Authorizing `identity:get_project(project_id=90ee3928a7cf4c8590e1103847faa6a2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.818691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.820615 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 167/334] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/projects/90ee3928a7cf4c8590e1103847faa6a2 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.825862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:26.923330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd215-62f1-4e6c-987d-4e14f3721816 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:26.956153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:26.956769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:26.957042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:26.957309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] PATH_INFO: `/v3/groups/95465a5f94744d7685a4b68b7effd159` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:26.958382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] RBAC: Authorizing `identity:get_group(group_id=95465a5f94744d7685a4b68b7effd159)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:26.959842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660bc89-f31c-4a8c-a498-effb2cd503d9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:26.961394 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 168/335] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/groups/95465a5f94744d7685a4b68b7effd159 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:26.967277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:27.068447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4194b0-05ba-48c1-a260-71ca12eb93bc None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:27.100529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:27.101118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:27.101393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:27.101663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:27.102373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] RBAC: Adding query filter params (group.id=95465a5f94744d7685a4b68b7effd159, role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=90ee3928a7cf4c8590e1103847faa6a2) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:27.102709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:27.104152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ef8ef-c598-4eec-8884-f49d7f639ba0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:27.109667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 168/336] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Oct 31 13:56:26 2022] GET /identity/v3/role_assignments?group.id=95465a5f94744d7685a4b68b7effd159&scope.project.id=90ee3928a7cf4c8590e1103847faa6a2&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:29.910065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618456-7fb6-4d6c-b462-ad2ed8bcc4b7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:29.910658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618456-7fb6-4d6c-b462-ad2ed8bcc4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:29.910658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618456-7fb6-4d6c-b462-ad2ed8bcc4b7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:29.912228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 169/337] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:29.914239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa98d-0457-4d82-a536-c7d4361f6661 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:29.915060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa98d-0457-4d82-a536-c7d4361f6661 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:29.915537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aa98d-0457-4d82-a536-c7d4361f6661 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:29.917461 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 169/338] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:29.917576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a43d1-86f0-48ae-a284-be7985d23994 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:29.917800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a43d1-86f0-48ae-a284-be7985d23994 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:29.918075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a43d1-86f0-48ae-a284-be7985d23994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:29.926062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37a6d-5855-48c6-96fb-8d211b00a00f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:29.926062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37a6d-5855-48c6-96fb-8d211b00a00f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:29.926062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37a6d-5855-48c6-96fb-8d211b00a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:29.938095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:29.943528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d3a43d1-86f0-48ae-a284-be7985d23994 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:29.945113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d3a43d1-86f0-48ae-a284-be7985d23994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:29.951805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c4e37a6d-5855-48c6-96fb-8d211b00a00f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:29.953400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c4e37a6d-5855-48c6-96fb-8d211b00a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:30.031214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:30.039706 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 170/339] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:30.050844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8553-5ccc-49cf-a6b6-8f0f269bb282 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.050844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8553-5ccc-49cf-a6b6-8f0f269bb282 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.050844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8553-5ccc-49cf-a6b6-8f0f269bb282 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.051100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 170/340] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:30.051189 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 171/341] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:30.064464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.064788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.065018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.097022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:30.098201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:30.187901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 171/342] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:30.316080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8553-5ccc-49cf-a6b6-8f0f269bb282 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.323769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.443658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ee4f6-aec3-4f0f-a75a-930d2fcf4811 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.451005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8553-5ccc-49cf-a6b6-8f0f269bb282 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.463748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:30.485389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.486331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.486844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.487319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.488879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.489676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.490135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.490545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.493615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:30.499762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.501653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.502197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:30.503658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:30.523541 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:30.524506 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:30.525373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:30.525373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.525373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-11c98b8c-dda5-436e-9bf5-08949f5bf719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:30.525538 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:30.526307 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:30.527188 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:30.527188 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.527188 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:30.527188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 172/343] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:30.528167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c4b7-b3c5-4c62-a15b-a75f51c21142 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.528331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c4b7-b3c5-4c62-a15b-a75f51c21142 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.528629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c4b7-b3c5-4c62-a15b-a75f51c21142 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.529825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 173/344] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:30.534267 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 172/345] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:30.534409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c4b7-b3c5-4c62-a15b-a75f51c21142 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.540525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.648004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c4b7-b3c5-4c62-a15b-a75f51c21142 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.654551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac236-83b1-4de5-b5ee-4819fbe894ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.681628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.682253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.682526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.682799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.683432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:30.683736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.685087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98895-9da3-4904-b229-5efd90838203 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:30.689716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.690314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.690590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.690888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.691518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:30.691821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.693236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:30.703095 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 174/346] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:30.704436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.707528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.707528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.715241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 173/347] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:30.715241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.729881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:30.731115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:30.755144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:30.786217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:30.811705 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 175/348] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:30.812872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.855559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b32bd-7914-43d7-aa14-1ce379d0d9b9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.897611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.898505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.899046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.899450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.914079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.915730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:30.937332 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:30.938276 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:30.939722 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:30.939722 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:30.939722 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:30.942755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 174/349] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:30.944367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:30.947535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de16aa-3bc1-4098-aa5c-4a3849e9d6a9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:30.985692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:30.986738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:30.987242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:30.987720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:30.988636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:30.990288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.047880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:31.068125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602663-5e7c-4a64-bb65-960f8c191232 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.070254 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 176/350] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:30 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:31.076502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:31.113832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.114479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.117180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.117180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.117180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.117468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.153255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:31.201396 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 175/351] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:30 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:31.202984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:31.264551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f9828-e971-42a1-9769-75aac9a01610 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.360530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.361255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.361539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.361811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.362469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:31.362839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.364009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32969d-b6e3-43aa-9842-fb0cfc2685ad None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.364226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.379397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 177/352] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:31.385307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:31.409652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.410267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.410541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.412949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.419865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:31.429601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.431242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:31.452451 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:31.453412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:31.454243 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:31.454243 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:31.454243 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:31.458730 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 176/353] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:31.462226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:31.522311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:31.530417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574ba4-c492-4aa5-bc2c-da2db3ea8520 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.577283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.577887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.578166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.578430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.579124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.580552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf78f56-6d28-409b-9045-90ffcaab8135 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.597848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc642e55-540a-491e-9675-5324bad2ffc0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.633332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.634036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.634319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.634594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.635273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:31.635595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.637355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc325a-8c20-4852-b832-3d4555744498 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.649825 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 177/354] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:31.654451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbf2b-13ed-469e-bd9c-4f772be87a59 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.654451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbf2b-13ed-469e-bd9c-4f772be87a59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.654451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbf2b-13ed-469e-bd9c-4f772be87a59 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.654451 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 178/355] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:31.655966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acbf2b-13ed-469e-bd9c-4f772be87a59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:31.698947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 178/356] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:31 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:31.698947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.698947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.698947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.738520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:31.743912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:31.745407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:31.852719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acbf2b-13ed-469e-bd9c-4f772be87a59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:31.878915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 179/357] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:31.911258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:31.912109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:31.912540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:31.912940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:31.913718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:31.915320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:31.999995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 179/358] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:31 2022] POST /identity/v3/users => generated 249 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:32.182549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:32.319129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:32.331614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b0a1-85ac-4d7a-94da-e8821bcdcb0e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:32.368597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:32.369198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:32.369473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:32.369742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:32.370412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:32.371996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:32.409962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.sql.core [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 13:56:32.409962 n-d-863055-2 devstack@keystone.service[82163]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 13:56:32.409962 n-d-863055-2 devstack@keystone.service[82163]: [parameters: {'id': '6d6b971d024947a7bfdf944e43ab6894', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 13:56:32.409962 n-d-863055-2 devstack@keystone.service[82163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result.read() Oct 31 13:56:32.426893 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return ref.to_dict() Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:56:32.427780 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application yield resource Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise self.value Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application session.commit() Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 13:56:32.428675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.session.flush() Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application compat.raise_( Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 13:56:32.429493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:56:32.430339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result.read() Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:56:32.431215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [parameters: {'id': '6d6b971d024947a7bfdf944e43ab6894', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:32.432049 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 13:56:32.432836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:32.433657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 180/359] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 31 13:56:32 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:32.435033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:32.565880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75f48d-4143-4d3b-ac98-6a93e9ffa208 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:32.573361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:32.601071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:32.602081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:32.602579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:32.603164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:32.619395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0cbad041-7dfc-4f42-8f24-42b58e9357a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:32.624732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:32.631000 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:32.631803 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 180/360] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:56:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:32.632689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:32.785322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2aea-e9e4-4c4b-9c91-90a3bf23f806 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:32.835511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:32.836039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:32.836312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:32.836578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:32.837314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:32.837609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:32.838998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1af20-d5fc-48db-8612-2338fe4cb499 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:32.850168 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 181/361] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:33.808581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ffd4f-0c3a-4b68-825d-7fbe9dba54e4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:33.809560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ffd4f-0c3a-4b68-825d-7fbe9dba54e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:33.810033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ffd4f-0c3a-4b68-825d-7fbe9dba54e4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:33.811654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 181/362] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:33.817208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dabb6-dfff-493d-9d53-aa489c68d76c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:33.817695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dabb6-dfff-493d-9d53-aa489c68d76c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:33.817769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dabb6-dfff-493d-9d53-aa489c68d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:33.832991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:33.838997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-642dabb6-dfff-493d-9d53-aa489c68d76c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:33.847919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-642dabb6-dfff-493d-9d53-aa489c68d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:33.930569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 182/363] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:33.954123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1b08-1cd3-4f17-b416-18b122b95289 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:33.954404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1b08-1cd3-4f17-b416-18b122b95289 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:33.954715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e1b08-1cd3-4f17-b416-18b122b95289 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:33.956293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 182/364] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:33.961470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:33.961756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:33.962028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:33.980590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:33.981686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:34.071081 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 183/365] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:34.235781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e1b08-1cd3-4f17-b416-18b122b95289 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.344622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e1b08-1cd3-4f17-b416-18b122b95289 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:34.378586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:34.379232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.379505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.379845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.390911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:34.396133 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:34.396999 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:34.397777 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 183/366] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:34.407689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.501643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:34.557441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae3ff-109a-4fe8-af03-29e3be21a9c2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:34.603316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:34.603932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.604207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.604475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.605137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:34.605437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:34.606837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011465f-7f0a-45d3-a1b1-4353333ba52f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:34.615863 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 184/367] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:34.621367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.634397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713ba4-411c-45f6-a2ae-9b40e2bdcdf6 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.635046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713ba4-411c-45f6-a2ae-9b40e2bdcdf6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.635545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713ba4-411c-45f6-a2ae-9b40e2bdcdf6 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.637348 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 185/368] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:34.641345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d713ba4-411c-45f6-a2ae-9b40e2bdcdf6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.662885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:34.747835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78daa6e-420a-4782-9c4a-1068a6099eaf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:34.763486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d713ba4-411c-45f6-a2ae-9b40e2bdcdf6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:34.784636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:34.785255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.785536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.785818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.791303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:34.797176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:34.798749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:34.799801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:34.800445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.810046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.810046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.811941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6a7aa4b2-7d9b-4f8e-83c3-6ec6e1300692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:34.814105 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:34.823334 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 184/369] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924f87-f0de-4393-90d6-76e953230f02 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.824143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924f87-f0de-4393-90d6-76e953230f02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-55363395-026d-4f73-9c4a-b29e730f6be2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:34.824467 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:34.825597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:34.826371 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:34.828049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924f87-f0de-4393-90d6-76e953230f02 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.828168 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 186/370] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:34.828295 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 185/371] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:34.828451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.828451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.828451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.828814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924f87-f0de-4393-90d6-76e953230f02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.844474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:34.844717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:34.910563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:34.917880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 187/372] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:34.918964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:34.937506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924f87-f0de-4393-90d6-76e953230f02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:34.977362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:34.978499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.978979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.979397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:34.980292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:34.980738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:34.982315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118d7f-f7db-4baa-9c9f-ba19f722c79a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:34.997057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 186/373] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:34.998558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:34.999606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:34.999998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.026770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:35.026770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:35.054676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa644-cb39-4f30-b02b-4379f1265ef0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.078381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.102649 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 187/374] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:35.102649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.112542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.113214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.113565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.113843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.115951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:35.116258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.119459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.136106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 188/375] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:35.143409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.215915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.266819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350bab-691a-426a-8441-70cf79a43124 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.282524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996075da-8bff-4516-86c6-8028b8c82d9f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.313279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.314022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.314309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.314581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] PATH_INFO: `/v3/users/glance` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.320523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.321667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.322012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.322350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.322843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.323512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.335464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:35.336644 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:35.337496 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:35.338357 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 188/376] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:35.338953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.340133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:35.359653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:35.360570 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:35.361416 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:35.361416 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:35.361416 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:35.363920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 189/377] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:35.365176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.399540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.470192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2af53-567e-4e41-8236-4f16bcebce8c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.477149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87c63-c2b5-4219-bdb3-d74ab309a970 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.499115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.507645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.508907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.509443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.509854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.513100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.513704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.517723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.517723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.517723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:35.517723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.517723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.521889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:35.527810 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:35.528960 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:35.531687 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:35.532303 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 189/378] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:35.536024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.562092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 190/379] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:35.563377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.645292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc5345-4887-4016-9204-f6d5b4a2ced2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.663237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.674641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9062-6acf-4cd2-9143-98b2306d19d2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.679867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.680466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.680744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.681012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.681640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:35.681943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.683364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.694862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 190/380] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:35.696903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.709168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.709913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.710067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.710339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.722487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:35.727326 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:35.728333 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:35.729105 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 191/381] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:35.730034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.750546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.798873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4393d6-eda0-47cf-8ff8-4da9155ea4f2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.829138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec6598-fdce-4f34-b27f-6c276ab53000 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.832062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.832660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.832932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.833199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.833845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:35.834144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.835520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18649a5-5db1-4511-b78d-67ab3b5a5b81 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.843830 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 191/382] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:35.844995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dcfc-5c54-4dec-925f-851ae9d0d7ed None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.845278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dcfc-5c54-4dec-925f-851ae9d0d7ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.845553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dcfc-5c54-4dec-925f-851ae9d0d7ed None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.846778 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 192/383] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:35.847466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051dcfc-5c54-4dec-925f-851ae9d0d7ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.866576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.867225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.867502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.867769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.877565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.879069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:35.894587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:35.895510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 192/384] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:35.901132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.948292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051dcfc-5c54-4dec-925f-851ae9d0d7ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:35.959245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:35.981447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:35.982070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:35.982348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:35.982649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:35.990765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:35.992177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:35.994330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635cfda-bad7-415a-8303-493a79fcb24a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:36.003568 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.004553 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.005427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.031194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.031892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.032170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.032436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.033086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.033384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.034772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49baf0-4050-4d54-879d-0729d408a060 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.042342 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.043483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.043769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.044033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.061744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:36.062911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:36.102218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6deb-2e65-498a-9fcc-b6849891e2e6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.119595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.128071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 194/387] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:36.128860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.146491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.147251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.147542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.147807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.160653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.162138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:36.176272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.177142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:36.177980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:36.177980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.177980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:36.177980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 194/388] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.178189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.203603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.237425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83e4e-1a1e-45ca-a006-b9146061bb59 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.272364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.273171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.273453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.273724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.274354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.274677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.276055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.280498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6146fa-51fa-4afd-bb58-feb39929b9bf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.287823 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 195/389] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.293115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.316941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.317619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.317993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.318361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.319209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.319611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.321123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.350554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.361400 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 195/390] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.361400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.400247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86711-9cbe-4a87-a40e-29e9bb3e1f9d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.433704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.434323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.434601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.434903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.442178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.445870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.447364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.460215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b56e02-f71c-4019-bc5c-1dc0ecd7bcfb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:36.461354 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.462375 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:36.463448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:36.463448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.463448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:36.463448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 196/391] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.463448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.497605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.498208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.498485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.499390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.499989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.500290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.501657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.512665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 196/392] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.513427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.567908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d48cf-c7f6-47e8-872f-538290cae243 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.574519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.599899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.600520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.600797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.601064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.607474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.608933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e5f43-e625-49ff-8c83-10f7d240a377 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.609455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:36.621814 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.622850 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 197/393] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.624473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.645340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.645963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.646238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.646509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.655754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.658015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.659486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:36.674361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.675434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:36.676442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:36.676442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.676442 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:36.676442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 197/394] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.676693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.723810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154949-cc46-452a-9abf-a756f57e8b84 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.756846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.757469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.757749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.758021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.768568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.770023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.780477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336dd39-66c8-4af8-a0c9-1c23623debb8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:36.784133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.785211 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:36.786041 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:36.786041 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:36.786041 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:36.786041 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 198/395] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.786041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.804642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.817235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.817905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.818291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.818570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.819292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.819587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.821000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.832469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 198/396] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.833074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.887465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:36.888979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bf6ee-3c02-43bc-8b0c-e3afdb6b004f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.921923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.922538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.922850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.923119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.930271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.931737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.934483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb7bc-646e-4f35-8273-b82c88d6dbd6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:36.943681 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:36.944629 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:36.945499 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:36.946049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:36.969268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:36.969869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:36.970150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:36.970422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:36.971125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:36.971431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:36.972836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:36.990282 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:36.991095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.027480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.054445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4a47-a2fe-41a2-941a-d4ec034a0902 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.087660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1a59-d052-4d24-a724-64845505b1ab None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.088288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.088892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.089158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.089426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.090050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:37.090346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.091746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.100853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.104160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 200/399] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:37.114647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.125770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.126364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.126780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.127052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.127679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:37.128150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.129520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.142149 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 200/400] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:37.143061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.201555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ecb43-a36b-47cb-abdc-68ca49f35de6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.235547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.236158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.236433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.236695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.242458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf66bd-39c3-42e9-8a11-3540cf72d7e0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.243401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.244831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.246503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:37.256541 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:37.257928 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 201/401] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:37.258837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.279607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.280789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.281063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.281329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.282042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:37.282340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.283807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.300842 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 201/402] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:37.301628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.330132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.360733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243166b-e115-42db-9f2c-21ec7ffb3221 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.394013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.394687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.394966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.395235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/22e15ff208c1453ab8318e64575dc2bc/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.397994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762585-7079-45b4-a5cd-cdc93bfb79ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.409671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=22e15ff208c1453ab8318e64575dc2bc, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.411158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.432181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.432793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.433071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.433342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.440259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.441689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:37.453579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:37.454543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 202/403] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:37.455652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.466586 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 202/404] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:37 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/22e15ff208c1453ab8318e64575dc2bc/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:37.467588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.543291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.562165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.572560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de145712-e466-493e-afdb-a3e88eb7a31f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.599963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92451-5117-41ea-bbc7-ee726bb697c9 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.609322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.609958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.610269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.610503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.615783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.615783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.641164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.641862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.642142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.642413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.643668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:37.643668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.645732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.662756 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 203/405] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:37.663576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.690591 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 203/406] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:37 2022] POST /identity/v3/users => generated 247 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:37.696259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.798335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77dec9-7fd4-46ea-96c0-8439629cb890 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.807404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:37.825814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e57de-a265-4bfb-a270-372bacf5d123 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:37.845030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.845709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.846305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.846583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.862259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.864500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.874987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:37.875641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:37.875846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:37.876157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:37.877557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:37.877860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:37.879373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:37.884605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:37.885481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:37.886581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:37.886581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:37.886581 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:37.886581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 204/407] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:37.892753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.895894 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 204/408] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:37.896982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:37.906356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.018457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc25b7-b61b-486f-923b-e7092591c9b3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.027046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b073345-9dac-41b6-9f33-3b3d1bea7ca3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.063275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.064921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.065537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.066101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.067249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:38.067859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.069526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.069891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.070142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.070415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.070708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.085008 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 205/409] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:38.085998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.087423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.087599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:38.102674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:38.103596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:38.104437 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:38.104437 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:38.104437 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:38.104437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 205/410] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:38.105072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.119075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.168206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.204746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551bd80-8310-430c-b8d5-f903f2f2d838 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.236243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67853db-842a-4b98-9495-e86fede43c58 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.255666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.257113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.257608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.258298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.271635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.272258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.272612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.272961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.278087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=7cf0897f734e424a9dbbda87f9c0d6f2, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.280596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.280771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.282354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:38.294238 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:38.303451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 206/411] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:38.304292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.378270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.387462 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 206/412] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:38 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:38.388407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.416067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8db3d2-0f7e-4333-bfe8-162667a15c14 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.459051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.460112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.460598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.461067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.461952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:38.462458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.464316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.480680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 207/413] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:38.487001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.606274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465363f-3f78-4bed-acd2-48f1c3a35e5c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.640754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.648720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.649683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.650160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.650977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.664992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.668484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:38.686533 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:38.687596 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:38.688448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:38.696947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 208/414] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:38.698445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.757201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d1271-5b0e-409d-b51d-a6350919207e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.775940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:38.819010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.819622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.819894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.820163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.820861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:38.825829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.829887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.842350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f2a74-46dd-4933-b524-6457e82b0311 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:38.868958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 207/415] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:38.876878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:38.903170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:38.903822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:38.905507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:38.905507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:38.905694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:38.905981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:38.907494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:38.964561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 209/416] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:38.970944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:39.086996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb59b8-0f1b-467f-abbc-7eee195242c9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:39.127357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:39.128026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:39.128304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:39.128579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/e4f863d5b33d4f10a053481933f03555/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:39.143843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:39.157949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=e4f863d5b33d4f10a053481933f03555, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:39.160828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89a29-3ab4-4af7-bf92-763121047e37 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:39.206586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243c90a-dd28-49cd-9246-d7b398a081a1 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:39.242993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:39.243660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:39.243997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:39.244280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/d72035cfc0a24494a557a50792e6382d/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:39.260067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=d72035cfc0a24494a557a50792e6382d, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:39.261891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4349646-632e-4785-966b-196d9df7e450 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:39.290710 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 208/417] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:38 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/e4f863d5b33d4f10a053481933f03555/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:39.360011 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 210/418] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:38 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/d72035cfc0a24494a557a50792e6382d/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:39.839712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c370-776d-4be6-9b78-31c20d2f56f9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:39.840112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c370-776d-4be6-9b78-31c20d2f56f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:39.840298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c370-776d-4be6-9b78-31c20d2f56f9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:39.841850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 209/419] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:39.856056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378770-e526-4ccb-8e1c-a2796585ea7f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:39.856347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378770-e526-4ccb-8e1c-a2796585ea7f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:39.856629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378770-e526-4ccb-8e1c-a2796585ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:39.887697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-36378770-e526-4ccb-8e1c-a2796585ea7f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:39.888910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-36378770-e526-4ccb-8e1c-a2796585ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:39.969208 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 211/420] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:40.183885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8b1f-f9dc-421d-a80d-a2ba9ecb87cc None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:40.184897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8b1f-f9dc-421d-a80d-a2ba9ecb87cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:40.185376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8b1f-f9dc-421d-a80d-a2ba9ecb87cc None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:40.186941 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 210/421] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:40.192396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:40.192892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:40.193375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:40.212047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:40.213500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:40.246191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:40.299141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 212/422] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:40.303026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8b1f-f9dc-421d-a80d-a2ba9ecb87cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:40.339008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:40.427840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8b1f-f9dc-421d-a80d-a2ba9ecb87cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:40.474923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:40.475624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:40.475898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:40.476164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:40.487913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:40.492665 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:40.493530 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:40.494304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 211/423] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:40.500060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:40.626342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caa925-02ef-444f-ad65-445ed28dc3ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:40.662270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:40.663232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:40.663736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:40.664227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:40.665092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:40.665591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:40.667473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:40.676404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 213/424] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:40.681587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:40.728516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:40.781327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:40.804321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31436-7c40-401f-bee2-dc44472c8b4b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:40.818577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:40.852691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:40.853315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:40.853587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:40.853850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:40.879630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:40.881084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:40.910387 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:40.911351 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:40.912177 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:40.912177 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:40.912177 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:40.912177 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 212/425] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:40.917790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:40.919223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5c94-db9e-40b0-b58f-6cacdb3a4e0f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.010453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.011523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.011690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.011952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.037157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd805273-f76b-4099-83f0-f07e141eacd3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.041060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:41.046910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:41.047921 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:41.049451 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 214/426] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:41.055890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.083326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.084613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.085383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.085930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.086837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:41.087413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.089942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.097632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.104589 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 213/427] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:41.111737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.251537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409168c-82d7-4a63-a881-112ece1e04f4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.267006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.276309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33fc0-46fb-4ef3-b10d-4c12ba009cde None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.301366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.302315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.302812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.303546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.313021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.314916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.315250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.316045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.316331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.316600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.317258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:41.317561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.319191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a662c-4434-4938-8e77-d00598f64abb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.327651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 215/428] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:41.328742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4503771-c4bd-4569-aaf4-8563ca08b557 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.329031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4503771-c4bd-4569-aaf4-8563ca08b557 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.329306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4503771-c4bd-4569-aaf4-8563ca08b557 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2ddb26c8-fe09-480e-a16f-8c1eaf382112 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:41.329783 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:41.330653 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 13:56:41.331540 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:41.332028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 216/429] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:41.333995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 214/430] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:41.338586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4503771-c4bd-4569-aaf4-8563ca08b557 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.341130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.341613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.342078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.364618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:41.366139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:41.431023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.453648 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 215/431] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:41.453648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.462067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4503771-c4bd-4569-aaf4-8563ca08b557 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.523669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.524751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.525218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.525665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.547850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.549804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.554792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94751-f972-4acb-b5e2-6fe9858baca7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.562123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:41.573958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:41.575525 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:41.576339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:41.576339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:41.576339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:41.576339 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 217/432] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:41.581234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.597507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.598437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.598950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.599422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.600382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:41.600921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.602513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.622458 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 216/433] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:41.628718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.697256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.766403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3eb37-87c2-4f1c-9638-90b65d28419d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.787613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a9a0-94be-4f41-85bd-c3943306f2b2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:41.819055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.820901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.821185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.821455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.822091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:41.822392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.823799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.852626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 218/434] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:41.855575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:41.856186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:41.856458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:41.856724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:41.858008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:41.935977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:41.949743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:41.951228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e1392-de1f-49c5-a2ea-f4dffb3e4363 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:41.985792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f32f3-54a5-41c4-b667-a40a5fd41aad None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.002395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.024144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.024776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.025047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.025316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.032419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.033869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:42.047955 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.048951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 219/435] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.049816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.066889 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 217/436] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 13:56:42.068350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850a42-71c1-4918-b3e6-e36415aa2a97 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.068797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850a42-71c1-4918-b3e6-e36415aa2a97 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.069406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2850a42-71c1-4918-b3e6-e36415aa2a97 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.071115 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 218/437] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:42.075800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2850a42-71c1-4918-b3e6-e36415aa2a97 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.153421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b18d-c372-4fd5-b9bb-9f38c2caec18 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.168893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.175262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2850a42-71c1-4918-b3e6-e36415aa2a97 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.186567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.187247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.187523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.187792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.198041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:42.203393 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.204302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:42.205063 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 220/438] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.205686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.214934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.215536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.215808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.216072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.216782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:42.217082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.218485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112260-ec8c-4fcd-9ea4-68495f153e11 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.234937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 219/439] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:42.236209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a2284-19f6-44f9-8cc7-7b0b87c4c309 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.236495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a2284-19f6-44f9-8cc7-7b0b87c4c309 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.236763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a2284-19f6-44f9-8cc7-7b0b87c4c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.243386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.254125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e12a2284-19f6-44f9-8cc7-7b0b87c4c309 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:42.255321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e12a2284-19f6-44f9-8cc7-7b0b87c4c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:42.305860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8866a-c62d-40d2-821f-5e80d7c8f387 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.320753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 220/440] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:42.322009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bce28-9dfe-41a9-bba6-621f0a406bd6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.322277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bce28-9dfe-41a9-bba6-621f0a406bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.322442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bce28-9dfe-41a9-bba6-621f0a406bd6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.328068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 221/441] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:42.328068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bce28-9dfe-41a9-bba6-621f0a406bd6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.341156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.341776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.342098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.342485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.353906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.355589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:42.370994 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.371880 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:42.372698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:42.372698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.372698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:42.374907 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 221/442] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.375809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.408484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.443039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bce28-9dfe-41a9-bba6-621f0a406bd6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.477612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.478205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.478477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.478778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.479423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:42.479718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.481068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3b6fc-987d-424f-b280-0a5bcdd536f0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.482377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.485761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336357ae-97e4-47f7-b9e3-1c92f602e0ae None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.495733 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 222/443] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:42.495733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.495733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.495733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.512241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:42.514274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:42.521955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.522570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.522869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.523135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.534338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.536244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:42.550804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.551840 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:42.552953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:42.552953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.552953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:42.556412 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 222/444] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.557235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.591019 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 223/445] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:42.591841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.643255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.662032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcdfa-e1ea-46d6-a91c-0446c06033b2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.697863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.698464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.698770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.699039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.699665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:42.699962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.701325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.702135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4af8fe-00cd-43ba-a3fa-0312e2b56d52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.715148 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 223/446] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:42.716807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.736633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.745483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.751137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.751137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.751137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.757302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.758878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:42.775026 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.775892 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:42.776745 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:42.776745 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:42.776745 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:42.776745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 224/447] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.777509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.827631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a43eb-029f-4334-85d4-c21c89d710e0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.863685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.864201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.864472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.864734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.865362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:42.865657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:42.867063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:42.875272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.878434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 224/448] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:42.879231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.882008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f222ac-a208-419a-9bf2-185bb561a0f1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:42.917678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:42.918287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:42.918560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:42.918867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:42.930361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:42.935732 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:42.936743 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:42.937531 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 225/449] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:42.938163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:42.975672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:42.984107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc96-227c-446f-955a-563eb01df804 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.017355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.017973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.018249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.018526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.025047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.026490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.035199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf897f6a-b312-4a11-9ce7-268fbe28e25f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:43.038042 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.039072 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:43.040108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 225/450] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.040640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.072545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.073137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.073411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.073678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.074323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.074623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.076007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.088085 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 226/451] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.088712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.098539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.140073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191828c1-6b4c-42cf-9a03-9f70e6196fca None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.172528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.173141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.173415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.173682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.183696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:43.188333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:43.188914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.189932 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 226/452] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.190838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.193625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed3c4a-13cb-43e5-8c11-2727e6be0aa7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.227306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.227932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.228205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.228469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.234795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.236227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:43.247855 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.248864 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 227/453] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.249874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.292271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bf7ee-41bb-485a-a89b-74ddd5b908a7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.311098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.324845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.325431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.325707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.325986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.327177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.327481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.328841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.336469 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 227/454] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.337242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.348610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070917c4-fe82-4eb3-b9b5-66216aaac346 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.382602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.383218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.386503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.386503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.386503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.386503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.386503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.398863 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 228/455] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.399586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.419370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.440161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8263c-40a9-42ae-bfd3-86852b363c18 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.473100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.473713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.473986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.474259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.481563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.483110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:43.493796 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.494873 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 228/456] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.495991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.501228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd8f3-5d37-4079-bcb7-24b59cbb5bd6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.534922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.535514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.535788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.536056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.536709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.537005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.537994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.538357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.546053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 229/457] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.546849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.594511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175876d-cd62-46e6-8681-6557fa760343 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.627625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.628211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.628369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.628472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.628736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.629417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.629717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.631201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.643884 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 229/458] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.644660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.651212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06641da4-8686-434a-8f1c-66ce7c7ef902 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.683543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.684161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.684431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.684696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.694735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.696145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:43.711170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.712230 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:43.717737 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:43.717737 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:43.717737 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:43.717737 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 230/459] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.717737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.743898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37165ae1-818a-4bfb-a327-3f98ac659654 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.745384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.777895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.778491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.778802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.779071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.779815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=22e15ff208c1453ab8318e64575dc2bc) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.780160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.782337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.788051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 230/460] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/role_assignments?user.id=22e15ff208c1453ab8318e64575dc2bc&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.788898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.818529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb3d7-5730-409d-9a6b-df3d0af9db6e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.850112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:43.855474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.856179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.856455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.856724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.857457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:43.857760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.859794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.881553 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 231/461] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:43.882918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.905297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb4548-76ef-483d-8af9-ba2679a510bf None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:43.943057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:43.944008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:43.944461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:43.944902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:43.956032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:43.957603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:43.973721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:43.974848 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:43.975715 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:43.975715 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:43.975715 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:43.975715 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 231/462] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:43.975940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:43.997690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.003814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186975-4581-44d1-a759-76d4164cab90 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.040575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.041232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.041508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.041777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/dd208aa4e6dc479a8a24bdfce4dff5d7/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.059872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=dd208aa4e6dc479a8a24bdfce4dff5d7, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.062269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.085376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e84d-ae38-4f0e-bdb3-4ba88ec212d4 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.118709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.119303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.122536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.122536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.122536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:44.122536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.122536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.134523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 232/463] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:44.135165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.175753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 232/464] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:43 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/dd208aa4e6dc479a8a24bdfce4dff5d7/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:44.176614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.231551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.236019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.258920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da154d09-2cb8-4502-8479-d50d568c18ba None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.305548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.306485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.307061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.307531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.315990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87629c7-45e5-4aef-9e87-e820694647c4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.363767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.365359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.365359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.365359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.366218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:44.366523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.368878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.386644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 233/465] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:44.386644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.404546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.406600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.495613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.496929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.498251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69307-864a-4128-a631-352d13db0307 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.526220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 233/466] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:44.527450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.534389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.535055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.535332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.535603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.543270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.544724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:44.557236 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:44.558174 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 13:56:44.559107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:44.562946 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 234/467] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:44.563837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.644920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f72d4-f8d2-4eaf-b6d5-e7567024e3b0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.666560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9d77-5d60-4f54-bc9e-ed8910e90b29 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.686246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.687629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.688398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.688898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.699271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.700773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.701399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.701507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.702203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.702478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:44.718297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:44.719209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 234/468] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:44.720792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.731571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.734907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:44.754382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:44.755345 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:44.756178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:44.756178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:44.756178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:44.759126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 235/469] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:44.760174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.768626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.782230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:44.841551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e0fc-6d8c-4c33-a6a7-8b3504cabd38 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.878859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.879667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.880006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.880347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.881176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:44.881683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.882638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbea5-cb3e-4a8d-99bb-a77066507e85 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:44.883456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.903344 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 235/470] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:44.904475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:44.922486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:44.924463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:44.924930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:44.925335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:44.926662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:44.927031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:44.928478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:44.948980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 236/471] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:44.949813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.015344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.022199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aae2b-8ab1-4e7e-a546-fbe524e3d6ef None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.033377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.062046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.063039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.063484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.067516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.067516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:45.067516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.067516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.067819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb440f8-35e8-422f-af49-e168f93480c9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.079897 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 236/472] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:45.081158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.107313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.107964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.108238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.108502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.193358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.194822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.195245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830df9-57ec-4c7f-8026-1f55903cdac2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.230634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.231608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.232148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.232657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.262680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.274269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.307899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.308767 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 237/473] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:45.309812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.310007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.435485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 237/474] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:45.436850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.438484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800165fd-f881-4ecd-a662-23be4d01fc9b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.483385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.484461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.484934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.485473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.493958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.495825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.500912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:45.511492 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:45.514977 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 238/475] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:45.515815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.549287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbac97f-f33d-49b2-b6f7-eda8e15c3bee None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.555603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.585589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.586273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.586560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.586875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.597818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.599411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:45.615181 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:45.616084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:45.616918 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:45.616918 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:45.616918 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:45.616918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 238/476] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:45.617552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.646170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5ed4-d98c-492d-9868-fe88c7ffe1a6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.689607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.690739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.691068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.691559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.704756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.706505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:45.723791 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:45.724803 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:45.725624 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:45.725624 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:45.725624 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:45.732509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 239/477] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:45.732509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.741298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486b173-0210-4b5a-be8b-316c523479f6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.750537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.775745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.776748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.776748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.776912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.777636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:45.777914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.779382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.793328 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 239/478] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:45.794235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.840199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:45.864104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a743-732c-45b5-9629-ee19fbcfde0a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.900682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58dbc-d331-479b-b603-10037dabd922 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:45.908595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.909542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.910059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.910490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.911320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:45.911766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.913500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.929077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:45.930172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.945037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:45.945795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:45.946184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:45.946546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:45.947337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:45.947743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:45.949212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:45.965393 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:45.965393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:45.996207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.058243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32948-1fb2-4d8c-8ca1-4c47b775e01c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.071076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6913-2aee-4382-ab7a-b7821dd8e86e None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.098303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.099183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.099872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.100306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.101754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=7cf0897f734e424a9dbbda87f9c0d6f2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:46.102202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.103778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.105148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.105760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.106038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.106308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.114649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.114649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.114909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 241/481] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/role_assignments?user.id=7cf0897f734e424a9dbbda87f9c0d6f2&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:46.122851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.126679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-60361f79-cc19-4a57-8c30-20b5e8bdb6fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:46.138078 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:46.145360 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 241/482] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c59a-f301-4c97-92f4-6385a445affa None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.146192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c59a-f301-4c97-92f4-6385a445affa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.146873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c59a-f301-4c97-92f4-6385a445affa None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.146873 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 242/483] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:46.150642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c59a-f301-4c97-92f4-6385a445affa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.255550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564903-f7cf-4144-998f-2095cef928b2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.273034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.295728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c59a-f301-4c97-92f4-6385a445affa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.302803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.303491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.303771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.304043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.313443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.315879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6b9d57ac-ae8a-479d-996b-a87f58a4233d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:46.329585 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:46.330534 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:46.331450 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:46.331892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 242/484] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:46.334648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.334648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.334648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.350899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.351441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.351719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.351997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.352695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:46.353001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.354436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.354542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:46.355975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:46.370727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 243/485] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:46.372164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.432149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.441328 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 243/486] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:46.443582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.513467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8dba6-3e35-4d9e-9eba-36ab5af295d6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.548500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.549511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.549997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.550481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.551404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:46.551935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.553574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513dd35-e6d8-425b-9830-2f6d816ab5ae None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.560165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831b59-274f-466e-914c-0e01e3ee85ce None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.567091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 244/487] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:46.568620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277571aa-42d4-45a9-ad19-4de89dc8ef2b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.569145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277571aa-42d4-45a9-ad19-4de89dc8ef2b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.569623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277571aa-42d4-45a9-ad19-4de89dc8ef2b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.574926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 245/488] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:46.575938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277571aa-42d4-45a9-ad19-4de89dc8ef2b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.587901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.602709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.603031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.603295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.603559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.604441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=d72035cfc0a24494a557a50792e6382d) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:46.604744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.606836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e4703-7280-42d7-be98-a12352414716 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.614390 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 244/489] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/role_assignments?user.id=d72035cfc0a24494a557a50792e6382d&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:46.615614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.616045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.616341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.641554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:46.643113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:46.714162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:46.729734 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 245/490] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:46.760448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277571aa-42d4-45a9-ad19-4de89dc8ef2b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.771791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:46.831665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.832362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.832645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.832917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.833651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=e4f863d5b33d4f10a053481933f03555) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:46.833957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.837547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.846416 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 246/491] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/role_assignments?user.id=e4f863d5b33d4f10a053481933f03555&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:46.909427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414c00-7e6b-4ae8-a3b1-152767661d8b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:46.953248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:46.953892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:46.954167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:46.954438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:46.965815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:46.968001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:46.983990 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:46.984979 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:46.985820 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:46.985820 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:46.985820 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:46.985820 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 246/492] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:46.993135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.026595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.087143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:47.119008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:47.146886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c697-9672-4c6b-a168-6a859f3ffffc None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.162933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53403a-9b0c-4a02-8f81-854c88dc8685 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.182968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.183732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.184058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.184329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.185260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:47.185558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:47.187594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:47.207316 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 247/493] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:47.207514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.208009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.208309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.208548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.212984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.227612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:47.235170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:47.236241 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:47.237036 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:47.239910 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 247/494] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:47.245948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.410458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204dcb0-11ed-444c-9fce-776dfb1d6bdf None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.449373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edde14d-b295-4249-8aac-7faf4f0884f6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.454207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:47.469668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:47.477662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.478274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.478542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.478841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.479496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:47.482362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:47.509746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.510460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.510771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.511110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.512093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:47.512389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:47.513743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:47.523147 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 248/495] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:47.529567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.558798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 248/496] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:56:47 2022] POST /identity/v3/users => generated 254 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:56:47.687985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b625-b09b-4d99-95f6-7dbeb1d3bb2c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.749499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.750131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.750408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.750711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.762094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:47.763565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:47.779565 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:47.780596 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:47.781449 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:47.781449 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:47.781449 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:47.781449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 249/497] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:47.786400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:47.917520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4686d3-aba0-4993-a017-ad1c2ea69d03 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:47.965612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:47.966651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:47.967887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:47.968365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:47.969213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:47.969726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:47.971351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:47.990400 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 249/498] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:47.995531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:48.018381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:48.130461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4b6d2-db81-449a-8551-42f68aa92c27 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:48.182633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:48.183603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:48.184107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:48.184582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:48.197633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:48.199348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:48.213958 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:48.214933 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:48.215830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:48.218573 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 250/499] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:48.224227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:48.304306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:48.369759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea369f-64b1-4e41-ab68-9b6b33770591 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:48.413957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:48.414637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:48.414879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:48.415118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:48.415840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:48.416139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:48.417572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f65099-2acc-4e39-8892-9bd764008201 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:48.435659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 250/500] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:56:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:48.441283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:48.575138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:48.602579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15634b-9578-40c4-ab80-4a420a47bcfb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:48.649964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:48.650572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:48.650878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:48.651136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:48.711293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdaa32-2cc6-4dd9-8235-a803317758f1 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:48.711923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdaa32-2cc6-4dd9-8235-a803317758f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:48.712404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdaa32-2cc6-4dd9-8235-a803317758f1 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:48.714206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 251/501] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:48.720300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:48.720805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:48.721281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:48.751690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:48.752886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:48.754534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:48.757522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:48.846605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 252/502] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:48.884866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:48.909947 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 251/503] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 13:56:48.915256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:48.963620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.050708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2bebc-e03f-40cd-bda2-f62d7237ebe5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.101765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.102310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.102582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.102875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.118013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.119610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:49.139871 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:49.140827 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:49.141686 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:49.141686 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:49.141686 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:49.141686 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 253/504] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:49.146534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.165946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.283939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48276-9011-4ff6-9b66-a14b8198530c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.328542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.343154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4ac3-9394-4064-ac87-fa06bcbf2b17 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.352169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.352691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.352972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.353246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.353924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:49.354227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.355644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:49.377158 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 252/505] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:49.383740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.409444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.410078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.410356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.410644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.425588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:49.431358 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:49.432295 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:49.433140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 254/506] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:49.441518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.459841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.548412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791409d3-ea44-4f33-adf0-a6f3d0524eef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.583220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b46df-ad69-4fee-910d-dd053cc9019c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.588542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.589170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.589441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.589703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.596448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.598573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5c67340e-9b8a-47a8-acc3-52ef81856127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:49.610318 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:49.611510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:49.612598 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:49.614953 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 253/507] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:49.616128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd171-095d-42e2-8db0-7c5e6fd35fd5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.616405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd171-095d-42e2-8db0-7c5e6fd35fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.616672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd171-095d-42e2-8db0-7c5e6fd35fd5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.617898 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 254/508] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:49.619033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b28adc-bac4-477b-9731-eb29e4635d02 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.619382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b28adc-bac4-477b-9731-eb29e4635d02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.619716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b28adc-bac4-477b-9731-eb29e4635d02 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.621059 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 255/509] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:49.625548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.626229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b28adc-bac4-477b-9731-eb29e4635d02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.626582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.626961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.627233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.627895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:49.628197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.630681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085e061-e3e4-4420-be4c-6127746c17a2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:49.641711 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 255/510] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:49.646232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319d14-7f1b-417b-9cd5-0e72ef53a465 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.646232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319d14-7f1b-417b-9cd5-0e72ef53a465 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.646232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca319d14-7f1b-417b-9cd5-0e72ef53a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.666601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ca319d14-7f1b-417b-9cd5-0e72ef53a465 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:49.667796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca319d14-7f1b-417b-9cd5-0e72ef53a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:49.672376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.732399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.738810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b28adc-bac4-477b-9731-eb29e4635d02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.745137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 256/511] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:49.746187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.746466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.746763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.766381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:49.767591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:49.787623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.788223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.788496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.788762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.789442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:49.789740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.791226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:49.803686 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 256/512] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:49.804553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.845748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 257/513] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:49.846948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:49.919765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:49.953341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2a7d0-ad0d-4e30-9fdb-ca220f0ff5a6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.960069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265636-10ee-4fea-93b4-fdf8151c80cb None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:49.990872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:49.991933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:49.992422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:49.992900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:49.993836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=dd208aa4e6dc479a8a24bdfce4dff5d7) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:49.994353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:49.996033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.003581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 258/514] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/role_assignments?user.id=dd208aa4e6dc479a8a24bdfce4dff5d7&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:50.012599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.013256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.013526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.013791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.026476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.027972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:50.043116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:50.044106 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:50.044980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:50.044980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:50.044980 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:50.044980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 257/515] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:50.050502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.050863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.064601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.165564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f49a-590a-432b-830f-6d838e41621f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.202935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.203806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.204255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.204680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] PATH_INFO: `/v3/services/network` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.205267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.206741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:50.219300 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:50.220342 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:50.221176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 258/516] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:50.230689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.272704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5fd0c-bec4-4ac8-a5c4-46dc70d24711 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.309165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.318216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.332908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.339392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.339392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 259/517] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:50.339392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.348412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609e4a-60d4-4694-b1b9-4b641b0273fd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.392263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.393581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.394072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.394887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.396062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] RBAC: Adding query filter params (name=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:50.396573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.398739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.405467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 259/518] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:50.406429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.454878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10bc1e-544c-4590-aee3-e7d003c03ca7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.491219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.491841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.492117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.492394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.492957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.494317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-1ac0fc40-5ace-463d-8d18-9dad21b50798 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:50.504914 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:50.505929 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:50.507255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 260/519] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:50.508035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfe3b-cfe4-4ab6-9112-9f85d9d2cf19 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.508035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfe3b-cfe4-4ab6-9112-9f85d9d2cf19 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.508035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfe3b-cfe4-4ab6-9112-9f85d9d2cf19 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.509023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 261/520] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:50.513725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dfe3b-cfe4-4ab6-9112-9f85d9d2cf19 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.518182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0d6f-db08-4506-bb0d-a0bc2f93587d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.553779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.554401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.554703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.554970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.558132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.563720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.565534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.575510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:50.578286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:50.583510 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 260/521] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:50.584416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.628153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dfe3b-cfe4-4ab6-9112-9f85d9d2cf19 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.664047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.664649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.664932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.665210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.665824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] RBAC: Adding query filter params (type=network) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:50.666127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.667539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224b00d-036e-41a6-a5db-f8c0957178f4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.682656 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 262/522] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:50.682656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.682656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.682656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.693961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:50.695309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:50.702694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79fa5d-abce-4992-aa03-7ffe8cccfb0c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.755821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.757044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.757507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:50.758218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:50.759606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:50.760108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:50.762089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:50.770757 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 261/523] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:50.772055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.785663 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 263/524] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:50.786465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:50.859013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.868581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:50.950343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f80e0-334c-48d3-9baf-7063d5c21cff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.955854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367da69-2031-4c94-aaee-b94a0639a201 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:50.999135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:50.999673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:50.999949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.000215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.000853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:51.001151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.002529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.005193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.005802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.006131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.006402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.007147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:51.007448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.008917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.021232 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 264/525] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:51.040100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 262/526] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:56:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:51.045879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.129226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.169529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7ee-3a6e-4c2e-84de-57d875b9eeb8 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.190916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:51.213591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.214290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.214570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.214864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.227244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.228727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:51.248044 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:51.249653 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:51.250518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:51.250518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:51.250518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:51.250518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 265/527] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:51.255479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.340261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0296d-27aa-422d-909c-3546ea821bf3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.362536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:51.377592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b386ad-9569-4171-91cb-8ced59234be6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.385404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.386229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.386933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.387348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.401127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:51.408400 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:51.409507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:51.410609 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:51.412881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 263/528] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:51.417301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.418415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.420029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.423791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.425564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.426458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:51.426991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.428675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.446973 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 266/529] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:51.448463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.519075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:51.599011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dbe0-2088-4d0e-8c6e-6137e4f5675d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.637809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.638432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.638737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.639033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.646887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.648690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:51.661057 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:51.661947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:51.663084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 267/530] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:51.667907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.681934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75f20b-a8a4-40d0-9264-0fb47d296489 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.731131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.738655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.739224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.739763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.740672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:51.741194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.742797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.762257 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 264/531] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:51.768122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.786721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283ff7-9cf6-4c06-8bf1-6c2242879a9d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:51.798995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:51.822086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:51.822761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:51.823047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:51.823324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:51.824035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:51.824344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:51.825924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:51.841683 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 268/532] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:51.856490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:51.857473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:51.964179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d83d8-ce2f-45da-9d13-926bea5c1962 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.026558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.027488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.027953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.028385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.043518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79839-bcac-4606-a7d5-89db688dbbb9 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.051588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.053306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:52.076118 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:52.077858 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:52.078966 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:52.078966 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:52.078966 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:52.088441 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 265/533] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:52.091180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:52.115719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.116682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.118536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.118976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.122049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=7cf0897f734e424a9dbbda87f9c0d6f2, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.124263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.209109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:52.218894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29324e-8bc0-467f-acf1-a01aaa561075 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.221598 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 269/534] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:51 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 13:56:52.258678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.259290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.259619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.259891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.260584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:52.260925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.262597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd028b-48b3-48c1-ab4a-cb77e013559c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.277023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 266/535] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:52.283366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:52.319371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:52.409081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54794-9d79-4c84-9b10-66d44e8b739a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.418962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1edd-16e4-4112-bda1-1cdeb3f969a5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.419258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1edd-16e4-4112-bda1-1cdeb3f969a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.419508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1edd-16e4-4112-bda1-1cdeb3f969a5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.421157 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 267/536] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:52.430317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.430603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.430920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.453409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:52.454829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:52.477030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.477661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.477937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.478205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.485612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.487902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:52.501638 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:52.502586 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:52.504142 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 270/537] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:52.514682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:52.577758 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 268/538] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:52.622999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:52.661349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f313b1-2da9-4084-81a9-5590e326c190 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.695504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.696108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.696383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.696712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.697444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:52.697741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.699213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.726283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 271/539] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:52.731889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:52.829239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:52.848077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2bfce-102e-4622-9214-8f3118730eaa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:52.885600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:52.886229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:52.886798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:52.887068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:52.897577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:52.899135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:52.910304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:52.926369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:52.927369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:52.928237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:52.928237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:52.928237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:52.928237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 269/540] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:52.934410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.038346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451594d5-e66f-4a67-9a95-a82c3572e0fa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.073571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.074241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.074524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.074825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.075461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:53.075763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.077178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.090865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 270/541] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:53.091108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.098870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.143820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e8b6-0b93-48c6-8335-5e7c8ff0d8bf None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.191835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.213894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.214985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.215465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.215925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.236651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:53.242191 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:53.243184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:53.244043 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:53.251221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063854-5e93-4017-b882-405fff26a425 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.252319 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 272/542] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:53.258046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.288983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.289717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.289992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.290261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.297701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.299172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:53.310685 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:53.311594 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:53.312483 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 271/543] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:53.319601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.410122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.450750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e771-d81f-4004-a205-595c625ccbd3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.462769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaee858-3e1e-4f04-84eb-e2ffc2aaaa1e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.490595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.491225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.491503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.491776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.492432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:53.492734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.494213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd280399-d0fb-4bdc-b426-13a4cc9beb34 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.502836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.503514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.503890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.504232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.504978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:53.505351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.506902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6aae-31c3-429c-bdb3-bc07e7d85d7a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.508784 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 273/544] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:53.510147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e388c-ee20-45ed-9196-9ead5f6190c9 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.510439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e388c-ee20-45ed-9196-9ead5f6190c9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.510733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e388c-ee20-45ed-9196-9ead5f6190c9 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.517040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 274/545] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:53.517916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e388c-ee20-45ed-9196-9ead5f6190c9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.520828 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 272/546] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:53.530662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.530662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.530662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.547937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:53.549573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:53.573762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.626829 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 273/547] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:53.628038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.643541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e388c-ee20-45ed-9196-9ead5f6190c9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.681420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.724404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.725838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.727965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.728413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.751573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.755834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:53.782002 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:53.783139 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:53.783992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:53.783992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:53.783992 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:53.790904 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 275/548] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:53.798800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:53.808526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28603bd-d3d8-4861-8c3b-29cb35fc085b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.884095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.884997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.885465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.885903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/bdf1d58b4c5646629bfa0a0e09b2dc01/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:53.921758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=bdf1d58b4c5646629bfa0a0e09b2dc01, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:53.927752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:53.963360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:53.966067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f079-3bd1-4b13-9e7e-7a2121cc3fea None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:53.997935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:53.999084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:53.999356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:53.999616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.000236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:54.000527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.001884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bec19-3053-4bd5-bf1f-ae4d320bf6d1 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.013431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 274/549] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:53 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/bdf1d58b4c5646629bfa0a0e09b2dc01/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:54.015266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.017948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 276/550] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:56:54.018210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21648d-58dc-43fc-a226-4091ec6d0379 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.018596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21648d-58dc-43fc-a226-4091ec6d0379 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.022807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21648d-58dc-43fc-a226-4091ec6d0379 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.022807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 277/551] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:54.022807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21648d-58dc-43fc-a226-4091ec6d0379 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.128964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:54.142603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ccd9-e1e9-4274-a986-ff7760d287e9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.167699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21648d-58dc-43fc-a226-4091ec6d0379 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.191265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.191877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.192154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.192883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.193548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.195033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.210585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.211243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.211553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.211832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.219843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.222033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-09c08d2f-c12d-4fef-97a5-92f79d790d1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:54.233605 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:54.240008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 278/552] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.240924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.241608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.262138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 275/553] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:56:54 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:54.264586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.266453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:54.267944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:54.287472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:54.364357 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 279/554] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 13:56:54.451228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9ead4-63fc-498d-9d92-cf20b61bac11 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.489257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.489785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.490067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.490331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.491101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:54.491576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.493087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a3f6a-ccba-4d9b-a337-32c96f82e263 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.511958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 276/555] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:56:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:54.517599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.629450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f66ce-2b8c-467a-9f89-fbb1457974bd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.664864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877512-27a6-4c3f-8fa0-b7b1cc544e21 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.665187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877512-27a6-4c3f-8fa0-b7b1cc544e21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.665424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877512-27a6-4c3f-8fa0-b7b1cc544e21 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.665917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.666660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.667001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.667104 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 277/556] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:54.667259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.672583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.672867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.673142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.679109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.681553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.689781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:54.692384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:54.693653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:54.699502 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:54.702193 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:54.703112 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:54.703112 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:54.703112 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:54.703112 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 280/557] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:54.703780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:54.712050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.770905 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 278/558] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 13:56:54.779362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.825956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f0a6-9fa0-4f4b-ae6f-cb0d10d1b6d7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.862595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.863331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.863619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.863889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.864525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:54.864824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.866299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:54.878956 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 281/559] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:54.884141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:54.947600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:54.952096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1f79c-33f9-4713-9da2-29f39c2c16e5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.993211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba97bb-35e5-4657-a50d-c7673bfbfc2d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:54.995223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:54.995841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:54.996227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:54.996505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:54.997156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:54.998552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.036153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.036700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.036979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.037250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.044389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:55.045962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:55.058385 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:55.062793 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:55.063863 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 282/560] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:55.065794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:55.085287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 279/561] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:56:54 2022] POST /identity/v3/services => generated 251 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:56:55.236924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491c0b3-7414-4a03-b324-72e050c164f4 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:55.274338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:55.289525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:55.297870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:55.302381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.303044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.303316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.303586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.304272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:55.304569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:55.305996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.319233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 283/562] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:55.324952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:55.451005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b64c5-d20a-4b8c-9c74-1bb14fbaade6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:55.472864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10734e-6532-4bb2-8952-f5a2bd2c591d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:55.520886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.521526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.521803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.522067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.539507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:55.544262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:55.544706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:55.546178 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:55.547603 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:55.548227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.548227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.548227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/dd208aa4e6dc479a8a24bdfce4dff5d7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.548413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 280/563] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:55.548481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=dd208aa4e6dc479a8a24bdfce4dff5d7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:55.551537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.559049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:55.620311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:55.639276 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 284/564] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:56:55 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/dd208aa4e6dc479a8a24bdfce4dff5d7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:56:55.684179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29c39-c018-4f60-987d-c546882d5d23 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:55.745047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.746125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.746633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.747115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.748040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:55.748625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:55.750251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.760239 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 281/565] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:55.766522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:55.834429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:55.908429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ce63c-91a2-4de4-9e56-73bf2b949fb0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:55.945225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:55.945848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:55.946123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:55.946392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:55.958122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:55.959608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:55.974648 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:55.975587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:55.976458 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:55.976458 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:55.976458 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:55.976458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 285/566] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:55.981656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:56.093070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ba0b-22a0-4188-acd7-8f7a5b00bb94 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:56.122019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:56.132613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:56.133222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.133549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.133818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.134453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:56.134777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:56.136121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:56.152337 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 282/567] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:56.158462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:56.246440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:56.266253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d1db9-ce3d-4cdc-80f8-eb28fa8ed92c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:56.311838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:56.312471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.312749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.313018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.325630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:56.327681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:56.341758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:56.342785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:56:56.343777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:56.344324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 286/568] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:56:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:56.348532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:56.499026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd15c3-288a-4b02-8bae-7e36be287526 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:56.540819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:56.541422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.541695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.541961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.542697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:56.542998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:56.544405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052e260-448d-437d-86ab-4d1ca620bcf5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:56.566350 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 283/569] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:56:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:56.571925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:56.584333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325bbed-bcc2-4a63-961b-46caf78996ea None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.584608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325bbed-bcc2-4a63-961b-46caf78996ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.584870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325bbed-bcc2-4a63-961b-46caf78996ea None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.586431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 284/570] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:56:56.591630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.591906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.592211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.611659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:56.612808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:56.667033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:56.732104 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 285/571] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:56:56.747882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3118-1358-422c-bcd2-be88e81b77f5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:56.790154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:56.790800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:56.791123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:56.791397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:56.808584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:56.867676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:56.869099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:56.999370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 287/572] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:56:57.004595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.035934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.098088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.151604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3d50-07cb-4379-91e3-c32d179d192e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.161187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8ef3b-b89e-40e3-87ce-21dd55b61b71 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.189763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.190595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.191152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.191570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.203335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.204132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.204301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.204718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.205136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.205918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.215967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-6319a011-0003-48da-b8a5-61508918c1b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:57.221579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:57.222540 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:56:57.223427 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b44a0f4d-635e-4418-80fb-c45680d6d0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:57.224053 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:57.224874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 286/573] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6bc0f-8759-4a8f-b9be-ef20c1ed7a04 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6bc0f-8759-4a8f-b9be-ef20c1ed7a04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.225740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6bc0f-8759-4a8f-b9be-ef20c1ed7a04 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.227207 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 287/574] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:57.229108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 288/575] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:57.235143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6bc0f-8759-4a8f-b9be-ef20c1ed7a04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.236599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.237147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.237643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.262652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:57.262652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:57.262896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.341953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6bc0f-8759-4a8f-b9be-ef20c1ed7a04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.342747 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 289/576] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:56:57.343632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.376643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.377251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.377530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.378142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.378426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:57.378768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.380211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.395861 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 288/577] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:57.401603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.406748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.522839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706879-1ccc-408b-9a90-677cc1d878af None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.559913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.560524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.560828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.561097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.561749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:57.562047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.564083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.565595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.581284 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 290/578] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:57.586841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.601381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a5fb-9c9e-4859-ae22-8baaa7aebcb7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.666663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.667243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.667589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.667862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.675472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.676904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:57.690322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:57.691487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:57.692617 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 289/579] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:56:57.693132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.740069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1315-3906-4ea3-bf15-f9c2a69818af None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.743007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.784266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.785359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.786194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.786699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.800750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.803414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.812359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c192-a987-4bb4-9e39-b3aa3e704380 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:57.825055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:57.826097 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:57.828184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:57.828184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:57.828184 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:57.828184 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 291/580] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:57.828184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.857754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.858374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.858698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.858975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] PATH_INFO: `/v3/services/network` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.859546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:57.860958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:57.869834 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:57.870878 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:57.871709 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 290/581] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:57.872516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:57.902815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:57.962580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4d52-3590-4077-a44f-b9c05ff78fd3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.983221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d060ff-e8b0-42e6-8139-2b10a6b81fd7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:57.997179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:57.997980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:57.998877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:57.999136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:57.999816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.000117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.001542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.014910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 292/582] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.015530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.024174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.024806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.025057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.025323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.025957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.026257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.027644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c97ea-57f8-4202-81c4-ed3d48a1318a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.027753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.039692 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 291/583] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.041141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a97e4-8547-4d04-bbaa-4557b0520e12 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.041633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a97e4-8547-4d04-bbaa-4557b0520e12 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.042112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a97e4-8547-4d04-bbaa-4557b0520e12 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.043888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 292/584] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:58.044789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a97e4-8547-4d04-bbaa-4557b0520e12 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.116181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.126384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459deb-8c1e-4db7-ac48-aa6dc9a11ab3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.153635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a97e4-8547-4d04-bbaa-4557b0520e12 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.159600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.160231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.160504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.160772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.161388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] RBAC: Adding query filter params (name=network) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.161683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.163074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.167427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 293/585] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.168185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.197087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.197990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.198417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.198859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.199824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=7cf0897f734e424a9dbbda87f9c0d6f2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.200359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.201916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dff85-e684-450d-b493-2637e0b34c0c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.208758 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 293/586] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/role_assignments?user.id=7cf0897f734e424a9dbbda87f9c0d6f2&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.210095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.210373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.210661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.231484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:58.233375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:58.260653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.290534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cb9bf-1ceb-44d1-8b2f-60adf0057d0f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.323805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 294/587] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:56:58.324985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.337624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.338496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.338921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.339321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.354001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.355555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-40e94227-b222-45a3-8137-f4d84e4b10b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:56:58.368637 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:58.369664 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:58.370600 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 294/588] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:58.375421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27bce-f099-4a6d-8970-5d6ffbfde9ed None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.375698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27bce-f099-4a6d-8970-5d6ffbfde9ed None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.375972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27bce-f099-4a6d-8970-5d6ffbfde9ed None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.381555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 295/589] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:56:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:56:58.381555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27bce-f099-4a6d-8970-5d6ffbfde9ed None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.421644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.471554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ea78c-ed8d-4159-a812-74f09fba8e80 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.511419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27bce-f099-4a6d-8970-5d6ffbfde9ed None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.518374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.519080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.519445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.519780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.520881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] RBAC: Adding query filter params (type=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.521258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.523071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266bf04-09fb-4a60-98ba-37645bba1a0e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.530600 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 295/590] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.531958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.532402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.532669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.553135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:56:58.553998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.554294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:56:58.554677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.554964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.555291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.556357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.556668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.559131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.560887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.580891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 296/591] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.581726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.631054 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 296/592] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:56:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:56:58.632152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.698198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.709791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c60b-de8b-4e33-9f0a-1e53c6689395 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.747119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318bf3a-d4c2-4f35-8b96-2ac3cbede9ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.753089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.753955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.754428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.754936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.755871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] RBAC: Adding query filter params (interface=public, service_id=c7b09492a05c4ef38a966cc5868bd37d, region_id=RegionOne) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:58.756386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.758108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.767675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 297/593] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/endpoints?service_id=c7b09492a05c4ef38a966cc5868bd37d&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:58.768906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.786150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.786590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.786899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.787174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.855105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.864764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.865992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.879212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfab28-2a2f-49b0-b880-97d86f280b0b None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:58.921800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:58.922428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:58.922739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:58.923012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:58.923594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:58.924963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:58.928011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:58.934133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:58.935116 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:56:58.935969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 298/594] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:58.936732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:58.982672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 297/595] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:56:58.982672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.049554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031870-acb7-4d1c-9470-2b065772a8a2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.070323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.085209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.085816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.086096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.086368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.086653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d44693-9272-42aa-9c3b-f2b0753b67a4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.087089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.088370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.094140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 299/596] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.095487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.131048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.132264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.132764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.133235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.148219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:56:59.153957 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:59.155839 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:56:59.156654 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:59.157268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 298/597] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:56:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:59.158221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.182682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.224409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49d6a5-94e9-4408-8717-7c8c2403188c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.262389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.263099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.263380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.263654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.264869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.265173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.266600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.272160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 300/598] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.273025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.295674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b457-56a1-49d5-b515-2b3a628ff5e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.326383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.337181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.337910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.341065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.341065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.349763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.351372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:59.366246 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:59.367435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:59.368348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:59.368348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:59.368348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:59.368348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 299/599] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:59.368870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.395635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbfa32-5879-47ab-b4cd-465857ceb8b8 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.440215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.441338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.442186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.442608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.443682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.444401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.446771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.450748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.459279 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 301/600] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.460448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.497135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e441c-246f-4e2a-bf21-907fdd19066a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.542354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.543952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.544710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.545699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.546660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.547315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.548978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.554888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 300/601] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.556091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.585090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdbc0e-e8b1-4350-87e2-5c23c61178bb None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.600184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.634989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.635608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.635888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.636162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.637488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.637797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.639588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.659252 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 302/602] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.660313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.684140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af334e-0e89-4b45-a29a-14977376419c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.716551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.723210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.724142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.724624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.725247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.737912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.739652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:56:59.755994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:59.757004 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:56:59.757899 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:56:59.757899 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:56:59.757899 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:59.760000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 301/603] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:59.760609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.787717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b21e19-f726-4b35-8ce9-17ac57ee0111 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.824848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.825506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.825789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.826143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.826926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] RBAC: Adding query filter params (interface=public, service_id=cfc64d7c11d94fe99cd38533bde0af63, region_id=RegionOne) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.827245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.828731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.834669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 303/604] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/endpoints?service_id=cfc64d7c11d94fe99cd38533bde0af63&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:56:59.835342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.872298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:56:59.877021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa48a1e-3981-4b1e-a2fb-d9760039eb5e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.914684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.915794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.916281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.916756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.925005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.926880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:56:59.939425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:56:59.940324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:56:59.941198 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:56:59.943326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 302/605] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:56:59.944309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:56:59.944814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28512954-fa0d-4a16-a9df-dd462eeda149 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:56:59.982347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:56:59.984212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:56:59.984212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:56:59.984390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:56:59.984893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:56:59.985194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:56:59.986644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:56:59.996421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:00.000091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 304/606] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:00.000934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:00.059888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553ce3-40fe-4a89-a890-1f7c9571f77b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.099303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.100884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.101462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.101939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.102785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.103703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:00.105724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.110984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300320-95f3-4699-b600-58007d9ed3c1 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.112827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 303/607] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:56:59 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:00.113887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:00.150233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.150873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.151156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.151433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.152238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:00.152556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.154186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.168369 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 305/608] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:00.174738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:00.305437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65732-ef6b-439f-918e-e82dab36b2b5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.322712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:00.368202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a8a8-e2d9-4ea8-bbaf-a462ebeafc21 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.369776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.372789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.373071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.373396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.381834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.383660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:00.410039 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:00.411071 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:00.411973 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 304/609] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:57:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:00.419221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:00.427320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.427929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.428206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.428476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.429235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=bdf1d58b4c5646629bfa0a0e09b2dc01) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:00.429513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.430992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57b83e-94f1-4bbc-a344-52820145fd05 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.444677 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 306/610] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:00 2022] GET /identity/v3/role_assignments?user.id=bdf1d58b4c5646629bfa0a0e09b2dc01&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:00.570989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0378a3-ba63-4dbd-8a91-083529d574dd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.617947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.618639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.618864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.619133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.619856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:00.620157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.621582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.638512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8b53-44aa-438d-8849-bc7587eac6e1 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.639366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8b53-44aa-438d-8849-bc7587eac6e1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.639663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8b53-44aa-438d-8849-bc7587eac6e1 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.641306 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 307/611] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:00.643661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 305/612] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Oct 31 13:57:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:00.650654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.650654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.650654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.651677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:00.674783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:00.676943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:00.702939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:00.707341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:00.796632 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 308/613] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:00.828044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9085-3fbe-4c60-9a75-91ae226cd5bd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:00.864058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:00.864664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:00.864935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:00.865199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:00.949044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:00.950474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:00.984277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.065174 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 306/614] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:57:01.070791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.180829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d9d8-2b67-497d-aaad-376dde8ae597 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.226190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.226767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.227057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.227325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.242310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.243787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.252646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.253792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:01.265721 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:01.269704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:01.270609 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:01.270609 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:01.270609 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:01.270609 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 309/615] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:01.274927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.426760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685ec1c-1630-4a54-9a3b-8c369320f95f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.438274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab326-7b5e-4c1a-a8f1-d0f2246c00b4 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.467619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.478964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.479424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.479555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.479778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.480054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.480641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.480757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:01.480979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.481309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.481722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.482340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77966551-0bc4-4745-8e03-a27f0d631960 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.482658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.484974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d28d3f50-b6df-479c-b176-d29f8ca079b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:01.496110 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:01.497206 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:01.498399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:01.499324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 310/616] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:01.499324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4cc0-a04a-4912-a323-d6bebd4c174f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.499324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4cc0-a04a-4912-a323-d6bebd4c174f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.499324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4cc0-a04a-4912-a323-d6bebd4c174f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.499988 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 311/617] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:01.501838 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 307/618] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:01.504769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d4cc0-a04a-4912-a323-d6bebd4c174f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.506303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.506800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.507256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.528962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:01.531017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:01.582979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.614649 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 308/619] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:01.614649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.650636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d4cc0-a04a-4912-a323-d6bebd4c174f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.719290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef7a7-8abb-4fbd-8960-0b5ba1a347ff None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.731407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.732004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.732302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.732558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.742387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.745577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.755174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.757590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.758360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.758666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.758991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.759740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:01.760139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.761502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.767765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 309/620] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:01.773939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:01.777943 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:01.778892 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:01.780369 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 312/621] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:01.787102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:01.930321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf239-274b-4056-a18e-0ac321ad5baf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.949606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3ad4-902b-4b6e-bfaf-d584c9d48725 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:01.974757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:01.993330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:01.993330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:01.993330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:01.993330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:01.993835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:01.993835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:01.993835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:01.995605 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 310/622] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:02.007534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.008176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.008452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.008721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.009438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:02.009750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.011299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:02.026519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 313/623] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:02.033244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:02.049691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:02.131303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:02.228069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515f3-e4db-4d9c-baa9-1669aca10d43 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:02.249907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cf7f6-8704-445b-93e2-ed0a325d9b3b None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:02.279708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.280371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.280580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.280846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.283136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=dd208aa4e6dc479a8a24bdfce4dff5d7) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:02.283662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.286107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:02.294753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 311/624] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:02 2022] GET /identity/v3/role_assignments?user.id=dd208aa4e6dc479a8a24bdfce4dff5d7&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:02.300871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.301890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.302392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.302897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] PATH_INFO: `/v3/services/network` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.303709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.305371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:02.316166 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:02.317240 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 13:57:02.318073 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:02.321024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 314/625] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:02 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:02.327294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:02.459570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa516131-bba1-4a15-9b1f-8f0983fd200d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:02.473982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:02.502530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.503102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.503383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.503654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.504349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] RBAC: Adding query filter params (name=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:02.504741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.506117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:02.511267 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 312/626] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:02.520272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:02.587576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:02.666106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ac-fdc3-42e9-af74-6fc664b2b103 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:02.708414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.709411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.709897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.710371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.711309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:02.711839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.713434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbf54e-a0bf-4c34-8317-6599c75f5fb7 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:02.719694 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 315/627] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:02.725546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:02.727897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcbab-a1ae-449a-a7c1-162baf14ace5 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.728426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcbab-a1ae-449a-a7c1-162baf14ace5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.728914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebcbab-a1ae-449a-a7c1-162baf14ace5 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.730682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 316/628] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:02.740126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.740412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.740685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.760350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:02.761646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:02.859718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a287881-1902-461a-b9a9-b093ee2f8c8b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:02.865208 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 317/629] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:02.901836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:02.902452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:02.902761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:02.903036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:02.903720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:02.905659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:03.028865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 313/630] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:03.156562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:03.217650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:03.290339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de51d-5f27-4061-972c-88c86dc53ae3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:03.332912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:03.333545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.333821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.334088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.334680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:03.336048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-7223cdff-5901-461f-8bce-e772e51cdb10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:03.345365 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:03.347644 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:03.348948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 318/631] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Oct 31 13:57:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:03.356651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:03.392620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a502-01a9-4d63-b794-f3239c0f2acc None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.392943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a502-01a9-4d63-b794-f3239c0f2acc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.393164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a502-01a9-4d63-b794-f3239c0f2acc None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.394766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 319/632] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:03.404962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.405503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.405994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.410277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:03.428654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:03.430166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:03.492949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853e1c-933d-4171-b014-188621fa4367 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:03.523180 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 320/633] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:03.539829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:03.540832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.541349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.541821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.542695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:03.543208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:03.544817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:03.555973 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 314/634] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:57:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:03.557725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:03.593118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:03.668211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b55c3-53e1-4ab5-8da9-bd162bb24dd1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:03.703957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:03.710147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.710734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.711186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.711987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:03.717632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:03.719294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:03.725094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 321/635] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Oct 31 13:57:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:03.730682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:03.812525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:03.833425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:03.841338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a9fa6-5dfd-4492-9f8e-5fd9c2a200e7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:03.879267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:03.880072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.880350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.880623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.881644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:03.883360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:03.919511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:03.928459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660a81-3b49-491e-82db-9488c987f66f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:03.966741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:03.966741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:03.967041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:03.967308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:03.974907 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 315/636] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:03.986300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:03.992117 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:03.993151 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:03.994405 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 322/637] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:57:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:04.002793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.128113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760bcc-dd01-4389-9ed3-613f4e44769f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:04.167481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:04.168634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.169115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.169585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.171009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:04.171533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:04.173126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:04.181871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 316/638] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:04.187488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.300224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07ce4c-4f5f-4ad4-9529-3c4585796ec7 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:04.337180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:04.338182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.338753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.339283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.351285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:04.353093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:04.368124 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:04.369066 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:04.370013 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:04.370013 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:04.370013 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:04.372125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 323/639] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:04.380033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.392525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:04.494017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14046a-68bd-4252-9174-217c274f4621 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:04.533083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:04.534023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.534512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.535014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.535833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:04.536316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:04.537862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba04d-9753-4587-aac6-d4a3f2d0ad44 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:04.551043 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 317/640] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:04.559142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.560433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:04.580196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4482-f87f-4deb-bc68-9dc181da112b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.580616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4482-f87f-4deb-bc68-9dc181da112b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.580789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4482-f87f-4deb-bc68-9dc181da112b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.582322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 318/641] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:04.587397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.587682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.587961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.607090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:04.608326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:04.674977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd463-b0a5-4ea6-a9ed-c1b59582052c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:04.685353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:04.694758 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 319/642] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:04.719096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:04.719735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.720011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.720283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.728960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:04.730690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-90542970-bd72-4e54-85b9-1540a7470c46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:04.743129 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:04.744319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:57:04.745303 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:04.752876 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 324/643] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:04.754590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.865607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab87f0-5201-41b6-b222-067d6734df22 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:04.868634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68a6b-9d4b-4e71-a48b-9a88b69c0d5e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.869184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68a6b-9d4b-4e71-a48b-9a88b69c0d5e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.869670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68a6b-9d4b-4e71-a48b-9a88b69c0d5e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.871518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 325/644] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:04.877005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e699c-e728-4039-a02e-e42efb11782f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.877129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e699c-e728-4039-a02e-e42efb11782f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.877390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e699c-e728-4039-a02e-e42efb11782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.897608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-144e699c-e728-4039-a02e-e42efb11782f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:04.898908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-144e699c-e728-4039-a02e-e42efb11782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:04.902925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:04.903540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:04.903813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:04.904081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:04.904842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:04.905144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:04.906656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:04.926392 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 320/645] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:04.936379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:04.967775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:04.977517 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 326/646] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:05.001094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.016777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e699c-e728-4039-a02e-e42efb11782f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.044743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b912b-18af-472b-9f62-00d9774ed29a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.087913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.088536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.089556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.089876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.104132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.105076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:05.120730 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:05.121672 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:05.128058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:05.128058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:05.128058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:05.128058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 321/647] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:05.129944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.144830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e699c-e728-4039-a02e-e42efb11782f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.191798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.192767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.193249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.193718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.195127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.197264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.248558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b90d-67f5-42e5-8bc1-0bd87d3a6b19 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.258918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.274663 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 327/648] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:05 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:05.274663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.308322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.309262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.309750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.310209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.311075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:05.311571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.313194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.327005 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 322/649] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:05.333862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.370228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.437216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5f59c-9370-4aad-90a0-10d07bd24d43 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.474433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc31ec2-6031-4ea9-815c-8c91dcf54827 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.483818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.484464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.485148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.485419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.485997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.488522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:05.500972 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:05.501979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:05.503906 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 328/650] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:05.508717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.520225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.521150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.521657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.522127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.531052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.532565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:05.546845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:05.547793 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:05.548695 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:05.552873 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 323/651] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:05.554876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.586100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.644294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0044bbf-c4d9-44ee-ad07-bd1b08a5e3b3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.666130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.673141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d424-416f-4f8f-876e-69deed61859d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.684245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.684968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.685248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.685518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.686571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:05.686924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.688638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.694934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 329/652] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:05.703546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.727659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.728697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.728987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.729263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.730271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:05.730605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.732237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.746079 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 324/653] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:05.754835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:05.824905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725cfdc-d102-491e-8d8e-15e507aebc04 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.861937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.862537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.862875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.863130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.863494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:05.863760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:05.864068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.865428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936273a-2099-40bd-9935-96112c5e96c9 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:05.870475 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 330/654] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:05.886038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53f9ad-6101-402e-ba8e-95ab85daf13d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:05.927405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:05.928476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:05.928967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:05.929473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/bdf1d58b4c5646629bfa0a0e09b2dc01/roles/af90c0d23a9b4deeae3b85f52bc98754` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:05.932108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=bdf1d58b4c5646629bfa0a0e09b2dc01, role_id=af90c0d23a9b4deeae3b85f52bc98754)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:05.933857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733dab1-87b0-410c-9360-1040cccf1673 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:06.011513 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 325/655] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:57:05 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/bdf1d58b4c5646629bfa0a0e09b2dc01/roles/af90c0d23a9b4deeae3b85f52bc98754 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:57:06.312739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57514-a8e6-4068-a08a-7e1a0b953827 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:06.312935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57514-a8e6-4068-a08a-7e1a0b953827 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:06.313201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a57514-a8e6-4068-a08a-7e1a0b953827 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:06.314837 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 331/656] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:06.320073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:06.320357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:06.320631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:06.338681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:06.339875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:06.407865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 326/657] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:06 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:06.680412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a57514-a8e6-4068-a08a-7e1a0b953827 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:06.735500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:06.793616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a57514-a8e6-4068-a08a-7e1a0b953827 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:06.827392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:06.828016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:06.828292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:06.828622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:06.829197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:06.830610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:06.839661 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:06.840734 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:06.841641 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 332/658] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:06.847375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:06.926955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:06.950193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3a13-9891-4f91-9471-b40b9eed2204 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:06.985595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:06.986196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:06.986478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:06.986787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:06.987417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:06.987722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:06.989076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40271a-def4-494f-8266-3f375f1fd9b7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:06.993965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 327/659] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:07.002055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:07.113128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f6eb-00e7-4e24-96ce-5a4cea19f57e None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:07.123887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:07.148997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:07.149599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:07.149872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:07.150136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:07.150785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:07.151085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:07.152571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445836b-c6f4-42e9-a517-8192ea0b9382 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:07.158160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 333/660] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:07.694759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f935f90-1b48-42c6-b7d3-4a2f1f3bafc2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:07.695181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f935f90-1b48-42c6-b7d3-4a2f1f3bafc2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:07.695286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f935f90-1b48-42c6-b7d3-4a2f1f3bafc2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:07.696848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 328/661] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:07.702903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b8372-3e56-4088-bd4f-a3fae5adfa48 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:07.703360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b8372-3e56-4088-bd4f-a3fae5adfa48 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:07.703456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b8372-3e56-4088-bd4f-a3fae5adfa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:07.724318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-320b8372-3e56-4088-bd4f-a3fae5adfa48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:07.725507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-320b8372-3e56-4088-bd4f-a3fae5adfa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:07.794656 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 334/662] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:07 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:08.055275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a917-63c0-4d37-9298-7c75a4e90e5d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.055775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a917-63c0-4d37-9298-7c75a4e90e5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.055775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a917-63c0-4d37-9298-7c75a4e90e5d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.057298 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 329/663] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:08.063560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.063791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a917-63c0-4d37-9298-7c75a4e90e5d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.063908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.064096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.086488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:08.087843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:08.172867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a917-63c0-4d37-9298-7c75a4e90e5d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.178669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 335/664] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:08.212021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.212640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.212912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.213175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.213742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.215130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-538b78ae-7bae-4aa4-8f5a-2b6126784553 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:08.224260 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:08.226446 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:08.228579 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:08.235337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.239981 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 330/665] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:08.241509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e010efb-c443-41dc-9513-728db9afa93f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.241999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e010efb-c443-41dc-9513-728db9afa93f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.242563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e010efb-c443-41dc-9513-728db9afa93f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.244346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 331/666] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:08.249416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.249915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.250407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.258948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.268872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.270774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:08.278887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:08.346634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d31dd5-da03-4744-8215-51834fdc3204 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.354640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 332/667] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:08.382758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.383373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.383653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.383925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.384547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:08.384846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.386217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.391373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 336/668] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:08.399230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.446788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.511582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226cc78-4e9a-41a8-9581-df466874b113 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.553742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.554024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.554557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.554861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.555134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.555754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:08.556052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.557512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.558019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfe6c8-c01f-40b6-8a32-4e9ec2822966 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.558876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.564581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 333/669] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:08.571902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.602529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.603483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.603958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.604416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.605310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.606975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.677219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4a8fe-aa34-4b2d-8191-6ab135cdb076 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.690819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 337/670] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:08 2022] POST /identity/v3/services => generated 241 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:08.692139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.740854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.741472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.741802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.742582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.743395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] RBAC: Adding query filter params (interface=public, service_id=3da5019913dd47178661999458a6d609, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:08.744193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.745886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.758791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 334/671] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/endpoints?service_id=3da5019913dd47178661999458a6d609&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:08.764688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.820548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514416-3d44-4b04-8ebf-ab6961409a38 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.840495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.870160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.870922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.871302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.871672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.883753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:08.891577 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:08.892528 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:08.893405 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:08.894077 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 338/672] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:08.898282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8518c-f08c-405a-9e4e-a96cecc8c560 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:08.899521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:08.924540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:08.944286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:08.945261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:08.945804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:08.946287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:08.947133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:08.948683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:08.956175 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 335/673] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/services => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:57:09.028694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24656-ec18-4ed2-b49b-5dc1bf50c919 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.067878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.068499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.068774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.069043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.069788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:09.070092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.071580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.082080 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 339/674] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 31 13:57:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:09.087982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.198292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c9c6b-010d-48ac-b992-8577ea9c3754 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.224447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:09.240898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.243018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.243018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.243018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.255273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.256759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-691d8fac-5156-4c93-a266-1825b82828dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:09.273070 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:09.274059 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:09.274959 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:09.274959 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:09.274959 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:09.274959 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 336/675] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:09.280131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.348780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5e8a5-4e25-4aa2-ab0e-245e3dc679d8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.349095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5e8a5-4e25-4aa2-ab0e-245e3dc679d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.349322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5e8a5-4e25-4aa2-ab0e-245e3dc679d8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.350904 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 337/676] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:09.356579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.357116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.358157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.370016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:09.378200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:09.386029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:09.394970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0f150-1697-40cd-b5bc-b67f56cf225d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.441793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.442401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.442699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.442968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.443973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:09.444282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.445968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.460973 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 338/677] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:09 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:09.463036 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 340/678] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:09.467256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.570814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddbae4-0351-45ea-a4af-d4aa1c79eb4d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.573127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:09.605033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.605653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.605927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.606197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.614072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.615552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:09.628072 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:09.629298 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 13:57:09.630474 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:09.632588 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 339/679] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:57:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:09.638461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.740497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.744050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dd850-2c5b-4f65-984e-d6135a0d213d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.785404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.786442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.786994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.787483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.788398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:09.788902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.790528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.801374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:09.810841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 341/680] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Oct 31 13:57:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:09.817609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:09.870268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f9601-b054-4dbf-a0b2-8c1a6871c2c2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.909269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.909871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.910148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.910477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.911107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:09.912568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:09.945222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1f6d0-1d39-4334-8809-22b2c9541411 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:09.980444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:09.980989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:09.981259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:09.981515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:09.997043 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 340/681] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:09 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:10.058859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:10.063402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:10.065168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:10.182423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 342/682] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:09 2022] GET /identity/v3/auth/tokens => generated 1373 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 31 13:57:10.188663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:10.218786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:10.303508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14ded-c2f5-4a1c-bc28-0505b3a7ad52 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:10.339573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:10.340201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:10.340477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:10.340746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:10.350922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:10.352370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:10.367848 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:10.368830 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:10.369755 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:10.369755 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:10.369755 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:10.369755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 341/683] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:10.376567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:10.478295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:10.481903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92351d-f3e1-4a75-9fd7-5d9974cac723 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:10.517481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:10.518657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:10.518946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:10.519226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:10.519866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:10.520172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:10.521572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:10.534433 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 343/684] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:10.543694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:10.616981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:10.649800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e852-2a50-4548-ba42-91651fba41d0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:10.685895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:10.686528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:10.686820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:10.687089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:10.693986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:10.695469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:10.706869 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:10.707774 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:10.708676 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 342/685] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:10.715726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:10.822063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131b063-badf-43a8-ba75-45cac6906b7d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:10.858015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:10.858643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:10.858928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:10.859202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:10.859949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:10.860531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:10.861958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24772a-5509-42cd-8824-41aa87050613 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:10.874916 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 344/686] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:10.880922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:10.995572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ef96e-3914-48a2-bb33-fb6cd12b301f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.015764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976513-229f-4abd-a080-06df02456b85 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.016754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976513-229f-4abd-a080-06df02456b85 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.017233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976513-229f-4abd-a080-06df02456b85 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.019108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 345/687] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:11.023904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ff22-fec3-4af1-abc5-80ebad769d5c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.024154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ff22-fec3-4af1-abc5-80ebad769d5c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.024426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ff22-fec3-4af1-abc5-80ebad769d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.031449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.032969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.033269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.033545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.034295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] RBAC: Adding query filter params (role.id=af90c0d23a9b4deeae3b85f52bc98754, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=bdf1d58b4c5646629bfa0a0e09b2dc01) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:11.034609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.035108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:11.038174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227bd8a-f801-4ca7-aed0-893e0e365eee None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.044983 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 343/688] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:10 2022] GET /identity/v3/role_assignments?user.id=bdf1d58b4c5646629bfa0a0e09b2dc01&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=af90c0d23a9b4deeae3b85f52bc98754 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:11.045217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1fa4ff22-fec3-4af1-abc5-80ebad769d5c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:11.046504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1fa4ff22-fec3-4af1-abc5-80ebad769d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:11.072906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:11.129627 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 346/689] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:11.173461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a97c-42df-4fff-8c84-c9b1ca71583c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.174088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a97c-42df-4fff-8c84-c9b1ca71583c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.174592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a97c-42df-4fff-8c84-c9b1ca71583c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.176268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 344/690] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:11.181951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.182240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.182513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.203090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:11.204310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:11.284570 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 347/691] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:11.405405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a97c-42df-4fff-8c84-c9b1ca71583c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.514474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a97c-42df-4fff-8c84-c9b1ca71583c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.548970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.549593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.549869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.550141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.550738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.552097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:11.560784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:11.561843 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:11.563237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 345/692] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:11.564039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.567689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.640058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:11.653758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:11.684509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee624a-a47a-41f4-8b61-77b013942715 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.685974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bf75-8d9f-4abf-b501-590d5e388978 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.732962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.734014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.734492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.734985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.735778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.737539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.737648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.738182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.738451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.738752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.739371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:11.739670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.741174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.746663 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 346/693] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:11.752044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:11.753524 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:11.754440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 13:57:11.755511 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:11.762560 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 348/694] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:11.764898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.863573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fa2f5-440c-458a-86f1-7db2d10f4f81 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.877531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f0c-75bd-45d1-bc22-73b571ca5e94 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:11.892038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:11.905060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.905671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.905988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.906253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.906929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:11.907362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.909400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.918762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 347/695] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:11.920725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.922998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:11.923610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:11.924135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:11.924353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:11.924992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:11.925288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:11.926860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:11.937933 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 349/696] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:11.938777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:11.948524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:12.037795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d37ec-2d79-4c51-854c-2dbb8973135e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:12.057320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba66b-620d-48e0-a46e-781d7195b691 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:12.078968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:12.080254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.081008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.081489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.082376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] RBAC: Adding query filter params (interface=public, service_id=ab4c6fef7719416ea88fdba87333b2a7, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:12.082926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:12.084489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:12.094840 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 348/697] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/endpoints?service_id=ab4c6fef7719416ea88fdba87333b2a7&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:12.096326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:12.100723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:12.101607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.102083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.102546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.103388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:12.103900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:12.105868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:12.113226 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 350/698] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:12.118426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:12.161530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:12.204854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:12.218534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2f42-3a74-4c43-b518-dc8251de726e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:12.244115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e986-2f97-48e1-9eb0-21c25bb2a1fe None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:12.260869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:12.261944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.262728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.263215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.264662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:12.267145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd2827-44e9-4a83-a42b-6ec06bcf711a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:12.283101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 349/699] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:12 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:57:12.290443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:12.291536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.292018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.292498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.293448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:12.295743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:12.393654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c128-2a16-4d6c-b91e-110fd7a017ca None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.393999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c128-2a16-4d6c-b91e-110fd7a017ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.394199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c128-2a16-4d6c-b91e-110fd7a017ca None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.396126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 350/700] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:12.401493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.401781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.402045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.402952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 351/701] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:12.425254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:12.426573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:12.511514 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 351/702] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:12.783645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:12.889444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5b0f0-3935-463d-9538-f1696ea596a6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:12.916671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:12.926523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:12.934476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:12.934476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:12.934476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:12.934476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:12.934476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:12.938777 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:12.940008 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:12.941062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 352/703] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:12.946009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:12.991985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:13.051316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742a8b1-e296-4cd9-909e-5d7e5e2195de None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:13.086838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:13.087448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.087724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.087994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.088618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:13.088917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:13.090278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:13.096107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 352/704] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:13.101408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:13.209362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b16cd1-d1e6-4680-8100-94d98238a64a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:13.251503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:13.252396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.252827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.253281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.254095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:13.254560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:13.256216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb070459-58c3-4277-aad3-b06869d03c10 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:13.263362 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 353/705] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:13.274787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:13.368449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d853-a4a1-4a09-bddf-a6b96e07a92e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.368745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d853-a4a1-4a09-bddf-a6b96e07a92e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.368923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d853-a4a1-4a09-bddf-a6b96e07a92e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.371648 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 354/706] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:13.375888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.376272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.376550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.382012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045d022-ff38-4fb7-be7d-25e84df207a5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:13.390473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:13.398751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:13.399982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:13.423642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:13.424723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.425227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.425821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.427255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] RBAC: Adding query filter params (interface=public, service_id=6d7fae7d722649dcb73466483ccf2f03, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:13.427772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:13.429567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:13.435275 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 353/707] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:57:13 2022] GET /identity/v3/endpoints?service_id=6d7fae7d722649dcb73466483ccf2f03&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:13.443546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:13.458901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:13.485778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 355/708] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:13.551307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f437-f043-4977-a3d2-b9485f0e7a23 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:13.587222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:13.588086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.588532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.588948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.589687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:13.591250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:13.599162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 354/709] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:13 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 13:57:13.758465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:13.868383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97f2b-dd8f-4c98-bab5-ddcc63ecceb6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:13.904101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:13.905110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:13.905669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:13.906142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] PATH_INFO: `/v3/services/image` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:13.906953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:13.908580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:13.917602 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:13.918593 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:13.919477 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:13.926733 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 356/710] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 31 13:57:13 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:13.931705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:13.969217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:14.040379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a9180-e96b-40ac-89c8-3c9a9eb0900d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:14.076820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:14.077487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.077761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.078027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.078724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] RBAC: Adding query filter params (name=image) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:14.079025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:14.080385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b0fd0-d15b-4214-ac78-8fa33e1e3fdc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:14.085478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 355/711] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:14.091303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:14.145711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:14.204657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090c8c2-3a81-41d7-963b-3c41e5b4990a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:14.241928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:14.242814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.243243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.243663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.244451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] RBAC: Adding query filter params (type=image) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:14.244911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:14.246543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cce2b-2e3c-4328-a52e-03df61f5fe10 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:14.251774 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 357/712] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:14.589075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819c989-0921-4ec5-ad44-11ddcca22dda None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.589570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819c989-0921-4ec5-ad44-11ddcca22dda None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.589570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819c989-0921-4ec5-ad44-11ddcca22dda None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.591135 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 356/713] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:14.596962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9de14-cd1e-41ea-820c-54849ec9cab0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.597251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9de14-cd1e-41ea-820c-54849ec9cab0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.597523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9de14-cd1e-41ea-820c-54849ec9cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.615986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-35b9de14-cd1e-41ea-820c-54849ec9cab0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:14.617162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35b9de14-cd1e-41ea-820c-54849ec9cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:14.692352 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 358/714] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:14.765455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b845b-fae8-4f27-bb70-e78d98ed2324 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.765782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b845b-fae8-4f27-bb70-e78d98ed2324 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.766006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b845b-fae8-4f27-bb70-e78d98ed2324 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.767614 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 357/715] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:14.772765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:14.773050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:14.773320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:14.792188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:14.793364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:14.829482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:14.866920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 359/716] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:14.965997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b845b-fae8-4f27-bb70-e78d98ed2324 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.066318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:15.071272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b845b-fae8-4f27-bb70-e78d98ed2324 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.105477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.106114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.106395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.106691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.107271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.109050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:15.118171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:15.119249 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.120706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 358/717] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:15.125773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.145626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.235346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5477-0a0c-421d-82ea-fbd6cb09de72 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.253666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a17ee-9f51-4520-94f1-5252963d534a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.273737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.274716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.275067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.275349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.275991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:15.276296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.278007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.288112 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 360/718] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:15.289145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.300649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.300649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.300649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.300649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.302820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.304427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:15.315953 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:15.316973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:15.317815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:15.318792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 359/719] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:15.322997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.336482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:15.353340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:15.423993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fc74-0caa-4e69-b8f5-5a091cc7497a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.436648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d403de9-c7fd-4c66-9903-85244c0df3ff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.471126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.471743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.472013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.472282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.472911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:15.473213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.474574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.475973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.476872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.477327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.477795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.478599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] RBAC: Adding query filter params (name=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:15.479101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.482957 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 361/720] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:15.485852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.486318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.496188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 360/721] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:15.497244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:15.594030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:15.597415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c7ec-b8c8-4ccd-882d-4d1e2ba79855 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.620220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:15.636641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e38b-20ab-482e-98f6-760183a65aae None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:15.644023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.644876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.645349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.645828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.647118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.649197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aa502-35e1-419a-93fa-546a4fc74bc8 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.678296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:15.678296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.678296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.678296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.678795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:15.678795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:15.679215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ee952-c3ce-4bb6-bef1-b472a97e39dd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:15.686653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 361/722] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:15.738581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 362/723] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:15.916870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56b50-06f6-4427-98b8-5d59f2e16c5f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.917252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56b50-06f6-4427-98b8-5d59f2e16c5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.917460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56b50-06f6-4427-98b8-5d59f2e16c5f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.921023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 362/724] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:15.925233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:15.925513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:15.925783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:15.945224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:15.946322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:16.025477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 363/725] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:16.296494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56b50-06f6-4427-98b8-5d59f2e16c5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:16.408208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff56b50-06f6-4427-98b8-5d59f2e16c5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:16.444223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:16.444844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.445172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.445378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.445951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:16.447332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e90fd42d-c496-4563-a7d1-4d1d5b4e3d46 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:16.456533 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:16.457576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:16.458405 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 363/726] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:16.465824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:16.496309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad257c-11cb-40d0-96dc-0bf97c082a16 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.496607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad257c-11cb-40d0-96dc-0bf97c082a16 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.496876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad257c-11cb-40d0-96dc-0bf97c082a16 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.499576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 364/727] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:16.503535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.503821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.504094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.523933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:16.525130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:16.540268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:16.569146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:16.594768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df4079-6e1d-4d7b-90d8-7be7c9060dd2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:16.606661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 365/728] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:16.634533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:16.635173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.635450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.635716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.636438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:16.636744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:16.638466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:16.643711 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 364/729] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:16.649238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:16.756500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db470bb-dbda-415b-82ba-4b58b00fd1ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:16.792517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:16.793118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.793392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.793662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.794279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:16.794577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:16.796037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:16.801167 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 366/730] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Oct 31 13:57:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:16.806739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:16.883560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:16.900314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:16.912967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b27a0-70dc-4c73-964b-dae6170efc8e None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:16.947985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:16.948590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:16.948864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:16.949129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:16.949790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:16.951719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1558b-2340-439a-b3ae-3eb5f2af7bd4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:16.997132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce0d7d-b470-42db-bb94-bfbd7a68cae3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:17.033999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:17.034679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:17.035007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:17.035278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:17.035909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:17.037265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fb0e2-3766-4d32-91e8-b096319d7ccc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:17.046660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 365/731] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:17.142252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 367/732] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:16 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:17.921843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f188-345a-4048-bf79-07cc08e6a5e7 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:17.922367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f188-345a-4048-bf79-07cc08e6a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:17.922707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66f188-345a-4048-bf79-07cc08e6a5e7 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:17.924399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 366/733] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:17.929712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da02be-4c77-4999-8dec-d65478ea0a03 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:17.930133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da02be-4c77-4999-8dec-d65478ea0a03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:17.930453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da02be-4c77-4999-8dec-d65478ea0a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:17.949561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a3da02be-4c77-4999-8dec-d65478ea0a03 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:17.950819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3da02be-4c77-4999-8dec-d65478ea0a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:18.026442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:18.034173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 368/734] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:18.077364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2e17-be90-4340-ac75-f963497f2638 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.077648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2e17-be90-4340-ac75-f963497f2638 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.078166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2e17-be90-4340-ac75-f963497f2638 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.080023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 367/735] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:18.085394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.085684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.085959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.105729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:18.106921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:18.174454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 369/736] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:18.313733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2e17-be90-4340-ac75-f963497f2638 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:18.316654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:18.421499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2e17-be90-4340-ac75-f963497f2638 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:18.449943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:18.458213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:18.458919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.459197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.459468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.460130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:18.461606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:18.542436 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 368/737] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:18 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:18.564413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fcbd9-1c88-467d-975c-d4d8d83807c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:18.597796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:18.614453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:18.615376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.615804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.616270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.617009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:18.618597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:18.628819 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:18.630058 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:18.631075 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:18.634666 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 370/738] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:18.644065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:18.722560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:18.755369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bf1f-665a-4d2c-83a8-68efb11096f5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:18.790972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:18.791821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.792241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.792676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.793462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:18.793912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:18.795463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:18.801130 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 369/739] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:18.806896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:18.916577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe1105-cd7d-468f-98ae-0a3c54b1b027 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:18.953210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:18.954502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:18.954956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:18.955371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:18.956164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:18.956611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:18.958113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:18.963960 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 371/740] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:18.972577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:19.074998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dacff-8d19-4417-a1c2-64d719a6bf14 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:19.101421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:19.110901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:19.111508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.111782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.112050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.112753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] RBAC: Adding query filter params (interface=admin, service_id=ab4c6fef7719416ea88fdba87333b2a7, region_id=RegionOne) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:19.113058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:19.114486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a99ba2-a84a-4ff2-8fe6-054c9136742b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:19.119850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 370/741] 10.222.0.13 () {56 vars in 1249 bytes} [Mon Oct 31 13:57:18 2022] GET /identity/v3/endpoints?service_id=ab4c6fef7719416ea88fdba87333b2a7&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:19.127750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:19.186200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:19.244181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988095ca-414c-40f0-8c18-5e2c1f4e54f3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:19.279281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:19.279904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.280185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.280460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.281358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:19.282890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647813-4547-4d7e-8bbf-2fd83f0848f5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:19.292575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 372/742] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:19 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:57:19.332370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2daec-6694-4a43-a336-665576b9903b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.332721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2daec-6694-4a43-a336-665576b9903b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.332911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2daec-6694-4a43-a336-665576b9903b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.334610 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 371/743] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:19.340543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.340828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.341103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.361556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:19.362809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:19.421956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2514e-6abc-47e9-b5a6-e9051de29bc8 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.422277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2514e-6abc-47e9-b5a6-e9051de29bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.422511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2514e-6abc-47e9-b5a6-e9051de29bc8 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.424420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 372/744] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:19.432565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.433202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.433854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.440062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 373/745] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:19 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:19.456273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:19.457851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:19.534439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 373/746] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:19 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:19.708235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:19.754676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:19.813329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a053-fd9d-4ff7-8d5e-3b13e8a416eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:19.817890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:19.849743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:19.850351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.850640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.850990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.851634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:19.853060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:19.855723 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.server.flask.common [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 13:57:19.901953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:19.901953 n-d-863055-2 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:57:19.901953 n-d-863055-2 devstack@keystone.service[82161]: [parameters: {'id': 'c75543fbe8e04a6489a909f578f62554', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 13:57:19.901953 n-d-863055-2 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c75543fbe8e04a6489a909f578f62554.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c75543fbe8e04a6489a909f578f62554. Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:19.911085 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 13:57:19.911922 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 13:57:19.912879 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 13:57:19.913784 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 13:57:19.914757 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:19.915597 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': 'c75543fbe8e04a6489a909f578f62554', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.916469 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:19.919324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c75543fbe8e04a6489a909f578f62554. Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 374/747] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Oct 31 13:57:19 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:19.920498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:19.935568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06bbb4-f3cf-4b27-a622-0b9b3ba09a3f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:19.958785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:19.975039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:19.977745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:19.977745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:19.977745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] PATH_INFO: `/v3/services/image` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:19.977745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:19.979507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:19.989501 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:19.990717 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:19.991674 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:19.994347 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 374/748] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 31 13:57:19 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:20.000295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:20.040003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a94-0dbe-435a-8bc3-a2b2130642a7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.041914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:20.088382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.089368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.089852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.090349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.100370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.102809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.118578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284ba98-8aa9-4dc6-84eb-767c7b64f46c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:20.119850 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:20.120713 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:20.121593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:20.124661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 375/749] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:20.131017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:20.162407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.163407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.164034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.164587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.165568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] RBAC: Adding query filter params (name=image) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:20.166176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.168048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.178336 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 375/750] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:20.179584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:20.239126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:20.246028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24826b3-d73a-4eb7-9e44-002f9f0db151 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.286789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.287382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.287662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.287938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.288603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:20.288930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.290864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.293428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab57af6-8cc2-42c8-ab22-fde205596b76 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.318722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 376/751] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:20.332670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.333677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.334160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.334662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.335541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] RBAC: Adding query filter params (type=image) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:20.336066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.337762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.344761 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 376/752] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:20.351273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:20.379348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:20.471390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae502-c9e6-410b-80e6-04a7fe8353e7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.509235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.509771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.510049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.510317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.511068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] RBAC: Adding query filter params (interface=public, service_id=a7bf29ee8cb84e90b52d7d2f0b0d6a41, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:20.511362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.512981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc6f6b-f801-4a98-8695-5b67bdfa860a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.519427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 377/753] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:57:20 2022] GET /identity/v3/endpoints?service_id=a7bf29ee8cb84e90b52d7d2f0b0d6a41&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:20.525009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:20.642150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b637-da2f-4d79-8ef1-adb12bd3beef None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:20.655738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:20.678891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:20.679757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.680048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.680319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.680921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:20.682406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5bc3-4ab3-4920-a6b1-720815781faf None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:20.690242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 377/754] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:20 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:57:20.878971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15deb7-7731-474c-a93d-1ad0d72d6a0a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.879298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15deb7-7731-474c-a93d-1ad0d72d6a0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.879522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15deb7-7731-474c-a93d-1ad0d72d6a0a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.881075 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 378/755] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:20.886665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:20.886950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:20.887219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:20.906848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:20.908040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:20.979599 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 378/756] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:20 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:21.246688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15deb7-7731-474c-a93d-1ad0d72d6a0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:21.334443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:21.350782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15deb7-7731-474c-a93d-1ad0d72d6a0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:21.384664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:21.385302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.385577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.385852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] PATH_INFO: `/v3/services/compute` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.386429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:21.388092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:21.398472 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:21.401087 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:21.401915 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 379/757] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:21.407812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:21.516224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3090-b1f3-4187-a6d7-7f05c1466c7b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:21.523649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:21.550480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:21.551174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.551451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.551720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.552385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:21.552683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:21.554040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8064ea-d820-4dec-b4bc-059153910f42 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:21.559289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 379/758] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:21.564932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:21.588895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df379-02ed-4ac3-b822-786af040b728 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.589189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df379-02ed-4ac3-b822-786af040b728 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.589444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df379-02ed-4ac3-b822-786af040b728 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.592722 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 380/759] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:21.597128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.597414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.597692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.617422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:21.618607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:21.684250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77da90-b87b-4355-83d0-b9d0385a5f9e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:21.710583 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 381/760] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:21 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:21.733241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:21.734496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.734969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.735403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.736246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:21.736695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:21.738201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:21.743583 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 380/761] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:21.750152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:21.851562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:21.854965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925505a8-03c3-4204-bae9-a1c81f72dbc0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:21.890552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:21.891431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:21.891851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:21.892273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:21.893106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] RBAC: Adding query filter params (interface=public, service_id=add211b9ed7e4a948839d1239dfa05e4, region_id=RegionOne) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:21.893549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:21.895235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:21.900868 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 382/762] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/endpoints?service_id=add211b9ed7e4a948839d1239dfa05e4&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:21.906677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:21.923615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:21.991197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:22.020255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabacd24-72f3-4392-b100-6c68c94ad348 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:22.063592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:22.064197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.064472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.064742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.065336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:22.066815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:22.078643 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 381/763] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:57:22.122435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163857e-562e-4fd9-85ce-c7f05543fc10 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:22.160885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:22.161528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.161805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.162078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.162691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:22.164167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:22.174736 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:22.175844 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:22.176804 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 383/764] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Oct 31 13:57:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:22.182237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:22.269740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:22.291581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc3e7-9137-4833-a803-8a088d44fa43 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:22.327744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:22.328354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.328635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.328908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.329537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:22.329837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:22.331258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:22.341078 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 382/765] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:22.342509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:22.372799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:22.448562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98069d05-b0aa-4496-9156-87fbb59abc18 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:22.486827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:22.487427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.487701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.488030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.488651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:22.488960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:22.490399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29fde1-c660-46e5-980f-e39abe0fd80e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:22.496179 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 384/766] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Oct 31 13:57:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:22.502001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:22.607389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f99-94af-463e-b59c-fdf448a0c5d8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:22.643477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:22.644083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.644356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.644620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.645292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:22.646735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e011d9-9320-4d51-ab5a-d90388fad26f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:22.725139 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 383/767] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:22.809471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcf48-3a13-4977-ac85-21e625352ec6 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.809849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcf48-3a13-4977-ac85-21e625352ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.810041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcf48-3a13-4977-ac85-21e625352ec6 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.811978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 385/768] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:22.818235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.818567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.818830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.825626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:22.839852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:22.842518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:22.913123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e988b-3535-4832-b5f4-aab104fb9b23 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.913737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e988b-3535-4832-b5f4-aab104fb9b23 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.914222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e988b-3535-4832-b5f4-aab104fb9b23 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.917146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 386/769] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:22.921345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:22.921629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:22.922451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:22.927682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 384/770] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:22.944385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:22.945883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:23.022344 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 387/771] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:23.207626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.295056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.312916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38240-8ac6-4247-aff0-9d2c291488f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.324271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:23.346110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:23.356767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.357786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.358256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.358719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.359513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.361618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.409089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3cd9f-f247-4a35-976a-ca9e19a256bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.433561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 13:57:23.433561 n-d-863055-2 devstack@keystone.service[82161]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 13:57:23.433561 n-d-863055-2 devstack@keystone.service[82161]: [parameters: {'user_id': '64ba9a7dd0474fc6a99012b03f77611f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 13:57:23.433561 n-d-863055-2 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:23.441224 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:23.442234 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 13:57:23.450007 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 13:57:23.450955 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:23.452501 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:23.456169 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'user_id': '64ba9a7dd0474fc6a99012b03f77611f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:23.458229 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 31 13:57:23.460968 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 385/772] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Oct 31 13:57:23 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:23.464162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.467633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.468862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.469384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.469854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] PATH_INFO: `/v3/services/image` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.471162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.472897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:23.486440 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:23.487598 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 13:57:23.488816 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:23.492393 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 388/773] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Oct 31 13:57:23 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:23.497820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.571695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72018d0-f7a3-41d7-b4a2-05e390e4a8dd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.611801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.612797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.613301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.613919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.626250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.628251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.632888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:23.642183 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:23.647142 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 13:57:23.648074 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:23.654650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874ff6-ac61-413c-8899-e1daf998bc69 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.654801 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 386/774] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:57:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:23.654801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.695186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.695797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.696082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.696353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.696978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] RBAC: Adding query filter params (name=image) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:23.697281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.699256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.709410 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 389/775] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:23.719310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:23.722911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:23.781672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c277-1aad-4865-86d4-91186aa5952e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.825433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.826248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.826934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.827330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.828396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:23.828799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.830315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.851166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3420ed-193d-4879-a4f0-9fd2ef0fd476 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:23.883069 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 387/776] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Oct 31 13:57:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:23.890543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:23.891445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:23.891886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:23.892310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:23.893237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] RBAC: Adding query filter params (type=image) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:23.893730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:23.895328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed880e88-5714-4e4b-8683-7fca1c8476ba None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:23.901909 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 390/777] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:23.908733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:24.023717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e063f-f141-4560-b0f1-0a70e7c116da None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:24.035518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:24.063090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:24.063939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:24.064362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:24.064803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:24.065629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:24.067181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f933b1-ca8b-411b-9f7c-e79611958f6b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:24.148306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 388/778] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:24.406407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c2f9-7675-4914-9780-6c8f0b67e7f6 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:24.406984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c2f9-7675-4914-9780-6c8f0b67e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:24.406984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c2f9-7675-4914-9780-6c8f0b67e7f6 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:24.408525 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 391/779] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:24.413786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:24.414175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:24.414348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:24.432718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:24.434230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:24.507816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 389/780] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:24 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:24.777226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c2f9-7675-4914-9780-6c8f0b67e7f6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:24.793449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:24.879856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56c2f9-7675-4914-9780-6c8f0b67e7f6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:24.913502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:24.914121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:24.914395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:24.914685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:24.915261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:24.916630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-80584a2f-4531-4f8a-8c3c-049cc80f6a88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:24.925643 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:24.927069 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 13:57:24.928205 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:24.929338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 392/781] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:24.932980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:25.026381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:25.036391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824917-d10a-4807-86ff-78a7cda54294 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:25.052474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0982-7fae-4cf9-8c91-c5f092c24f24 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.052760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0982-7fae-4cf9-8c91-c5f092c24f24 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.053034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0982-7fae-4cf9-8c91-c5f092c24f24 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.054799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 393/782] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:25.061125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.061444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.061693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.076885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:25.077640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.078021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.078397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.079165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:25.079571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:25.080626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:25.081191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:25.081809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:25.092002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 390/783] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:25.093412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:25.151933 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 394/784] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:25 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:25.205036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3be38-9c92-4536-93f6-0926fe64b781 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:25.239270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:25.239859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.240130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.240394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.241003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:25.241296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:25.242652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:25.252672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 391/785] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Oct 31 13:57:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:25.253890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:25.264660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:25.355208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf942a13-d4b1-49a6-a38b-e9511216d885 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:25.390712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:25.391446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.391779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.394028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.394028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:25.394527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:25.431214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:25.449749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:25.475108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 395/786] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:57:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:25.652776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1781d-dc38-4187-b47a-f6f8db471e22 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:25.695195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:25.695817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.696086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.696350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.697421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:25.698873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf3bbf-2e57-4dbb-975c-a5b0a0accbe2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:25.700564 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 392/787] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:25.706534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:25.776667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:25.815378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb93db-ad5c-46ad-a051-c71f2bba21e2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:25.850781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:25.851395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:25.851677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:25.851948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:25.852604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:25.854047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f9f81-433e-4d5f-9b2d-39d6926cc068 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:25.943883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 396/788] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:25 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:26.363271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89821-c39e-46b4-922e-b38a2396cb08 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:26.363495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89821-c39e-46b4-922e-b38a2396cb08 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:26.363778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89821-c39e-46b4-922e-b38a2396cb08 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:26.365342 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 393/789] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:26.370477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:26.370795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:26.371065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:26.390053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:26.391250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:26.463355 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 397/790] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:26.731722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b89821-c39e-46b4-922e-b38a2396cb08 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:26.811581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:26.830081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b89821-c39e-46b4-922e-b38a2396cb08 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:26.864953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:26.865947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:26.866450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:26.866976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:26.867875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:26.869517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:26.901366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:26.901366 n-d-863055-2 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:57:26.901366 n-d-863055-2 devstack@keystone.service[82161]: [parameters: {'id': '267361705f8b4dd5b3f5a7c17e2d928b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 13:57:26.901366 n-d-863055-2 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:26.909232 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 13:57:26.910046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 13:57:26.911043 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 13:57:26.911930 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 13:57:26.912807 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 13:57:26.913595 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '267361705f8b4dd5b3f5a7c17e2d928b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 13:57:26.914478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:26.917505 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:26.920251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 394/791] 10.222.0.13 () {60 vars in 1137 bytes} [Mon Oct 31 13:57:26 2022] POST /identity/v3/domains => generated 190 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:26.922085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:26.968637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:27.022237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4399a-6821-485b-888a-b85e790094e7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:27.056488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:27.057179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:27.057526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:27.057859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:27.068390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:27.069886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-8ff6221f-5204-4ce9-bd0a-8587af05f093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:27.085656 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:27.086839 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:27.087958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:27.087958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:27.087958 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:27.090770 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 398/792] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:27.094038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:27.192658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80296eb-fe8b-4de1-ac16-4539b136c114 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:27.226439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:27.227158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:27.227532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:27.227901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:27.228633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:27.229032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:27.230507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026638e-83fb-429d-a050-66f7b841f719 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:27.250671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 395/793] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:27.716036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecefa8-6ca4-408b-b962-6b463d79f836 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:27.716403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecefa8-6ca4-408b-b962-6b463d79f836 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:27.716627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecefa8-6ca4-408b-b962-6b463d79f836 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:27.718205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 399/794] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:27.723178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a97b-2cf0-49b1-8fcf-5edffc1afc07 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:27.723532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a97b-2cf0-49b1-8fcf-5edffc1afc07 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:27.723815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a97b-2cf0-49b1-8fcf-5edffc1afc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:27.736503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:27.741938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca08a97b-2cf0-49b1-8fcf-5edffc1afc07 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:27.743136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca08a97b-2cf0-49b1-8fcf-5edffc1afc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:27.810970 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 396/795] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:28.079911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecefa8-6ca4-408b-b962-6b463d79f836 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.141344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead771-4c94-456e-ba3b-29a5d0be8632 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.141623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead771-4c94-456e-ba3b-29a5d0be8632 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.141897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ead771-4c94-456e-ba3b-29a5d0be8632 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.143255 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 397/796] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:28.148115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.148401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.148675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.166097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:28.167300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:28.176002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.180727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecefa8-6ca4-408b-b962-6b463d79f836 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.213715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.214339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.214633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.214991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.224928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:28.229698 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:28.230836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:28.231947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 400/797] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:28.236894 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 398/798] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:28.237160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.334470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367ccb-7b39-4d00-bfab-c6063f45e1dd None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.366685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.367275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.367555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.367827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.368481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:28.368783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.370156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.378396 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 401/799] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:28.384005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.447756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.480649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656abc-08b8-4d1f-b53c-6deea29ff4bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.503612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.514018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.514673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.514957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.515226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.525071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.525683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.526504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:28.541333 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:28.542424 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:28.543627 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:28.543627 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:28.543627 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:28.543627 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 399/800] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:28.549053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.604712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b822c-69bc-45d9-95f7-9a40bc17c0f2 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.638718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.639341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.639619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.639890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.640982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.642411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.644146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 402/801] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:28.646323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e99-4d64-4ad4-b1aa-0f8aa5eac6b2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.649678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.663799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.680825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.681508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.681855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.682128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.682787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:28.683091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.684486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.696272 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 400/802] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:28.701805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.742453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.753854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40720a-61c3-4529-afc2-45a3704a7b1b None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.788782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.789382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.789665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.789936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.790577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.792048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.801054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1438e9-f7a8-4d13-a21c-cbf0d891c85f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:28.834296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:28.834946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:28.835224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:28.835496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:28.842793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:28.844207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:28.855412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:28.856324 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:28.857349 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 401/803] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:28.862041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:28.883128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 403/804] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:57:28 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 13:57:28.903251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:28.966533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b2630-e1d5-46a3-affa-23dbd9b23222 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.002127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.002757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.003029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.003292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.004007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:29.004302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.005742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.024956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 402/805] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:57:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:29.031449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:29.130856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad21c-6bb6-4ca8-9067-a16108b9a4de None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.164396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.165020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.165295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.165561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.176412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.177855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.180282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:29.192471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:29.193587 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:29.194689 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:29.194689 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:29.194689 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:29.194689 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 404/806] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:29.199333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:29.290565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:29.296094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437dc1-1069-4446-b4f8-5a08f1738200 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.329212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.329799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.330070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.330333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.331060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:29.331358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.332692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.343351 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 403/807] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:29.348871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:29.449714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adb6e-d9cc-413e-a3c0-b6dc37133ba8 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.482704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.483321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.483593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.483859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.490255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.491721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:29.503220 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:29.504247 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:29.505209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:29.506754 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 405/808] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:29.510089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:29.606924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2b7db-e441-4f34-8c00-604ca9545aba None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.640117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.640708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.640980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.641245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.641915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:29.642211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.643645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a225dc-ddad-4d28-9cef-40b0b3a412d3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.655726 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 404/809] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:29.661763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:29.718111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:29.759747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77d0f0-57e4-4a45-b14b-6c4c8195cb56 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:29.795065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:29.795720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:29.795990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:29.796255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/af90c0d23a9b4deeae3b85f52bc98754` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:29.798337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=7cf0897f734e424a9dbbda87f9c0d6f2, role_id=af90c0d23a9b4deeae3b85f52bc98754)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:29.799787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9132d-3849-4478-a1f6-d54411406b12 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:29.861745 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 406/810] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:57:29 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/7cf0897f734e424a9dbbda87f9c0d6f2/roles/af90c0d23a9b4deeae3b85f52bc98754 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:57:31.040198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d573b-3e77-46c8-b85b-73f9f5db8a93 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:31.040687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d573b-3e77-46c8-b85b-73f9f5db8a93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:31.040687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d573b-3e77-46c8-b85b-73f9f5db8a93 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:31.042131 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 405/811] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:31.047098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:31.047521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:31.047626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:31.065357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:31.066520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:31.131194 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 407/812] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:31.397973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d573b-3e77-46c8-b85b-73f9f5db8a93 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:31.416674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:31.496702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d573b-3e77-46c8-b85b-73f9f5db8a93 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:31.529990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:31.530602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:31.530901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:31.531167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:31.540916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:31.546172 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:31.547185 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:31.548042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 406/813] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:31.553338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:31.599116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:31.659619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f4cb-7d4e-4281-9232-0332e9c3fd5a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:31.692737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:31.693334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:31.693614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:31.693884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:31.694536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:31.694864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:31.696218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:31.704026 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 408/814] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:31.709842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:31.795660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:31.820618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abd11b-400a-4e4e-a2f1-98fba40bf629 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:31.857115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:31.857744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:31.858019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:31.858285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] PATH_INFO: `/v3/users/5c06e87cefa54900a5e885de018a4275` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:31.872547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5c06e87cefa54900a5e885de018a4275)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:31.874006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:31.875672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 407/815] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:31 2022] GET /identity/v3/users/5c06e87cefa54900a5e885de018a4275 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:31.881534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:31.986837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca297a-f886-4b5a-a0a5-e2d7c7db836e None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:31.995855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:32.021387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:32.022012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.022286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.022554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.023688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] RBAC: Authorizing `identity:get_project(project_id=10be2d35381844cea5cd7d9040572c5a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:32.025119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c64e9-02f2-4177-85fc-25810aaf28e4 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:32.032293 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 409/816] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:31 2022] GET /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:32.034531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:32.039104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0102d4-d930-4e8c-86c1-0e138398d783 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.039426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0102d4-d930-4e8c-86c1-0e138398d783 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.039656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0102d4-d930-4e8c-86c1-0e138398d783 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.041154 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 410/817] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:32.046340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.046642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.046928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.066406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:32.068480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:32.134317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ac18d-cada-49a0-8ef7-4929006d29d6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:32.144095 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 411/818] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:32.169997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:32.170674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.170954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.171224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a/users/5c06e87cefa54900a5e885de018a4275/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.173086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=10be2d35381844cea5cd7d9040572c5a, user_id=5c06e87cefa54900a5e885de018a4275, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:32.174500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:32.176701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:32.251922 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 408/819] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:57:32 2022] PUT /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a/users/5c06e87cefa54900a5e885de018a4275/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:57:32.433610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:32.541371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693d2ed-effe-4505-8190-4b363e4fe12f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:32.549530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:32.578009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:32.578659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.578943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.579212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.589204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:32.594488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:32.595634 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 13:57:32.596758 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:32.598760 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 412/820] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Oct 31 13:57:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:32.601669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:32.699738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95e563-1011-43b8-a522-96e5a753fcb6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:32.736453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:32.737058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.737334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.737601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.738255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:32.738561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:32.739936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:32.748540 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 409/821] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Oct 31 13:57:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:32.754131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:32.852931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf57d-9a26-4456-bfb6-cd30f6fc163d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:32.886377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:32.887030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:32.887308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:32.887578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:32.898953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:32.900419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:32.914312 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:32.915348 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:32.916626 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:32.916626 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:32.916626 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:32.916626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 413/822] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:32.921214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:32.976403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:33.020029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c38189-bc3d-4899-a6e4-47224cf63702 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.052503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.053098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.053377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.053648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.054286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:33.054590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.055967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:33.067745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 410/823] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:33.073340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:33.093084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:33.175694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca342c2-a31e-4d95-8463-5602536f35ec None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.208903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.209515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.209791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.210058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.217226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.218696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:57:33.229583 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:33.230493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:33.231435 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 414/824] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Oct 31 13:57:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:33.236548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:33.333580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da918b1-61ba-48a5-ac45-a824e6551639 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.349566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:33.367732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.368387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.368667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.368937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.369650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:33.369953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.371395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:33.391129 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 411/825] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Oct 31 13:57:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:33.398101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:33.477115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:33.498553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471ef2-c5f8-443c-9111-1db83f7edc3c None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.531449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.532167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.532444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.532712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.597515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.599000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:33.672563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:33.693437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 415/826] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:57:33.699179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:33.797385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd664e4e-c55b-4e1e-acad-26a054dbb98c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.830242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.830882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.831155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.831420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.841049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.843036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:57:33.857101 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:33.858815 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:57:33.859707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:57:33.859707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:57:33.859707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:33.859707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 412/827] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:33.864623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:33.960183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1a0a1-781d-4c56-9867-46c51f81f4ee None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:33.993789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:33.994391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:33.994689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:33.994961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:33.995583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:33.995879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:33.997256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:34.008220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 416/828] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:34.014677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:34.041857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:34.112559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a77a2c-1781-4660-b401-c26fc0311c5c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:34.145525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:34.146140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.146414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.146715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.153066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:34.155122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:57:34.165826 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:34.166724 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:57:34.167593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:34.170750 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 413/829] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 13:57:34.172895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:34.211824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:34.273920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051eea4-3222-4185-b2df-8995552b4135 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:34.309671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:34.310266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.310583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.310881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.311561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:34.311862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:34.313276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc9d0d-ff6c-466b-bf1b-29c5dca0fc09 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:34.325071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 417/830] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:34.331872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:34.379382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec69a-0316-4822-a9ba-34ce5782c397 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.379703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec69a-0316-4822-a9ba-34ce5782c397 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.379941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec69a-0316-4822-a9ba-34ce5782c397 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.381268 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 418/831] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 13:57:34.386043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c28c-f828-4828-ad64-934040057094 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.386321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c28c-f828-4828-ad64-934040057094 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.386590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464c28c-f828-4828-ad64-934040057094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.405837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f464c28c-f828-4828-ad64-934040057094 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:34.407072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f464c28c-f828-4828-ad64-934040057094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:34.414731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:34.429131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5e2a-0422-45e1-8263-ef2f33337d48 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:34.463091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:34.463681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.463955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.464221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.464920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] RBAC: Adding query filter params (role.id=af90c0d23a9b4deeae3b85f52bc98754, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=7cf0897f734e424a9dbbda87f9c0d6f2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:34.465223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:34.466682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:34.472641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 414/832] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:34 2022] GET /identity/v3/role_assignments?user.id=7cf0897f734e424a9dbbda87f9c0d6f2&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=af90c0d23a9b4deeae3b85f52bc98754 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:34.477076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 419/833] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:34.744981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:34.846257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d0554-4ade-4374-8c46-75f121e4feac None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:34.881335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:34.881963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:34.882240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:34.882515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:34.893883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:34.898736 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:34.899674 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:34.900507 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 415/834] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:34.906143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464c28c-f828-4828-ad64-934040057094 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:34.936671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:35.008886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464c28c-f828-4828-ad64-934040057094 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:35.042950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:35.043553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:35.043827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:35.044091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:35.045250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:35.045543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:35.046937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:35.055124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 420/835] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:35.061213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:35.074517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:35.163420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffad75-7313-4e04-9c9f-7f0f0cc2e22f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:35.198358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:35.199015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:35.199293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:35.199562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] PATH_INFO: `/v3/users/5c06e87cefa54900a5e885de018a4275` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:35.200678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] RBAC: Authorizing `identity:get_user(user_id=5c06e87cefa54900a5e885de018a4275)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:35.202089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:35.203871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 416/836] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:35 2022] GET /identity/v3/users/5c06e87cefa54900a5e885de018a4275 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:35.209512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:35.303882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:35.314276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb833e9-5650-4e82-8ea1-671cbbc147b3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:35.348303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:35.348901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:35.349177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:35.349445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:35.421465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:35.422948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:35.508665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:35.519230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 421/837] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:57:35.525259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:35.601310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:35.621501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46799d-7a58-41de-aff2-4600db6efc1c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:35.656048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:35.656650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:35.656926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:35.657192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:35.658282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] RBAC: Authorizing `identity:get_project(project_id=10be2d35381844cea5cd7d9040572c5a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:35.659724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a030c8-2a01-4454-ac87-c696c04eea33 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:35.661309 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 417/838] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:35 2022] GET /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:35.667304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:35.765715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a4d3-e13b-4813-b2e6-3a322e1073cc None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:35.798756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:35.799341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:35.799620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:35.799889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:35.800598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=10be2d35381844cea5cd7d9040572c5a, user.id=5c06e87cefa54900a5e885de018a4275) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:35.800902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:35.802310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8ad5-0069-4392-b4d2-109556b904da None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:35.807916 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 422/839] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:35 2022] GET /identity/v3/role_assignments?user.id=5c06e87cefa54900a5e885de018a4275&scope.project.id=10be2d35381844cea5cd7d9040572c5a&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:37.924448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c62131-ef8f-4b38-ba98-51a8e936b0a8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:37.924968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c62131-ef8f-4b38-ba98-51a8e936b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:37.924968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c62131-ef8f-4b38-ba98-51a8e936b0a8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:37.926288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 418/840] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:37.931447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:37.931835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:37.932020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:37.950203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:37.951413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:37.998663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:38.015211 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 423/841] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:38.287078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c62131-ef8f-4b38-ba98-51a8e936b0a8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:38.382755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c62131-ef8f-4b38-ba98-51a8e936b0a8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:38.414806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:38.415400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:38.415671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:38.415933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:38.417007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:38.418398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953c398-0e7b-43c6-a635-32d7ab9c1f32 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:38.420549 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 419/842] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:38.426299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:38.521157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76478301-3d5f-4d70-80a0-f839f1def9c3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:38.553911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:38.554435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:38.554737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:38.555005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:38.555646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:38.557056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5826781-249d-41e4-a073-cb2e42f38c0c None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:38.667372 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 424/843] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:57:38 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:40.834581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ee7a-fa58-420d-b545-a768acc89b8f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:40.835146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ee7a-fa58-420d-b545-a768acc89b8f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:40.835146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ee7a-fa58-420d-b545-a768acc89b8f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:40.836476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 420/844] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:40.841588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:40.841953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:40.842134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:40.860394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:40.861572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:40.895682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:40.927675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 425/845] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:41.195507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3ee7a-fa58-420d-b545-a768acc89b8f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:41.211323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:41.292463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3ee7a-fa58-420d-b545-a768acc89b8f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:41.324398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:41.325000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:41.325277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:41.325546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] PATH_INFO: `/v3/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:41.327495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] RBAC: Authorizing `identity:get_role(role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:41.328843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:41.330122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 421/846] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:41 2022] GET /identity/v3/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:41.335771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:41.432191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50e1ed-44a4-49f8-9227-fe44ab94518a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:41.468380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:41.468928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:41.469208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:41.469476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] PATH_INFO: `/v3/users/7cf6ff2e505c45df8261ed50c8d751eb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:41.481920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf6ff2e505c45df8261ed50c8d751eb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:41.483416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:41.484979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 426/847] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:41 2022] GET /identity/v3/users/7cf6ff2e505c45df8261ed50c8d751eb => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:41.490818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:41.569529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:41.586296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec83f-6bc9-4c71-8e24-3359199cd49e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:41.618768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:41.619375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:41.619650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:41.619919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:41.621008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] RBAC: Authorizing `identity:get_project(project_id=10be2d35381844cea5cd7d9040572c5a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:41.622470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9747ca-356f-426f-989a-9db0c58fa76a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:41.624616 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 422/848] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:41 2022] GET /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:41.630566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:41.658113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:41.726774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c1ee-df86-4dca-b8bc-6b1db4978882 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:41.759975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:41.760611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:41.760885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:41.761151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a/users/7cf6ff2e505c45df8261ed50c8d751eb/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:41.763532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=10be2d35381844cea5cd7d9040572c5a, user_id=7cf6ff2e505c45df8261ed50c8d751eb, role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:41.764945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1aaa-7421-40cc-a98b-31e8278f1c31 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:41.838722 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 427/849] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:57:41 2022] PUT /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a/users/7cf6ff2e505c45df8261ed50c8d751eb/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:57:43.930923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074643-80f0-419d-b83d-dea6cd1cea90 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:43.931446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074643-80f0-419d-b83d-dea6cd1cea90 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:43.931446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074643-80f0-419d-b83d-dea6cd1cea90 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:43.932785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 423/850] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:43.938761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:43.939155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:43.939297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:43.956831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:43.957980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:44.021534 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 428/851] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:44.287592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074643-80f0-419d-b83d-dea6cd1cea90 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:44.383937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074643-80f0-419d-b83d-dea6cd1cea90 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:44.416789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:44.417391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:44.417663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:44.417929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] PATH_INFO: `/v3/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:44.419331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] RBAC: Authorizing `identity:get_role(role_id=a4e05b78a86c4e08bc3f343cdf2ef6a9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:44.421291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:44.422572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 424/852] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:44 2022] GET /identity/v3/roles/a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:44.428183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:44.446075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:44.524515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4d19-595c-4723-92e1-d0c6e0f3decf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:44.557208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:44.557761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:44.558035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:44.558302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] PATH_INFO: `/v3/users/7cf6ff2e505c45df8261ed50c8d751eb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:44.559419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf6ff2e505c45df8261ed50c8d751eb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:44.560893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:44.562421 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 429/853] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:44 2022] GET /identity/v3/users/7cf6ff2e505c45df8261ed50c8d751eb => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:44.567987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:44.586491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:44.663573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfff10-5bdd-4d00-8dac-021f60ee8c7a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:44.694852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:44.695428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:44.695703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:44.695969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:44.759269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:44.760678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:44.777763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:44.854066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 425/854] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:57:44.859874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:44.941176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:44.955982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9235-66d5-4475-bde1-1f5497d6d154 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:44.987883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:44.988495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:44.988768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:44.989036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] PATH_INFO: `/v3/projects/10be2d35381844cea5cd7d9040572c5a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:44.990124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] RBAC: Authorizing `identity:get_project(project_id=10be2d35381844cea5cd7d9040572c5a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:44.991570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1133b-81a4-4a52-9682-4eb70011024a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:44.993161 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 430/855] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:44 2022] GET /identity/v3/projects/10be2d35381844cea5cd7d9040572c5a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:44.999679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:45.093477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d487af-0487-407d-823b-f8490ea1e9aa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:45.109716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:45.125978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:45.126566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:45.126877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:45.131911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:45.131911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] RBAC: Adding query filter params (role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9, scope.project.id=10be2d35381844cea5cd7d9040572c5a, user.id=7cf6ff2e505c45df8261ed50c8d751eb) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:45.131911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:45.131911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa0633-34ef-4c26-9564-3c16b9279548 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:45.135145 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 426/856] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:44 2022] GET /identity/v3/role_assignments?user.id=7cf6ff2e505c45df8261ed50c8d751eb&scope.project.id=10be2d35381844cea5cd7d9040572c5a&role.id=a4e05b78a86c4e08bc3f343cdf2ef6a9 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:47.261050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a85-e300-4ceb-b4c6-b03cb88e4b9a None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:47.261583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a85-e300-4ceb-b4c6-b03cb88e4b9a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:47.261583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a85-e300-4ceb-b4c6-b03cb88e4b9a None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:47.262945 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 431/857] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:47.268897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:47.269302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:47.269432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:47.287221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:47.288414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:47.352064 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 427/858] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:47.621180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973a85-e300-4ceb-b4c6-b03cb88e4b9a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:47.720231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973a85-e300-4ceb-b4c6-b03cb88e4b9a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:47.753447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:47.754056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:47.754331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:47.754598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:47.755716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:47.757133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a264-ceed-45e9-99f4-5af590066377 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:47.758694 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 432/859] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:47.764684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:47.858196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefc8d-4968-471e-96d9-4ad44443039e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:47.870675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:47.891173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:47.891761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:47.892035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:47.892301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:47.892939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:47.894342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a8f0-c991-4c77-879e-0acd9a43efd9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:48.028152 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 428/860] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:57:47 2022] POST /identity/v3/projects => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:50.199842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cba35-dbbf-4254-9527-67682b3aac97 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:50.200365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cba35-dbbf-4254-9527-67682b3aac97 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:50.200365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cba35-dbbf-4254-9527-67682b3aac97 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:50.201753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 433/861] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:50.207039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:50.207443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:50.207590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:50.225777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:50.226982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:50.291176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 429/862] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:57:50.562948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cba35-dbbf-4254-9527-67682b3aac97 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:50.586932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:50.662102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cba35-dbbf-4254-9527-67682b3aac97 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:50.693857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:50.694462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:50.694766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:50.695037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:50.696118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:50.697537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77ad6-4283-4fe3-829c-20fde8730d62 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:50.699085 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 434/863] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:50.705403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:50.794011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:50.800443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb898-19e1-47c1-ab3e-5f1d540cb619 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:50.832530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:50.833065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:50.833340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:50.833605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:50.834236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:50.835675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26d63c-208e-45d1-844b-00ea816a99cb None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:50.924405 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 430/864] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:57:50 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:57:53.092567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5a3a-2c04-4b28-a8bf-5b7d7bb61624 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:53.093160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5a3a-2c04-4b28-a8bf-5b7d7bb61624 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:53.093160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c5a3a-2c04-4b28-a8bf-5b7d7bb61624 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:53.094345 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 435/865] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:53.099585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:53.100015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:53.100114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:53.117785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:53.119004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:53.183048 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 431/866] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:53.453684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5a3a-2c04-4b28-a8bf-5b7d7bb61624 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:53.544905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:53.555039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c5a3a-2c04-4b28-a8bf-5b7d7bb61624 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:53.588462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:53.589071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:53.589345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:53.589611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:53.600071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:53.604785 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:53.605889 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:57:53.607074 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 436/867] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:53.612068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:53.688392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:53.706686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9edb0-94d6-497a-8fee-6d5686b11fca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:53.739832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:53.740426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:53.740706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:53.740980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:53.741818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:53.742335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:53.744162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:53.752019 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 432/868] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:53.757788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:53.852971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251c7e2-fa4f-4ef7-a9d4-2c3bcc191a00 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:53.883963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:53.884559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:53.884831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:53.885092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] PATH_INFO: `/v3/users/78707bcb02374ea0ae28d4772a4cc572` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:53.898141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] RBAC: Authorizing `identity:get_user(user_id=78707bcb02374ea0ae28d4772a4cc572)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:53.899596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:53.901119 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:53 2022] GET /identity/v3/users/78707bcb02374ea0ae28d4772a4cc572 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:53.907323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:54.001564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a344b-b600-4b67-abc6-5123443196b8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:54.033219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:54.033817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:54.034090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:54.034356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] PATH_INFO: `/v3/projects/f289b44588024c23a7662d910df2f03e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:54.035452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] RBAC: Authorizing `identity:get_project(project_id=f289b44588024c23a7662d910df2f03e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:54.036878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5b183-07e2-4776-b706-6dfe19b5d736 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:54.038437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 433/870] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:53 2022] GET /identity/v3/projects/f289b44588024c23a7662d910df2f03e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:54.044302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:54.054882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:54.141541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4cc8-3443-4dea-8842-fc172f5491bd None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:54.173446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:54.174079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:54.174354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:54.174646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] PATH_INFO: `/v3/projects/f289b44588024c23a7662d910df2f03e/users/78707bcb02374ea0ae28d4772a4cc572/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:54.176499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=f289b44588024c23a7662d910df2f03e, user_id=78707bcb02374ea0ae28d4772a4cc572, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:54.177908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfa58b-de2d-403d-9837-478dc7db2f96 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:54.273044 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 438/871] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:57:54 2022] PUT /identity/v3/projects/f289b44588024c23a7662d910df2f03e/users/78707bcb02374ea0ae28d4772a4cc572/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:57:56.379193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fda84-867a-43de-a261-b413510b61bf None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:56.379775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fda84-867a-43de-a261-b413510b61bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:56.379775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fda84-867a-43de-a261-b413510b61bf None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:56.381053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 434/872] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:57:56.386217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:56.386686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:56.386785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:56.405300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:57:56.406478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:57:56.466758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:56.472092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 439/873] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:57:56.742308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fda84-867a-43de-a261-b413510b61bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:56.755502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:56.840277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fda84-867a-43de-a261-b413510b61bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:56.872309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:56.873455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:56.873728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:56.873994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:56.883613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:57:56.888388 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:57:56.889739 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:57:56.890707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 435/874] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:57:56.895679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:57.103111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1711f40-c739-4868-9b2d-eac7b5238d2b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:57.135393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:57.135980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:57.136256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:57.136523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:57.137196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:57.137473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:57.139110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:57.146791 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 440/875] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:57:57.152817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:57.220656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:57.249825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f7efe-820e-4a49-b42f-6feb85938b28 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:57.283441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:57.284050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:57.284324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:57.284619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] PATH_INFO: `/v3/users/78707bcb02374ea0ae28d4772a4cc572` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:57.285713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] RBAC: Authorizing `identity:get_user(user_id=78707bcb02374ea0ae28d4772a4cc572)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:57.287166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:57.288715 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:57:57 2022] GET /identity/v3/users/78707bcb02374ea0ae28d4772a4cc572 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:57.294283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:57.351326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:57.390466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493c4b7-4e0a-4ceb-a7c1-16339999e7f6 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:57.422390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:57.423025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:57.423300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:57.423567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:57.487712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:57.490318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:57.546216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:57:57.585186 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 441/877] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:57:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:57:57.591091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:57.686272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30ea23-4706-4e55-8e19-a359c933943e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:57.718318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:57.718969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:57.719240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:57.719505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] PATH_INFO: `/v3/projects/f289b44588024c23a7662d910df2f03e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:57.720581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f289b44588024c23a7662d910df2f03e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:57.721982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de275704-37f6-4545-8480-39675245f0b5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:57.723679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 437/878] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:57:57 2022] GET /identity/v3/projects/f289b44588024c23a7662d910df2f03e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:57.729845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:57:57.824352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba5a1b-67ba-42aa-b7e7-5036362dfe73 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:57:57.857288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:57:57.857871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:57.858145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:57.858415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:57.859153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=f289b44588024c23a7662d910df2f03e, user.id=78707bcb02374ea0ae28d4772a4cc572) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:57:57.859459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:57:57.860880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea2d3c-434b-4c57-9a70-7f4e2925ac9b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:57:57.866540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 442/879] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:57:57 2022] GET /identity/v3/role_assignments?user.id=78707bcb02374ea0ae28d4772a4cc572&scope.project.id=f289b44588024c23a7662d910df2f03e&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:57:59.993066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05546386-939d-4aee-be33-f60b7c420372 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:57:59.993572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05546386-939d-4aee-be33-f60b7c420372 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:57:59.993572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05546386-939d-4aee-be33-f60b7c420372 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:57:59.994909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 438/880] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:58:00.000016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58979-bb18-4144-acbc-0abf6b4854e2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:00.000435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58979-bb18-4144-acbc-0abf6b4854e2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:00.000561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b58979-bb18-4144-acbc-0abf6b4854e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:00.018378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-89b58979-bb18-4144-acbc-0abf6b4854e2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:58:00.019590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-89b58979-bb18-4144-acbc-0abf6b4854e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:58:00.036540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:00.083759 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 443/881] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:58:00.350284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05546386-939d-4aee-be33-f60b7c420372 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:00.359042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:00.447196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05546386-939d-4aee-be33-f60b7c420372 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:00.479717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:00.480297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:00.480579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:00.480846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:00.481500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:00.482874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e210-8ab3-4607-802e-fa6c669fd791 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:00.565919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 439/882] 10.222.0.13 () {60 vars in 1138 bytes} [Mon Oct 31 13:58:00 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:58:02.704653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f492c-1000-4b66-9dbc-d3d258a7fea2 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:02.705203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f492c-1000-4b66-9dbc-d3d258a7fea2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:02.705203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f492c-1000-4b66-9dbc-d3d258a7fea2 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:02.706557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 444/883] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:58:02.711821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:02.712270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:02.712374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:02.730572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:58:02.731792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:58:02.787789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:02.794804 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 440/884] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:58:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:58:03.059263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f492c-1000-4b66-9dbc-d3d258a7fea2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:03.157528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f492c-1000-4b66-9dbc-d3d258a7fea2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:03.189851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:03.190461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:03.190765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:03.191030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] PATH_INFO: `/v3/domains/0de88fcba3c34d119c48191ebab50e2b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:03.201694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=0de88fcba3c34d119c48191ebab50e2b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:03.203144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f1ee9-2c61-4a25-9d9c-5da4d18918eb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:03.204668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 445/885] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Oct 31 13:58:03 2022] GET /identity/v3/domains/0de88fcba3c34d119c48191ebab50e2b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:03.210543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:03.303989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20961b57-25bc-4b7d-a08a-9b19e9c3bab3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:03.336175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:03.336707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:03.336982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:03.337258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:03.337898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:03.339333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9dd2f-2b5e-4563-bb4b-624603cffe34 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:03.417760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 441/886] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:58:03 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:58:05.552954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e8b6-15ec-45a4-9a9c-a180ed59be9c None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:05.553482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e8b6-15ec-45a4-9a9c-a180ed59be9c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:05.553482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e8b6-15ec-45a4-9a9c-a180ed59be9c None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:05.554835 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 446/887] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:58:05.560061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:05.560473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:05.560600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:05.578625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:58:05.579814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:58:05.621120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:05.643200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 442/888] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:58:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:58:05.909301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964e8b6-15ec-45a4-9a9c-a180ed59be9c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:05.925081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:06.007877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964e8b6-15ec-45a4-9a9c-a180ed59be9c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:06.040126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:06.040735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:06.041012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:06.041283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] PATH_INFO: `/v3/domains/0de88fcba3c34d119c48191ebab50e2b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:06.042376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0de88fcba3c34d119c48191ebab50e2b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:06.043837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d6d1-804a-4ed9-9092-1afcf7c9eb80 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:06.045364 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 447/889] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Oct 31 13:58:05 2022] GET /identity/v3/domains/0de88fcba3c34d119c48191ebab50e2b => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:06.051117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:06.144633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98cee0-d147-45fc-a324-0d1c1cb9e833 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:06.175954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:06.176476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:06.176750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:06.177015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:06.177652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:06.179082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc3e50-1dbc-411a-b8ad-0308d74962b4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:06.261739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 443/890] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:58:06 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:58:08.409060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc7c-ed9c-46b1-8df0-40f1e3b632bf None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:08.409618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc7c-ed9c-46b1-8df0-40f1e3b632bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:08.409618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc7c-ed9c-46b1-8df0-40f1e3b632bf None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:08.410965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 448/891] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:58:08.416175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:08.416600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:08.416718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:08.434287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:58:08.436013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:58:08.461612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:08.499452 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 444/892] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:58:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:58:08.769929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41dc7c-ed9c-46b1-8df0-40f1e3b632bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:08.850576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:08.868697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41dc7c-ed9c-46b1-8df0-40f1e3b632bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:08.901459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:08.902068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:08.902345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:08.902641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:08.913382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:58:08.918161 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:58:08.919225 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:58:08.920302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 449/893] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:58:08.925166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:09.019498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0181d5-8b21-41b0-b9da-09c2c699ccb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:09.051040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:09.051626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:09.051904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:09.052179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:09.052825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:58:09.053128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:09.054472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:09.062600 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 445/894] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:09.068087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:09.164214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a1830-a7f7-4bc2-88ea-d02870b826fa None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:09.196599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:09.197209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:09.197483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:09.197751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] PATH_INFO: `/v3/users/9a12b52904de480197b7a017bd62b9dc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:09.208816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:09.211067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] RBAC: Authorizing `identity:get_user(user_id=9a12b52904de480197b7a017bd62b9dc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:09.212483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:09.214071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 450/895] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:58:09 2022] GET /identity/v3/users/9a12b52904de480197b7a017bd62b9dc => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:09.219650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:09.246176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:09.315828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4916-828c-4d58-a5ec-8969ce2cf454 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:09.347410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:09.348016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:09.348292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:09.348564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] PATH_INFO: `/v3/projects/8f53434ac58b41359c70e36eaa3b97e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:09.349659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] RBAC: Authorizing `identity:get_project(project_id=8f53434ac58b41359c70e36eaa3b97e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:09.351098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b90fe-4c7d-4a56-80cb-bc8750a8ef97 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:09.352684 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 446/896] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:58:09 2022] GET /identity/v3/projects/8f53434ac58b41359c70e36eaa3b97e5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:09.359243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:09.455216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eebc54-40ea-405b-8785-b88c9d696fbe None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:09.487790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:09.488423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:09.488700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:09.488972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] PATH_INFO: `/v3/projects/8f53434ac58b41359c70e36eaa3b97e5/users/9a12b52904de480197b7a017bd62b9dc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:09.490857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f53434ac58b41359c70e36eaa3b97e5, user_id=9a12b52904de480197b7a017bd62b9dc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:09.492270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a17ea-7973-4474-9d4a-750162b01774 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:09.565296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 451/897] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:58:09 2022] PUT /identity/v3/projects/8f53434ac58b41359c70e36eaa3b97e5/users/9a12b52904de480197b7a017bd62b9dc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:58:11.661206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8c2c-8309-4d0f-90b7-3dba86fadb2e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:11.661761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8c2c-8309-4d0f-90b7-3dba86fadb2e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:11.661761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8c2c-8309-4d0f-90b7-3dba86fadb2e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:11.663117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 447/898] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:58:11.668201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:11.668582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:11.668740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:11.686976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:58:11.688129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:58:11.741831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:11.752542 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 452/899] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:58:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:58:12.022470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e8c2c-8309-4d0f-90b7-3dba86fadb2e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.111909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:12.119170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e8c2c-8309-4d0f-90b7-3dba86fadb2e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:12.152502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:12.153109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:12.153386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:12.153652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:12.163305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:58:12.167996 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:58:12.169069 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:58:12.170347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 448/900] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:58:12.175147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.271412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c69fa-c281-4d21-b8ae-ed588904a962 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:12.303977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:12.304511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:12.304788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:12.305057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:12.305704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:58:12.306003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:12.307395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:12.315668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 453/901] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:12.321717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.418384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886813b7-7fdd-43f6-af92-f74672cd3bff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:12.451396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:12.452006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:12.452281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:12.452578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] PATH_INFO: `/v3/users/9a12b52904de480197b7a017bd62b9dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:12.453671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] RBAC: Authorizing `identity:get_user(user_id=9a12b52904de480197b7a017bd62b9dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:12.455116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:12.456669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 449/902] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/users/9a12b52904de480197b7a017bd62b9dc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:58:12.462410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.513966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:12.560718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8d298-bc5f-4faa-b02d-6fd0e527543e None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:12.592561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:12.593142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:12.593419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:12.593690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:12.659008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:12.660432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:12.710386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:12.757574 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 454/903] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:58:12.764092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.788021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:12.860812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363f9f-52d2-4622-a481-4b9ba92d0104 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:12.892718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:12.893322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:12.893604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:12.893873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] PATH_INFO: `/v3/projects/8f53434ac58b41359c70e36eaa3b97e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:12.894986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] RBAC: Authorizing `identity:get_project(project_id=8f53434ac58b41359c70e36eaa3b97e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:12.896394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5432e2e-34b5-4097-bf77-11e836eb74cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:12.897980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 450/904] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/projects/8f53434ac58b41359c70e36eaa3b97e5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:12.904460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:58:12.999616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328444a4-dfd7-4c8f-bf0c-45be4710220b None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:58:13.032630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:58:13.033206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:58:13.033477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:58:13.033744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:58:13.034440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=8f53434ac58b41359c70e36eaa3b97e5, user.id=9a12b52904de480197b7a017bd62b9dc) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:58:13.034770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:58:13.036168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b743-0006-4638-af61-0a7cfc7d336f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:58:13.041606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 455/905] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:58:12 2022] GET /identity/v3/role_assignments?user.id=9a12b52904de480197b7a017bd62b9dc&scope.project.id=8f53434ac58b41359c70e36eaa3b97e5&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:58:22.888460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=55 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:58:23.039211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:25.248163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a7ee-ef74-452e-addb-f075bde07500 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:25.248794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a7ee-ef74-452e-addb-f075bde07500 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:25.248794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1a7ee-ef74-452e-addb-f075bde07500 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:25.250011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 451/906] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:25.255893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:25.258605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:25.258605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:25.274705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:25.275878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:25.341263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 456/907] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:59:25.608035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a7ee-ef74-452e-addb-f075bde07500 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:25.710888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1a7ee-ef74-452e-addb-f075bde07500 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:25.744488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:25.745093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:25.745367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:25.745633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:25.755378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:25.756897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:25.771856 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:25.773029 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:25.774171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:25.774171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:25.774171 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:25.774171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 452/908] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:25.779159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:25.876927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edffe-5894-4b22-beaf-1dc86d97f9bd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:25.904859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:25.911085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:25.911680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:25.911955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:25.912220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:25.912846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:25.913141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:25.914495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58973-b81d-4521-80c4-584b6fb391d9 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:25.925209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 457/909] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:25.931217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:25.982492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:26.027434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b05a-f85b-4318-b156-253488350388 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:26.060471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:26.061059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:26.061335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:26.061605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:26.062234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:26.063678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca732cd1-da28-44c1-bc09-df8f345ddb8e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:26.137916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 453/910] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Oct 31 13:59:25 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:59:28.290431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abc1a-c328-46d0-bb2e-3c6228ebc0ff None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:28.291028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abc1a-c328-46d0-bb2e-3c6228ebc0ff None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:28.291028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abc1a-c328-46d0-bb2e-3c6228ebc0ff None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:28.292335 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 458/911] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:28.297439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:28.297863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:28.298084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:28.316845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:28.318028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:28.383746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 454/912] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:28.657364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331abc1a-c328-46d0-bb2e-3c6228ebc0ff None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:28.758227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331abc1a-c328-46d0-bb2e-3c6228ebc0ff None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:28.791633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:28.792243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:28.792512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:28.792777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:28.803264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:59:28.808048 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:28.809118 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:28.809942 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 459/913] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:28.815468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:28.854887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:28.912667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80677-8f45-4622-bf53-360337eaad53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:28.944808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:28.945399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:28.945677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:28.945945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:28.946592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:28.946922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:28.948272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:28.956420 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 455/914] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:28.962297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.011618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:29.060728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05985-ca27-4119-9266-c2eba0549c4f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.094999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.095614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.095889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.096155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.106265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.107726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:29.121695 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:29.122650 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:29.123855 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:29.123855 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:29.123855 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:29.123855 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 460/915] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:29.129112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.224175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:29.226925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d58ab-0802-4e84-8200-f008f741497d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.259523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.260125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.260394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.260657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.261280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:29.261620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.262994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.275260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 456/916] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:29.281007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.379124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987666-6966-4506-8f6d-14c5199486d5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.380640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:29.413062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.413671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.413941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.414206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.421424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.422945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:59:29.434386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:29.435597 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:29.436910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 461/917] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:29.442180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.539449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009553df-61c7-4e26-a2af-3fc2abe48738 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.571840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.572419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.572692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.572956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.573652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:29.573950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.575383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.591682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 457/918] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:29.597574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.698269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3482-1415-4e28-ae95-fd1d4d90a375 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.731211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.735876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.735876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.735876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.743090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.744518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:29.758920 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:29.760779 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:29.761879 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:29.761879 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:29.761879 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:29.761879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 462/919] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:29.765734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.784791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:29.861670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9aac-e8db-4c67-87cf-65d243f0d685 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:29.895248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:29.895847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:29.896340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:29.896654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:29.897937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:29.898235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:29.899674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:29.911808 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 458/920] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:29.917732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:29.934574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:30.015540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44416778-ce0e-42f6-a007-4560438fa708 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:30.048052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:30.048656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:30.048924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:30.049185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:30.055548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:30.056970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:59:30.068291 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:30.069448 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:30.070481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 463/921] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:30.075286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:30.153814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:30.174416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9592dd-399b-4ae3-9d7f-eebe0e2d3b1c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:30.207378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:30.207972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:30.208248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:30.208517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:30.209191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:30.209490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:30.210936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef5ff-b477-489c-96db-e5be897cc698 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:30.223317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 459/922] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:30.229030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:30.304594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:30.328762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c4b6e-9c90-4767-94b5-95af0f51bb07 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:30.360655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:30.361286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:30.361559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:30.361823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/93e90dc19f58488387296c15062dcb20/roles/d69f0aab14f54dc080b913f7a5296d0d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:30.377141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=93e90dc19f58488387296c15062dcb20, role_id=d69f0aab14f54dc080b913f7a5296d0d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:30.379213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fb0ea-41cf-4858-b399-a056235d91dd None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:30.452711 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 464/923] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:59:30 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/93e90dc19f58488387296c15062dcb20/roles/d69f0aab14f54dc080b913f7a5296d0d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:59:32.592255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a409f8-9513-4794-a5e3-5f33cfff3039 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:32.592794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a409f8-9513-4794-a5e3-5f33cfff3039 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:32.592794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a409f8-9513-4794-a5e3-5f33cfff3039 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:32.594216 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 460/924] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:32.599927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:32.600478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:32.600478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:32.617996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:32.619185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:32.683421 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 465/925] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:32.953497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a409f8-9513-4794-a5e3-5f33cfff3039 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.052974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a409f8-9513-4794-a5e3-5f33cfff3039 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.086092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.086731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.087009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.087288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.093700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:33.097540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:59:33.102382 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:33.108065 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:33.109086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 461/926] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Oct 31 13:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:33.109927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.163243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:33.205715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be960c1-9a80-4e28-8266-31bfd0915470 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.239720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.240331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.240606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.240908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.241550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:33.241848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:33.243229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:33.250773 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 466/927] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:59:33.257230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.353624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9da93-e5b3-4a38-9c9e-8c74b0df631f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.386473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.387107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.387377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.387646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.397727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:33.399198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:33.413477 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:33.414593 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:33.415700 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:33.415700 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:33.415700 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:33.415700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 462/928] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:33.420432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.518905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072beea-aa36-48e9-8bde-db5e9fa967a0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.535013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:33.552886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.553470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.553742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.554007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.554822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:33.555134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:33.556463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:33.567777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 467/929] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:33.573498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.623290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:33.670564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ca9f3-e609-4bc6-9943-a7d238a667a5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.702437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.703169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.703461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.703937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.712116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:33.713543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:59:33.725121 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:33.726116 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:33.727490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 463/930] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:33.732067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.830692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03d4f-528d-475b-a420-7ef08fa5c3f0 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:33.874095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:33.874735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:33.875015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:33.875284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:33.876007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:33.876311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:33.877767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:33.895496 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 468/931] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:33.901419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:33.998822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28846-eda5-4887-a041-bd750952a291 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.008761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:34.031637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.032230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.032509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.032781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.098746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.100116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.193912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 464/932] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:59:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:59:34.199888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:34.237076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:34.303474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdfda0-6ead-4498-83f5-cb8ba41f2a68 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.337970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.338584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.338891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.339156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.348981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.350356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:34.364392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:34.365297 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:34.366215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:34.366215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:34.366215 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:34.366215 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 469/933] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:34.371344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:34.383389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:34.466859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b43d-48b5-4221-8170-056478ff4262 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.499362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.499949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.500220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.500483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.501100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:34.501393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.503304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.514000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 465/934] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:34.520506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:34.604369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:34.618624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c42d6-fca2-402b-89f2-43ff01668cb5 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.653010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.653625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.653899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.654164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.660624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.662049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:59:34.672941 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:34.673874 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:34.675469 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 470/935] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:34.680685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:34.749553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:34.779486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03f92-339b-490f-b039-9b164f7f4aa4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.811263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.811860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.812131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.812397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.813069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:34.813367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.814807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914aa1b-9495-42cb-bdf1-bcd1f3b8e970 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.827242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 466/936] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:34.833336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:34.929704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7dd4f-f244-4597-a99c-be3241e8463a None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:34.962475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:34.963068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:34.963341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:34.963606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:34.964306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] RBAC: Adding query filter params (role.id=d69f0aab14f54dc080b913f7a5296d0d, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=93e90dc19f58488387296c15062dcb20) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:34.964606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:34.966178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4a94d-fa99-40bc-9cd3-811e4cc9d0b0 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:34.971746 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 471/937] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:59:34 2022] GET /identity/v3/role_assignments?user.id=93e90dc19f58488387296c15062dcb20&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=d69f0aab14f54dc080b913f7a5296d0d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:37.167787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871030a8-5075-4cf1-ad9b-da9ddd9cdea9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:37.168336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871030a8-5075-4cf1-ad9b-da9ddd9cdea9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:37.168336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871030a8-5075-4cf1-ad9b-da9ddd9cdea9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:37.169641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 467/938] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:37.175088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:37.175489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:37.175623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:37.193206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:37.194380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:37.197213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:37.260247 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 472/939] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:37.535066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871030a8-5075-4cf1-ad9b-da9ddd9cdea9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:37.634271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871030a8-5075-4cf1-ad9b-da9ddd9cdea9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:37.662846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:37.668446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:37.669068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:37.669347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:37.669618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:37.679817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:59:37.684618 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:37.685636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:37.686962 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 468/940] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:37.692577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:37.789611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d09af-b7e4-48ea-a157-4375edaddc21 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:37.823049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:37.823640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:37.823937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:37.824203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:37.824874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:37.825166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:37.826546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:37.834507 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 473/941] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:37.840089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:37.944419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956706c-0535-482d-b37c-f8869d1cf7bc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:37.977716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:37.978338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:37.978642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:37.978974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:37.989096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:37.990515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:38.005107 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:38.006369 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:38.007271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:38.007271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:38.007271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:38.007271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 469/942] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:38.012198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.015014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:38.110040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7cf4-a1dd-447d-9ca9-469284d575e3 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.142025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.142608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.142908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.148280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.148280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:38.148280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.148280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.156954 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 474/943] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:38.163192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.205151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:38.259171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648966bd-5633-4da7-83e9-2d53e6f07f52 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.291207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.291854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.292473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.292898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.301912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.309330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:59:38.314373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:38.315562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:38.316690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 470/944] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:38.321369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.381579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:38.419573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f5f9-aac2-4bfc-a644-630fcf37085f None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.453666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.454254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.454528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.454823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.455533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:38.456393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.457876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.475006 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 475/945] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:38.480929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.577975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801cfe-b48c-4d91-bba4-86b510ddc5ba None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.579490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:38.611625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.612223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.612494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.612759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.622241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.623759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:38.638455 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:38.639586 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:38.640638 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:38.640638 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:38.640638 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:38.640638 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 471/946] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:38.645619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.743516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c0d4-8f67-4ec7-9ea2-8ccd24d054bb None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.763237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:38.777374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.778822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.778822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.778822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.779130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:38.779427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.780777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.791947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 476/947] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:38.797710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:38.893286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee539c-ce29-4b29-9087-e8df82aae389 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:38.925347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:38.925968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:38.926244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:38.926517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:38.933053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:38.934483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:59:38.945844 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:38.946895 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:38.947974 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 472/948] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:38.952767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:39.052716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7dc7b-acf9-42c7-a5e2-7e8faabef39d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:39.085589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:39.086180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:39.086456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:39.086756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:39.087434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:39.087735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:39.089220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f4a45-03d7-4f76-bf80-97e05bea1735 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:39.100723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 477/949] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:39.106899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:39.123145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:39.204046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1f2a9-11ef-4a28-b5ff-f7b23cc159e7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:39.236233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:39.236875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:39.237703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:39.237974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] PATH_INFO: `/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/93e90dc19f58488387296c15062dcb20/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:39.239846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] RBAC: Authorizing `identity:create_grant(project_id=029e4df755db486eae5e5c4db7643bf0, user_id=93e90dc19f58488387296c15062dcb20, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:39.241262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63bc5-4baf-4127-bf92-334b97b05680 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:39.304536 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 473/950] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Oct 31 13:59:39 2022] PUT /identity/v3/projects/029e4df755db486eae5e5c4db7643bf0/users/93e90dc19f58488387296c15062dcb20/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 13:59:41.436685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7265-19e9-443c-a1c1-f1f4efbe0743 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:41.437245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7265-19e9-443c-a1c1-f1f4efbe0743 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:41.437245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7265-19e9-443c-a1c1-f1f4efbe0743 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:41.438568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 478/951] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:41.444281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:41.449396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:41.449396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:41.462925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:41.464093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:41.528425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 474/952] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:41.797389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d7265-19e9-443c-a1c1-f1f4efbe0743 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:41.839427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:41.897201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d7265-19e9-443c-a1c1-f1f4efbe0743 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:41.932904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:41.933527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:41.933804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:41.934074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:41.944022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 13:59:41.948852 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:41.950327 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:41.951337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 479/953] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Oct 31 13:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:41.956393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:41.959460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:42.052003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb896-422a-4b8b-9283-8dfa14fa52b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.083390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.083973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.084247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.084510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.085149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:42.085444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.086916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.094470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 475/954] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Oct 31 13:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:42.100844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:42.195384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:42.198145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7877f-9590-4b05-b8d5-ad6452ae4afe None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.231345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.232056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.232327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.232590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.242282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.243734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:42.258476 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:42.259672 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:42.260579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:42.260579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:42.260579 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:42.260579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 480/955] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:42.265344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:42.330245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:42.364267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea53e74-5d43-489e-a113-e4c9c5de32c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.397098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.397689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.397961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.398227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.398878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:42.399177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.400514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.412261 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 476/956] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:42.417947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:42.515815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f4f9-38a7-4e6d-a0c7-5bcb6c8f7a1d None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.548933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.549515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.549797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.550065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] PATH_INFO: `/v3/users/placement` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.557265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.558733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 13:59:42.569999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:42.571274 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:42.572260 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 481/957] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:42.576955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:42.673730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad8e3-63dc-4f8d-a884-df07d356f83e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.698688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:42.707753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.708354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.708628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.708895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.709615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:42.709905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.711364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.728999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 477/958] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Oct 31 13:59:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 13:59:42.734856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:42.749801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:42.834342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578870-3f37-4362-95ff-852e8c546dbf None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:42.867879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:42.868474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:42.868754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:42.869024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:42.937030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:42.938415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:42.952059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:43.035840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 482/959] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Oct 31 13:59:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 13:59:43.040248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:43.138690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d07d10-724a-4611-a390-a2c13dcb3029 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:43.170791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:43.171408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:43.171681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:43.171948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:43.182017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:43.183548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 13:59:43.198159 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:43.199258 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 13:59:43.200272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 13:59:43.200272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 13:59:43.200272 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:43.200272 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 478/960] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 13:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:43.204926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:43.301853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48fe4-673f-490e-9c34-f53adaa41030 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:43.314741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:43.334785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:43.335374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:43.335651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:43.335915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:43.336529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:43.336822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:43.338223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:43.349576 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 483/961] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Oct 31 13:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:43.355263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:43.390729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:43.453288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a7622-59af-45aa-9fbe-901d0432a461 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:43.485525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:43.486134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:43.486405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:43.486696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:43.495480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:43.497063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 13:59:43.508271 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:43.509290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 13:59:43.510209 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 479/962] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Oct 31 13:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:43.515295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:43.615408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb7b4-d488-4aa7-b0af-516655afe658 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:43.647755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:43.648339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:43.650715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:43.650715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:43.650715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:43.650715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:43.651422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f9dc2-e881-4222-af58-08d902f37b9d None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:43.663420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 484/963] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Oct 31 13:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:43.669660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:43.760807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:43.766131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c1d40-e9af-4930-a019-c06761d241f5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:43.798597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:43.799242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:43.799541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:43.799812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:43.800513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] RBAC: Adding query filter params (role.id=cdd12ff38c8843ef896a12ed03c315ae, scope.project.id=029e4df755db486eae5e5c4db7643bf0, user.id=93e90dc19f58488387296c15062dcb20) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:43.800815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:43.802231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9571a-2f20-43b6-aa5d-304070bd4d7c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:43.807700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 480/964] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Oct 31 13:59:43 2022] GET /identity/v3/role_assignments?user.id=93e90dc19f58488387296c15062dcb20&scope.project.id=029e4df755db486eae5e5c4db7643bf0&role.id=cdd12ff38c8843ef896a12ed03c315ae => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:45.953494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c5fa-50f3-43eb-89a1-d45ad4c59f27 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:45.954053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c5fa-50f3-43eb-89a1-d45ad4c59f27 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:45.954053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889c5fa-50f3-43eb-89a1-d45ad4c59f27 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:45.955365 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 485/965] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:45.960633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:45.961047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:45.961155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:45.978871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:45.979975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:46.044490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 481/966] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 13:59:46.315441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889c5fa-50f3-43eb-89a1-d45ad4c59f27 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:46.345583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:46.415446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889c5fa-50f3-43eb-89a1-d45ad4c59f27 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:46.449622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:46.450504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:46.450851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:46.451167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:46.451811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:46.453338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:46.461876 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:46.463199 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:46.464415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 486/967] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:59:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:46.469028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:46.557174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:46.566346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541552-40c6-4539-8e20-905b69e05ecb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:46.599746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:46.600332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:46.600604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:46.600869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:46.601478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:46.601773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:46.603148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e367c4-3222-4795-ae12-50b7263a4060 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:46.607714 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 482/968] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 31 13:59:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:46.614028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:46.704814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:46.713402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63bcb9-54ee-4dca-8957-1a2c3686e3ab None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:46.746998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:46.747588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:46.747861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:46.748123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:46.748731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:46.749360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:46.750415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2571a-b2f2-4cd6-b44c-4746b7320a44 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:46.754755 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 487/969] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 31 13:59:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:48.856363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f55f-5e79-4d77-9b29-473013507216 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:48.856887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f55f-5e79-4d77-9b29-473013507216 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:48.857004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f55f-5e79-4d77-9b29-473013507216 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:48.858307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 483/970] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:48.863461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2d2-e8a0-488d-a2d0-45972613a139 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:48.863869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2d2-e8a0-488d-a2d0-45972613a139 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:48.863993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6e2d2-e8a0-488d-a2d0-45972613a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:48.882049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-47d6e2d2-e8a0-488d-a2d0-45972613a139 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:48.883233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47d6e2d2-e8a0-488d-a2d0-45972613a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:48.948566 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 488/971] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:49.210710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f55f-5e79-4d77-9b29-473013507216 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:49.311415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f55f-5e79-4d77-9b29-473013507216 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:49.343925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:49.344516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:49.344793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:49.345064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:49.345701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:49.347682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ddc56-44d0-4efe-9fdb-cb128aef9822 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:49.476705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 484/972] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Oct 31 13:59:49 2022] POST /identity/v3/services => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 13:59:51.625199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7e05-ebe2-419c-89ae-660b30b255c3 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:51.625770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7e05-ebe2-419c-89ae-660b30b255c3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:51.625770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc7e05-ebe2-419c-89ae-660b30b255c3 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:51.627141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 489/973] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:51.633033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:51.633576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:51.633576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:51.652988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:51.654189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:51.665179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:51.731888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 485/974] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:51.996257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc7e05-ebe2-419c-89ae-660b30b255c3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:52.113910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:52.124734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc7e05-ebe2-419c-89ae-660b30b255c3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:52.157936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:52.158553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:52.158914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:52.159707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:52.160276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:52.161676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:52.170090 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:52.171230 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:52.172493 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 490/975] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:59:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:52.177241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:52.274469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db626c15-9e6e-497b-86fa-414a6a239ef6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:52.311757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:52.312358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:52.312636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:52.312905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:52.313522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:52.313823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:52.315805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:52.321228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 486/976] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 31 13:59:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:52.327191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:52.448469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aff35f-9eb1-41a0-a074-b036e5e67570 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:52.495616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:52.496275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:52.496605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:52.496873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:52.497613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] RBAC: Adding query filter params (interface=public, service_id=e8eebc1363f74a73862b2333d5f056b9, region_id=RegionOne) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:52.497915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:52.499422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9e78-497d-46f6-a82f-000db5df6440 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:52.505790 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 491/977] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Oct 31 13:59:52 2022] GET /identity/v3/endpoints?service_id=e8eebc1363f74a73862b2333d5f056b9&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:52.511288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:52.515152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:52.610841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bc54-eef9-4c4d-9eb6-a29fb98cccaf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:52.644584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:52.645174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:52.645503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:52.645781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:52.646374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:52.647799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8249d-3345-42d6-aabd-eca8f2481d09 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:52.654592 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 487/978] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Oct 31 13:59:52 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 13:59:54.812934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1d40-226f-4e81-b673-684770a16c6c None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:54.813482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1d40-226f-4e81-b673-684770a16c6c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:54.813575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1d40-226f-4e81-b673-684770a16c6c None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:54.814898 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 492/979] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 13:59:54.820126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:54.820548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:54.820657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:54.838399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 13:59:54.839607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 13:59:54.900102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:54.905249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 488/980] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 13:59:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 13:59:55.176584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1d40-226f-4e81-b673-684770a16c6c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:55.196685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:55.279065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1d40-226f-4e81-b673-684770a16c6c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:55.311603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:55.312218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:55.312496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:55.312768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:55.313338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:55.314781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 13:59:55.324084 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 13:59:55.325289 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 13:59:55.326256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 493/981] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Oct 31 13:59:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 13:59:55.331847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:55.425913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f264f2b-e07a-4f60-87e0-aab56c0e5c65 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:55.459821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:55.460345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:55.460618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:55.460881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:55.461487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 13:59:55.461781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:55.463150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dfb59-cff5-4b8a-992f-cf08bd51b8d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:55.468014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 489/982] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Oct 31 13:59:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 13:59:55.473775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 13:59:55.553195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 13:59:55.571355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5ee62-7550-4bd1-b5b7-e5f76f705a53 None admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 13:59:55.604647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 13:59:55.605238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 13:59:55.605515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 13:59:55.605786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 13:59:55.606707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 13:59:55.612791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7ecbf-ea8e-44b5-b264-1cad8185b538 None admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 13:59:55.751485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 494/983] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 13:59:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:00:05.465119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=69 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:00:05.746644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:13.783485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812116b-2854-488f-a191-90dc07146999 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:13.784351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812116b-2854-488f-a191-90dc07146999 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:13.784775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812116b-2854-488f-a191-90dc07146999 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:13.792532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1a25-d26c-4019-92c9-7a11e4c8e9ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:13.793406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1a25-d26c-4019-92c9-7a11e4c8e9ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:13.793823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1a25-d26c-4019-92c9-7a11e4c8e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:13.798566 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 490/984] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:13.898919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-995e1a25-d26c-4019-92c9-7a11e4c8e9ae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:13.900145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-995e1a25-d26c-4019-92c9-7a11e4c8e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:14.104349 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 495/985] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:06:14.426585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:14.427691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:14.428192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:14.429739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 491/986] 10.222.0.13 () {54 vars in 965 bytes} [Mon Oct 31 14:06:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:14.435988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c42a-a3e0-4cfb-bcb9-61e414d2a6e4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:14.436553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c42a-a3e0-4cfb-bcb9-61e414d2a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:14.436975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c42a-a3e0-4cfb-bcb9-61e414d2a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:14.524915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5b01c42a-a3e0-4cfb-bcb9-61e414d2a6e4 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:14.526488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5b01c42a-a3e0-4cfb-bcb9-61e414d2a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:14.550237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:14.643562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 496/987] 10.222.0.13 () {58 vars in 1062 bytes} [Mon Oct 31 14:06:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:14.655308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:14.657584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:14.815416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cfee8-57b2-469b-85fc-d77cd8192f78 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:14.913257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:14.913834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:14.914114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:14.914402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:14.916149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:14.979504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:15.043954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:15.045465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae1276-9840-457e-8978-9bc36897643a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:15.067147 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 492/988] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:17.579530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:17.580058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:17.580058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:17.581415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 497/989] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:17.587373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd51b0-0604-45ee-901a-4b353b7cc2ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:17.587761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd51b0-0604-45ee-901a-4b353b7cc2ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:17.587939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd51b0-0604-45ee-901a-4b353b7cc2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:17.672375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aafd51b0-0604-45ee-901a-4b353b7cc2ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:17.673586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aafd51b0-0604-45ee-901a-4b353b7cc2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:17.770101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 493/990] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:18.051440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:18.052974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:18.154880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c04c0-b93e-4fa2-9ac2-b0561cff9944 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:18.225370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:18.227624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:18.228319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:18.228596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:18.228857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:18.230414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:18.336587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:18.337932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a01d1-b624-457a-aeba-0399abf3674d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:18.355646 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 498/991] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:21.057094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:21.057603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:21.057603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:21.058915 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 494/992] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:21.064194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa318-5d4b-4814-88ad-50bd75800074 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:21.064600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa318-5d4b-4814-88ad-50bd75800074 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:21.064737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa318-5d4b-4814-88ad-50bd75800074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:21.129646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8f8fa318-5d4b-4814-88ad-50bd75800074 None None] MFA Rules not processed for user `181b6bd00bde47c9ad4268d2ba2962c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:21.130879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8f8fa318-5d4b-4814-88ad-50bd75800074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:21.182519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:21.228511 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 499/993] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:06:21.513625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:21.515242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:21.525632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:21.617500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc1249-5da1-4a82-bff8-89f3ad53acc7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:21.689075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:21.689673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:21.689951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:21.690225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:21.692377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:21.754694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:21.800132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:21.801520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db328c-d579-4612-9176-de6b7f2ffe6e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:21.819909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 495/994] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:24.702005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:24.702567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:24.702567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:24.703981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 500/995] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:24.709309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41e14-e7b7-4355-9be4-ed8a797df6cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:24.709704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41e14-e7b7-4355-9be4-ed8a797df6cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:24.709857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41e14-e7b7-4355-9be4-ed8a797df6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:24.776733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99d41e14-e7b7-4355-9be4-ed8a797df6cd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:24.777925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99d41e14-e7b7-4355-9be4-ed8a797df6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:24.874421 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 496/996] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:25.169089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:25.170635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:25.270176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8608-6f83-4e42-ad72-49876a1c5849 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:25.341018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:25.341595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:25.341865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:25.342128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:25.343694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:25.351281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:25.449825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:25.451213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4512-046c-4640-8e04-f111756f51f2 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:25.468665 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 501/997] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:28.658502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:28.659100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:28.659100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:28.660932 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 497/998] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:28.666174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda894-6a45-45e2-a251-7fe38634c3bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:28.666608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda894-6a45-45e2-a251-7fe38634c3bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:28.666822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda894-6a45-45e2-a251-7fe38634c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:28.736554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6efda894-6a45-45e2-a251-7fe38634c3bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:28.737766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6efda894-6a45-45e2-a251-7fe38634c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:28.799371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:28.840978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 502/999] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:29.128188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:29.129758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:29.149288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:29.232069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccccf42-f81e-4c30-babc-3166ffe0bbf1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:29.304147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:29.304746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:29.305021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:29.305290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:29.306884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:29.377255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:29.415966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:29.417396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f57ed-da8f-402d-82d1-cbe01717c52c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:29.435297 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 498/1000] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:31.680687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:31.685823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:31.685823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:31.685823 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 503/1001] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:31.687917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f573-f583-4f1c-9161-f9460db33874 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:31.688364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f573-f583-4f1c-9161-f9460db33874 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:31.688460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315f573-f583-4f1c-9161-f9460db33874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:31.758207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9315f573-f583-4f1c-9161-f9460db33874 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:31.759428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9315f573-f583-4f1c-9161-f9460db33874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:31.868881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 499/1002] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:32.154759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:32.156276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:32.259453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fca22-26f2-4add-8e92-e60bf191ca3e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:32.333969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:32.334563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:32.334867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:32.335132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:32.336719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:32.353127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:32.446335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:32.447716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaaaed-26f3-4341-b051-9d85508a4da8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:32.465606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 504/1003] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:34.667792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:34.668311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:34.668311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:34.669661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 500/1004] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:34.675688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e024b4-ca84-42d1-88dd-418181772b85 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:34.676083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e024b4-ca84-42d1-88dd-418181772b85 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:34.676236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e024b4-ca84-42d1-88dd-418181772b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:34.743645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-86e024b4-ca84-42d1-88dd-418181772b85 None None] MFA Rules not processed for user `181b6bd00bde47c9ad4268d2ba2962c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:34.744828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86e024b4-ca84-42d1-88dd-418181772b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:34.809036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:34.840987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 505/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:35.120741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:35.122273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:35.155020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:35.233084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4037a6d-5026-48db-b78c-f3ce402e8aae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:35.315214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:35.316329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:35.316601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:35.316894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:35.318477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:35.393230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:35.424114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:35.426106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f299b-0d13-4730-a273-726e2c866fd0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:35.444445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 501/1006] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:38.064510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:38.065070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:38.065070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:38.066967 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 506/1007] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:38.072249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976fe9-1383-4aa5-a8a6-0d894f96da5b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:38.072644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976fe9-1383-4aa5-a8a6-0d894f96da5b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:38.072872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976fe9-1383-4aa5-a8a6-0d894f96da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:38.137690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec976fe9-1383-4aa5-a8a6-0d894f96da5b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:38.138907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec976fe9-1383-4aa5-a8a6-0d894f96da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:38.236415 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 502/1008] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:38.516604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:38.518127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:38.620165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b83d-bc26-4e73-ab96-0c627cf79053 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:38.692913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:38.693543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:38.693814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:38.694081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:38.695692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:38.724005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:38.805585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:38.806968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55b288-5fa8-4da5-941f-5649b7f25e76 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:38.824973 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 507/1009] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:41.022744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:41.023283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:41.023283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:41.024623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 503/1010] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:41.029757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e080ab6-af6b-4f86-9a37-0cd6877a1ea4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:41.030182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e080ab6-af6b-4f86-9a37-0cd6877a1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:41.030327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e080ab6-af6b-4f86-9a37-0cd6877a1ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:41.095489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7e080ab6-af6b-4f86-9a37-0cd6877a1ea4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:41.096689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e080ab6-af6b-4f86-9a37-0cd6877a1ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:41.171208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:41.193881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 508/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:41.477559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:41.479116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:41.518003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:41.581317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9c94-e092-4cbb-b338-c2a4cb2713da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:41.653462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:41.654058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:41.654337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:41.654610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:41.656209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:41.739638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:41.764601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:41.766017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154273d-7a43-4d40-96dd-f2e193e89085 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:41.784980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 504/1012] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:44.492434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:44.492957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:44.492957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:44.494263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 509/1013] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:44.499517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e31a4-977f-49e0-9bef-39302b846885 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:44.499934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e31a4-977f-49e0-9bef-39302b846885 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:44.500067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e31a4-977f-49e0-9bef-39302b846885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:44.565178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d0e31a4-977f-49e0-9bef-39302b846885 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:44.567034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d0e31a4-977f-49e0-9bef-39302b846885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:44.659847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 505/1014] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:44.941944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:44.943538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:45.050015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ada1-553f-4207-8d38-24e4a2355437 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:45.124408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:45.125006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:45.125282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:45.125551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:45.127160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:45.163321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:45.235084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:45.236476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c8bb7-c8df-46bd-b28e-10e36c81e230 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:45.254360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 510/1015] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:49.561315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:49.561870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:49.561870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:49.563251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 506/1016] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:49.568402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805723a-4a15-4d89-9355-d85cefaaca6b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:49.568806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805723a-4a15-4d89-9355-d85cefaaca6b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:49.568942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805723a-4a15-4d89-9355-d85cefaaca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:49.634968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a805723a-4a15-4d89-9355-d85cefaaca6b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:49.636224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a805723a-4a15-4d89-9355-d85cefaaca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:49.725242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:49.736115 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 511/1017] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:50.018581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:50.020216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:50.070793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:50.129451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94067-e8e9-4ecd-83db-5d6a499dbe86 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:50.202075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:50.202767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:50.203042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:50.203306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:50.204867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:50.295691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:50.312036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:50.313464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d867-0588-4273-9292-7b7de0d1b956 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:50.331285 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 507/1018] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:53.481293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:53.481818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:53.481818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:53.483350 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 512/1019] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:53.488778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131123-f50b-4acc-83d0-cc48b9ffdb9c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:53.489217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131123-f50b-4acc-83d0-cc48b9ffdb9c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:53.489320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131123-f50b-4acc-83d0-cc48b9ffdb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:53.554559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8131123-f50b-4acc-83d0-cc48b9ffdb9c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:53.555758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8131123-f50b-4acc-83d0-cc48b9ffdb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:53.653626 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 508/1020] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:53.938078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:53.939747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:54.047218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0e83-b061-48b9-b832-7323c0de5076 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:54.122853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:54.123453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:54.123724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:54.123996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:54.125575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:54.191164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:54.266348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:54.267930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae13026-5c3b-4fd5-80d8-8c837e81bcaf service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:54.288239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 513/1021] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:06:58.590795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:58.591320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:58.591320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:58.592731 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 509/1022] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:06:58.598233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8752e0-640a-47c6-bb8a-2a542e628716 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:58.598677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8752e0-640a-47c6-bb8a-2a542e628716 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:58.598857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8752e0-640a-47c6-bb8a-2a542e628716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:58.667586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2c8752e0-640a-47c6-bb8a-2a542e628716 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:06:58.668814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c8752e0-640a-47c6-bb8a-2a542e628716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:58.773774 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 514/1023] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:06:58.774314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:59.056957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:06:59.059829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:59.119071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:59.164892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0f1c-1098-48bf-b13b-ce401d8f469e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:06:59.236147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:06:59.236748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:06:59.237610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:06:59.237883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:06:59.239528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:06:59.341491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:06:59.344569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:06:59.345993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6249-da73-42df-8f8a-8f779de7818d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:06:59.364481 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 510/1024] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:04.275622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9df32-cd4a-4b1b-b262-8bbbcc1d6171 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:04.276159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9df32-cd4a-4b1b-b262-8bbbcc1d6171 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:04.276159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9df32-cd4a-4b1b-b262-8bbbcc1d6171 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:04.277758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 515/1025] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:04.282746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd263cd-b180-4d5c-a827-a65e5486bc70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:04.283157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd263cd-b180-4d5c-a827-a65e5486bc70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:04.283313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd263cd-b180-4d5c-a827-a65e5486bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:04.387266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cfd263cd-b180-4d5c-a827-a65e5486bc70 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:04.388467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfd263cd-b180-4d5c-a827-a65e5486bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:04.510849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 511/1026] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:08.849144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c86-a92b-4005-bb12-5e23392692d0 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:08.849738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c86-a92b-4005-bb12-5e23392692d0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:08.849738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c86-a92b-4005-bb12-5e23392692d0 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:08.851219 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 516/1027] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:08.856044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2ffb-e10b-419b-becd-175042bb1943 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:08.856512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2ffb-e10b-419b-becd-175042bb1943 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:08.856596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2ffb-e10b-419b-becd-175042bb1943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:08.915009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:08.940546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e5f2ffb-e10b-419b-becd-175042bb1943 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:08.942074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e5f2ffb-e10b-419b-becd-175042bb1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:09.054151 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 512/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:10.398482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdca8-c09b-484a-a59d-b2ba1970393b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:10.399049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdca8-c09b-484a-a59d-b2ba1970393b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:10.399049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdca8-c09b-484a-a59d-b2ba1970393b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:10.400394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 517/1029] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:10.405567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034c18-9700-4d01-b8dc-2a983b8d35c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:10.405957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034c18-9700-4d01-b8dc-2a983b8d35c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:10.406102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c034c18-9700-4d01-b8dc-2a983b8d35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:10.484934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7c034c18-9700-4d01-b8dc-2a983b8d35c7 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:10.486125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c034c18-9700-4d01-b8dc-2a983b8d35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:10.530654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:10.597352 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 513/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:07:14.202825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e5ca-9124-4264-9771-ba1f615b2884 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:14.203682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e5ca-9124-4264-9771-ba1f615b2884 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:14.203957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e5ca-9124-4264-9771-ba1f615b2884 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:14.205510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 518/1031] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:14.211409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390837-c6e0-4291-a6fb-9a9edf47ce48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:14.212219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390837-c6e0-4291-a6fb-9a9edf47ce48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:14.212494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390837-c6e0-4291-a6fb-9a9edf47ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:14.310227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6390837-c6e0-4291-a6fb-9a9edf47ce48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:14.311557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6390837-c6e0-4291-a6fb-9a9edf47ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:14.415418 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 514/1032] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:14.734389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:14.735211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:14.735805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:14.737381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 519/1033] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:07:14.747970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b064-9484-44d6-b635-a8504b79aeb8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:14.748455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b064-9484-44d6-b635-a8504b79aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:14.748883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b064-9484-44d6-b635-a8504b79aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:14.776016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:14.840019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bcf8b064-9484-44d6-b635-a8504b79aeb8 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:14.841412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcf8b064-9484-44d6-b635-a8504b79aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:14.965242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 515/1034] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:07:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:14.973825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:14.975579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:15.141988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f5c9-1faf-4010-b78d-5fc04e6c649e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:15.222175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:15.265750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:15.266356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:15.266646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:15.266927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:15.268634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:15.363995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:15.365721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cfc90-44a6-4e7c-88dc-4efc83f57ff8 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:15.387248 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 520/1035] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:17.776804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6761-3b86-47d0-866d-33638910601c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:17.777356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6761-3b86-47d0-866d-33638910601c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:17.777356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6761-3b86-47d0-866d-33638910601c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:17.778702 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 516/1036] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:07:17.784572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892808-c225-42b6-a12a-8c1174fdcaad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:17.785354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892808-c225-42b6-a12a-8c1174fdcaad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:17.785782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892808-c225-42b6-a12a-8c1174fdcaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:17.862542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-63892808-c225-42b6-a12a-8c1174fdcaad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:17.863987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-63892808-c225-42b6-a12a-8c1174fdcaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:17.910019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:17.975269 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 521/1037] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:18.271023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6761-3b86-47d0-866d-33638910601c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:18.272996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83df6761-3b86-47d0-866d-33638910601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:18.343615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:18.434149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6761-3b86-47d0-866d-33638910601c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:18.572702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:18.573384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:18.573772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:18.574089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:18.575906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:18.600452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:18.678083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:18.679715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ee112-e209-417b-81db-ede31ad5010e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:18.699160 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 517/1038] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:21.307632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5fb1-5ab1-430d-8d7b-64863a563fd5 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:21.308124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5fb1-5ab1-430d-8d7b-64863a563fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:21.308124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a5fb1-5ab1-430d-8d7b-64863a563fd5 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:21.309458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 522/1039] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:21.314893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427729-a165-4972-9a96-2c71299d22d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:21.315347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427729-a165-4972-9a96-2c71299d22d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:21.315449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427729-a165-4972-9a96-2c71299d22d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:21.392938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db427729-a165-4972-9a96-2c71299d22d1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:21.394173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db427729-a165-4972-9a96-2c71299d22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:21.529935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:21.532584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 518/1040] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:21.833320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:21.833696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:21.833881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:21.835424 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 523/1041] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:07:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:21.840860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ee46-c309-49e1-8f0d-a5c9b5d73ba1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:21.841142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ee46-c309-49e1-8f0d-a5c9b5d73ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:21.843998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ee46-c309-49e1-8f0d-a5c9b5d73ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:21.947573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c8c5ee46-c309-49e1-8f0d-a5c9b5d73ba1 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:21.949055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8c5ee46-c309-49e1-8f0d-a5c9b5d73ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:22.086173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 519/1042] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:22.094291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:22.095902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:22.311225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a388-1cbf-487d-ad42-4c3767546ac4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:22.337573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:22.460334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:22.462504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:22.462504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:22.462504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:22.463813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:22.597661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:22.599695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa8b3-2e5c-4bc9-9f1b-f2a7bc5ec28f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:22.623680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 524/1043] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:25.261874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:25.262444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:25.262444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:25.264287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 520/1044] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:25.270237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a895f-f2fd-4fa9-9a5e-da4eb50f4b55 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:25.271099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a895f-f2fd-4fa9-9a5e-da4eb50f4b55 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:25.271583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a895f-f2fd-4fa9-9a5e-da4eb50f4b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:25.305799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:25.348477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3b8a895f-f2fd-4fa9-9a5e-da4eb50f4b55 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:25.350012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b8a895f-f2fd-4fa9-9a5e-da4eb50f4b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:25.470952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 525/1045] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:25.837612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:25.839996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:25.924639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:26.123372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2391ae-b1e0-4377-a7ff-06875bc5ccb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:26.265625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:26.267681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930ffe-8c8d-43b1-be9b-437ffdc87828 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:26.267963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930ffe-8c8d-43b1-be9b-437ffdc87828 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:26.268236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930ffe-8c8d-43b1-be9b-437ffdc87828 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:26.269670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 526/1046] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:07:26.270241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:26.270518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:26.270811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:26.272688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:26.279956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8294-9b82-4185-8c5d-0ea0405be843 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:26.280991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8294-9b82-4185-8c5d-0ea0405be843 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:26.281269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8294-9b82-4185-8c5d-0ea0405be843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:26.284053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:26.353343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7b5e8294-9b82-4185-8c5d-0ea0405be843 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:26.354457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b5e8294-9b82-4185-8c5d-0ea0405be843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:26.377415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:26.379196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36ed9-f53d-498a-a991-400a82403fd6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:26.398220 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 521/1047] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:26.417448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:26.461358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 527/1048] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:07:26.813778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:26.814861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:26.815284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:26.816757 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 522/1049] 10.222.0.13 () {54 vars in 963 bytes} [Mon Oct 31 14:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:26.821847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e62a9-2c1a-4c9b-9da6-4f74aced9be5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:26.822313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e62a9-2c1a-4c9b-9da6-4f74aced9be5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:26.822823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e62a9-2c1a-4c9b-9da6-4f74aced9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:26.908556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4b5e62a9-2c1a-4c9b-9da6-4f74aced9be5 None None] MFA Rules not processed for user `e4f863d5b33d4f10a053481933f03555`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:26.909995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b5e62a9-2c1a-4c9b-9da6-4f74aced9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:26.995635 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 528/1050] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 31 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:27.003235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:27.004842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:27.119885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c31a0-1d31-4cbe-a2c4-71db08e413ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:27.156357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:27.198037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:27.198831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:27.199608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:27.199981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:27.201725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:27.318610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:27.320140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115b9ef-d821-43e8-a6ad-5c46c46198f0 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:27.343107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 523/1051] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:28.775240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:28.775722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:28.775834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:28.777122 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 529/1052] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:28.782454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0baeea-89bb-43ff-8f89-794f9ba1e5b3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:28.783924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0baeea-89bb-43ff-8f89-794f9ba1e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:28.784355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0baeea-89bb-43ff-8f89-794f9ba1e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:28.854149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa0baeea-89bb-43ff-8f89-794f9ba1e5b3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:28.855391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa0baeea-89bb-43ff-8f89-794f9ba1e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:28.870149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:28.960014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 524/1053] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:29.267986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:29.269777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:29.328823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:29.440351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51db58-f32a-4ff9-a73c-09bf527964dd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:29.581113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:29.581711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:29.581988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:29.582256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:29.584085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:29.598348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:29.694353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:29.695867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba32ea-aaa7-4ec8-bf5d-d733b4cbac05 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:29.717667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 530/1054] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:32.153351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:32.154380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:32.154903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:32.156457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 525/1055] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:32.162459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f73e0-6436-4d59-a3e3-e5ec95f1882f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:32.163284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f73e0-6436-4d59-a3e3-e5ec95f1882f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:32.163763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f73e0-6436-4d59-a3e3-e5ec95f1882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:32.232539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-431f73e0-6436-4d59-a3e3-e5ec95f1882f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:32.234078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-431f73e0-6436-4d59-a3e3-e5ec95f1882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:32.324052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:32.347083 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 531/1056] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:32.629033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:32.630812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:32.813318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:32.816494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d474232-cb5c-428c-95ed-db4de6866d94 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:32.936769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:32.937547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:32.937929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:32.938303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:32.940041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:33.035974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:33.037572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6dc6f-14fe-4b78-86c3-fdece07887d9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:33.068266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 526/1057] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:35.419101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:35.419546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:35.419789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:35.420978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 532/1058] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:35.427142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606217-436f-4cdb-9196-b133da201a61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:35.427565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606217-436f-4cdb-9196-b133da201a61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:35.427689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22606217-436f-4cdb-9196-b133da201a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:35.432572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:35.498294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-22606217-436f-4cdb-9196-b133da201a61 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:35.499527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22606217-436f-4cdb-9196-b133da201a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:35.597808 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 527/1059] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:35.888809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:35.890311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:36.055419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977e398-6fb6-4102-849d-8213ff545f7d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:36.131369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:36.183796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:36.184575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:36.184861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:36.185132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:36.186756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:36.294724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:36.297093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730ab7e-eabc-42ea-8476-effae4b5fe79 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:36.319952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 533/1060] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:38.550750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:38.551348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:38.551348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:38.552658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 528/1061] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:38.558667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcd69-34f8-4b59-a8d5-ef29c680698b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:38.559155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcd69-34f8-4b59-a8d5-ef29c680698b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:38.559410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddcd69-34f8-4b59-a8d5-ef29c680698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:38.633556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-94ddcd69-34f8-4b59-a8d5-ef29c680698b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:38.635091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94ddcd69-34f8-4b59-a8d5-ef29c680698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:38.667707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:38.744218 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 534/1062] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:39.037782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:39.039971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:39.126146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:39.193992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b2d5-a415-486c-bf6a-ced404c93983 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:39.312626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:39.313183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:39.313453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:39.313716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:39.315911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:39.370963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:39.418192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:39.419881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dcc54-5af1-4a5e-ba32-e81cb21b4c7a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:39.440743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 529/1063] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:41.803715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:41.804309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:41.804309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:41.805620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 535/1064] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:41.810943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a33cc-1726-4d63-bfe2-8c6cf5393f2b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:41.811416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a33cc-1726-4d63-bfe2-8c6cf5393f2b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:41.811626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a33cc-1726-4d63-bfe2-8c6cf5393f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:41.879826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-041a33cc-1726-4d63-bfe2-8c6cf5393f2b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:41.881003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-041a33cc-1726-4d63-bfe2-8c6cf5393f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:41.981599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 530/1065] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:42.270848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:42.272732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:42.420846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5830-6578-4ffa-8944-300d10f4aa04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:42.430857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:42.537572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:42.538089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:42.538366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:42.538654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:42.540239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:42.633427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:42.635060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe226320-fdaf-4af8-9d4c-c15cc81aff28 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:42.652766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 536/1066] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:43.429723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b05398-cb62-4779-ae61-803444e5ed80 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:43.430338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b05398-cb62-4779-ae61-803444e5ed80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:43.430338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b05398-cb62-4779-ae61-803444e5ed80 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:43.431640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 531/1067] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:43.436914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef371-7e07-4020-a311-0c3a1e1e3a94 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:43.437360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef371-7e07-4020-a311-0c3a1e1e3a94 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:43.437517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef371-7e07-4020-a311-0c3a1e1e3a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:43.456846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:43.512653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-249ef371-7e07-4020-a311-0c3a1e1e3a94 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:43.513888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-249ef371-7e07-4020-a311-0c3a1e1e3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:43.612697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 537/1068] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:43.920117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:43.920403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:43.920681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:43.922036 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 532/1069] 10.222.0.13 () {54 vars in 962 bytes} [Mon Oct 31 14:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:43.927751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42b457-ef45-4b08-b4cf-e367355177f5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:43.928032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42b457-ef45-4b08-b4cf-e367355177f5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:43.928309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42b457-ef45-4b08-b4cf-e367355177f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:44.004987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ea42b457-ef45-4b08-b4cf-e367355177f5 None None] MFA Rules not processed for user `22e15ff208c1453ab8318e64575dc2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:44.006088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea42b457-ef45-4b08-b4cf-e367355177f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:44.040828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:44.083828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 538/1070] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 31 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:44.091855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:44.093355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:44.117342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:44.202345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ebac8-691d-4706-9272-3f7246e1e13e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:44.277010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:44.277834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:44.278108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:44.278375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:44.279983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:44.357001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:44.393655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:44.395188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794628dc-ffae-4a3c-930b-2dbca7a6b905 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:44.414354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 533/1071] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:45.015507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7a93-bf22-4877-9c3b-d64f12da573f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.015979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7a93-bf22-4877-9c3b-d64f12da573f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.016070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7a93-bf22-4877-9c3b-d64f12da573f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.017412 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 539/1072] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:45.023022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.023481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.023588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.096798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:45.098030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.201696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 534/1073] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:45.312893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bada15-d714-4d68-8e2b-f9b6cb402ba3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.313171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bada15-d714-4d68-8e2b-f9b6cb402ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.313437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bada15-d714-4d68-8e2b-f9b6cb402ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.379911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-99bada15-d714-4d68-8e2b-f9b6cb402ba3 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:45.381089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-99bada15-d714-4d68-8e2b-f9b6cb402ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.469097 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 540/1074] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:45.509096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:45.510361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.516147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d694f-35dd-4be8-8868-730dcb32e948 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.516452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d694f-35dd-4be8-8868-730dcb32e948 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.516726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d694f-35dd-4be8-8868-730dcb32e948 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.518096 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 541/1075] 10.222.0.13 () {54 vars in 943 bytes} [Mon Oct 31 14:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:07:45.524334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.524619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.524923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.545032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:45.583069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:45.601699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] MFA Rules not processed for user `dd208aa4e6dc479a8a24bdfce4dff5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:45.602981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.626888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d87a66-e317-431b-a0f9-1b95729b2b81 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:45.722222 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 542/1076] 10.222.0.13 () {58 vars in 1040 bytes} [Mon Oct 31 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:07:45.731475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:45.741207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3583-7d4f-4438-9b32-91b7d521c173 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:45.748494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:45.749100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.749377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.749647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.751789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.780633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:45.845623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:45.847241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e835c-b595-404b-bcc1-6863d1cda41b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:45.847419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:45.853499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:45.854125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:45.854386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:45.854678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:45.856310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:45.865800 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 535/1077] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:45.944469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:45.946072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf30ec-e3f8-4231-b90a-a4d9abb72b8d service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:45.959428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 543/1078] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:07:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:07:48.343051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:48.343593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:48.343593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:48.345614 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 536/1079] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:48.351527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabbed-ffd0-4e33-8a06-5ed97dfb4765 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:48.351527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabbed-ffd0-4e33-8a06-5ed97dfb4765 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:48.351527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dabbed-ffd0-4e33-8a06-5ed97dfb4765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:48.427749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-29dabbed-ffd0-4e33-8a06-5ed97dfb4765 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:48.429356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-29dabbed-ffd0-4e33-8a06-5ed97dfb4765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:48.524128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:48.540256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 544/1080] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:07:48.833322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:48.834801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:49.012465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f30f0-cb9c-484a-a2f3-ae470cb6b026 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:49.016574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:49.146205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:49.146911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:49.147559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:49.147839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:49.149447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:49.259632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:49.261323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ee58-7ffd-4b16-9a4d-572b780bb16f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:49.281994 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 537/1081] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:07:51.630490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:51.631056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:51.631056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:51.632400 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 545/1082] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:07:51.637821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee125f-5e7d-4c42-bee8-2e8e58063b0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:51.638243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee125f-5e7d-4c42-bee8-2e8e58063b0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:51.638433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee125f-5e7d-4c42-bee8-2e8e58063b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:51.650584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:51.710799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71ee125f-5e7d-4c42-bee8-2e8e58063b0a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:07:51.712003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71ee125f-5e7d-4c42-bee8-2e8e58063b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:51.823821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 538/1083] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:07:52.111684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:07:52.113524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:52.290745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818229-b3c8-41cd-a7c8-6b40a78a27f5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:07:52.360413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:07:52.414997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:07:52.415637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:07:52.415916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:07:52.416182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:07:52.417801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:07:52.519294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:07:52.520892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319ed11-ad8e-4968-97ba-31757e9a9dc3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:07:52.540439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 546/1084] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:01.822283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=61 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:02.537862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=67 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:09.893514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942265-8657-4d40-91bc-c20d24d31464 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:09.894097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942265-8657-4d40-91bc-c20d24d31464 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:09.894210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942265-8657-4d40-91bc-c20d24d31464 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:09.895632 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 539/1085] 10.222.0.13 () {54 vars in 918 bytes} [Mon Oct 31 14:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:09.900821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d7ba-390f-4b3c-81d8-75b1aa5d8bb4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:09.901243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d7ba-390f-4b3c-81d8-75b1aa5d8bb4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:09.901349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d7ba-390f-4b3c-81d8-75b1aa5d8bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:09.977351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0c14d7ba-390f-4b3c-81d8-75b1aa5d8bb4 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:09.978479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0c14d7ba-390f-4b3c-81d8-75b1aa5d8bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:10.083980 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 547/1086] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 31 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:08:10.098504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8637-6edb-4713-8c50-08e7b49152da None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:10.098821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8637-6edb-4713-8c50-08e7b49152da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:10.099112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8637-6edb-4713-8c50-08e7b49152da None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:10.100461 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 540/1087] 10.222.0.13 () {54 vars in 918 bytes} [Mon Oct 31 14:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:10.105050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4547f-c09b-4f8b-b33a-d19946f3e13e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:10.105338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4547f-c09b-4f8b-b33a-d19946f3e13e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:10.105611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4547f-c09b-4f8b-b33a-d19946f3e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:10.178244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:10.181377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5eb4547f-c09b-4f8b-b33a-d19946f3e13e None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:10.182675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5eb4547f-c09b-4f8b-b33a-d19946f3e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:10.298082 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 548/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Oct 31 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:12.879007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:12.879562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:12.879562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:12.880871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 541/1089] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:12.886376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76741244-f627-41a6-83f0-4e72b638a247 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:12.886847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76741244-f627-41a6-83f0-4e72b638a247 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:12.886993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76741244-f627-41a6-83f0-4e72b638a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:12.955975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-76741244-f627-41a6-83f0-4e72b638a247 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:12.957163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76741244-f627-41a6-83f0-4e72b638a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:13.011296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:13.052838 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 549/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:13.343964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:13.345990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:13.491678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e54d-5d82-4f77-9563-d2b0f88d754b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:13.565203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:13.604846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:13.605410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:13.605684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:13.605949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:13.607574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:13.696292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:13.697876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac1a11-1dde-41e4-975f-ecfbcfcea2d6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:13.716035 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 542/1091] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:14.851240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:14.851778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:14.851868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:14.853166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 550/1092] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:14.858052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55699-5d5d-48c5-a38f-e1aa77130d9f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:14.858494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55699-5d5d-48c5-a38f-e1aa77130d9f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:14.858648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55699-5d5d-48c5-a38f-e1aa77130d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:14.934074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25e55699-5d5d-48c5-a38f-e1aa77130d9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:14.935307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25e55699-5d5d-48c5-a38f-e1aa77130d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:14.961944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:15.031956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 543/1093] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:08:15.192988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:15.194512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:15.337413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b013-9c25-489f-afef-b632d6da4918 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:15.377539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:15.448180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:15.448774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:15.449045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:15.449307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:15.450899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:15.539654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:15.541229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bd508-4d05-44be-8f72-237a0afe988f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:15.559282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 551/1094] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:16.685251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:16.685801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:16.685801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:16.688304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 544/1095] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:16.692034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68082c74-b2a1-44d3-a94e-1e083d6870a6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:16.692490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68082c74-b2a1-44d3-a94e-1e083d6870a6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:16.692592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68082c74-b2a1-44d3-a94e-1e083d6870a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:16.747088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:16.768404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-68082c74-b2a1-44d3-a94e-1e083d6870a6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:16.769755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-68082c74-b2a1-44d3-a94e-1e083d6870a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:16.866441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 552/1096] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:17.015711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:17.017686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:17.160965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c55d-684c-45ff-92f2-796b3e60976d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:17.172863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:17.271239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:17.271744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:17.272013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:17.272278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:17.274129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:17.358955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:17.360557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b46b91-94fe-4ed4-98f2-c8eddac6ac23 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:17.379304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 545/1097] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:18.475117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:18.475689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:18.475689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:18.476996 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 553/1098] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:18.481939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cb5-6a1c-4a39-92ce-94a530cfc5f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:18.482347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cb5-6a1c-4a39-92ce-94a530cfc5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:18.482489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cb5-6a1c-4a39-92ce-94a530cfc5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:18.503358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:18.558851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7637cb5-6a1c-4a39-92ce-94a530cfc5f2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:18.560024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7637cb5-6a1c-4a39-92ce-94a530cfc5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:18.653455 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 546/1099] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:18.803668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:18.805155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:18.914052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:18.949120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4251bd-53e0-4e83-816f-90198619ed21 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:19.061947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:19.062472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:19.062781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:19.063628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:19.065214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:19.139938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:19.153651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:19.155289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25c359-707b-4fa8-98e3-bad8cfbd2cf1 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:19.173680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 554/1100] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:20.263646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:20.264226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:20.264332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:20.265666 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 547/1101] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:20.271288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4d66-be24-4aef-ba63-c7e2b219de45 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:20.271683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4d66-be24-4aef-ba63-c7e2b219de45 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:20.271852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4d66-be24-4aef-ba63-c7e2b219de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:20.346473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-831d4d66-be24-4aef-ba63-c7e2b219de45 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:20.347688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-831d4d66-be24-4aef-ba63-c7e2b219de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:20.444947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 555/1102] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:20.593239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:20.595451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:20.679675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:20.742809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1880cc0-2ca1-4b28-ae1d-a1f0df182f55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:20.857199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:20.857800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:20.858082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:20.858354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:20.860084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:20.910037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:20.952411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:20.954603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b915b-bbaa-4004-93b8-25e8eec811c0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:20.972673 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 548/1103] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:22.064363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:22.064896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:22.064896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:22.066156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 556/1104] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:22.071085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27daef-c7fc-4b87-85d1-6451806390d2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:22.071519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27daef-c7fc-4b87-85d1-6451806390d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:22.071610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27daef-c7fc-4b87-85d1-6451806390d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:22.146100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e27daef-c7fc-4b87-85d1-6451806390d2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:22.147314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e27daef-c7fc-4b87-85d1-6451806390d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:22.243033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 549/1105] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:08:22.391622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:22.393128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:22.441870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:22.537074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3fd8-9957-4a41-a938-4864be578fc8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:22.647764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:22.648548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:22.648826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:22.649097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:22.650706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:22.658015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:22.741421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:22.743058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1919d1e-e302-49c0-b08a-c9b70545dbbc service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:22.760785 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 557/1106] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:23.858064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:23.858650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:23.858650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:23.860000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 550/1107] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:23.864903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036c04f-cdb9-4965-a05a-bf7d43f03a17 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:23.865337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036c04f-cdb9-4965-a05a-bf7d43f03a17 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:23.865429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036c04f-cdb9-4965-a05a-bf7d43f03a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:23.940923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4036c04f-cdb9-4965-a05a-bf7d43f03a17 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:23.942114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4036c04f-cdb9-4965-a05a-bf7d43f03a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:24.008469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:24.036996 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 558/1108] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:24.187543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:24.189680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:24.207010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:24.332512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbbfe-443d-4019-9628-0ac4c34c8749 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:24.416938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:24.442547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:24.443246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:24.443523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:24.443794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:24.445368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:24.534128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:24.535735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9589-4766-4b4f-8f88-25944400b4e3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:24.553613 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 551/1109] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:25.690406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:25.691075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:25.691075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:25.692473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 559/1110] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:08:25.697420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2497-bf95-4b4d-bc4d-e54d4a5439f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:25.697864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2497-bf95-4b4d-bc4d-e54d4a5439f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:25.697974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2497-bf95-4b4d-bc4d-e54d4a5439f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:25.773736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36bb2497-bf95-4b4d-bc4d-e54d4a5439f3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:25.774969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36bb2497-bf95-4b4d-bc4d-e54d4a5439f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:25.817270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:25.870986 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 552/1111] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:26.021017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:26.022409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:26.168690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8682f8-45ef-49d7-8311-0a7bfaa48411 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:26.223062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:26.281047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:26.282090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:26.282368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:26.282657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:26.284255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:26.372174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:26.373749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790277a-7fc3-435a-8131-2e0a9cc89421 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:26.391219 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 560/1112] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:27.486540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:27.487110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:27.487227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:27.488494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 553/1113] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:27.493294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae3a9-b5fb-4992-ba2a-430cf9f28d10 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:27.493751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae3a9-b5fb-4992-ba2a-430cf9f28d10 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:27.493846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ae3a9-b5fb-4992-ba2a-430cf9f28d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:27.569456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c97ae3a9-b5fb-4992-ba2a-430cf9f28d10 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:27.570646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c97ae3a9-b5fb-4992-ba2a-430cf9f28d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:27.572629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:27.664811 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 561/1114] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:27.814255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:27.815787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:27.959591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad879-41b7-48d2-984c-94d38ad2e958 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:27.986143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:28.070546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:28.071097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:28.071375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:28.071644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:28.073220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:28.161388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:28.162988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858be7f-7c43-437d-8279-a4f6770ddb55 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:28.180425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 554/1115] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:08:30.255910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:30.256515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:30.256618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:30.257884 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 562/1116] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:30.263279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca18-0f32-4403-a8f9-bfd7a07e156b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:30.263736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca18-0f32-4403-a8f9-bfd7a07e156b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:30.263838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cca18-0f32-4403-a8f9-bfd7a07e156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:30.304534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:30.329006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d00cca18-0f32-4403-a8f9-bfd7a07e156b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:30.330179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d00cca18-0f32-4403-a8f9-bfd7a07e156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:30.425623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 555/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:30.710828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:30.712394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:30.816270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ed05-92f3-445d-a708-ad5b74bd247b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:30.848893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:30.889261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:30.889862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:30.890145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:30.890413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:30.892654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:31.001787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:31.003198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2041-7cc2-4ce3-91cb-e20dd3351998 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:31.020784 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 563/1118] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:33.299064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:33.299638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:33.299638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:33.300956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 556/1119] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:33.306209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b086-5219-4d87-a2ce-1159edbc2a6e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:33.306704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b086-5219-4d87-a2ce-1159edbc2a6e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:33.306814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b086-5219-4d87-a2ce-1159edbc2a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:33.372951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7336b086-5219-4d87-a2ce-1159edbc2a6e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:33.374140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7336b086-5219-4d87-a2ce-1159edbc2a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:33.386596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:33.474036 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 564/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:33.756870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:33.758437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:33.860847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e8f5a-c878-4480-b716-945abc0df165 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:33.872633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:33.935081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:33.935688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:33.935967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:33.936243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:33.938433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:34.047811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:34.049161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa789a5-618e-4f6a-b59e-6aa1e45ad7aa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:34.067511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 557/1121] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:36.565160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:36.565757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:36.565757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:36.567084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 565/1122] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:36.572430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d53f0-daa7-42d7-a765-14ec6626c4bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:36.572874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d53f0-daa7-42d7-a765-14ec6626c4bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:36.572983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d53f0-daa7-42d7-a765-14ec6626c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:36.621058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:36.638679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e26d53f0-daa7-42d7-a765-14ec6626c4bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:36.639885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e26d53f0-daa7-42d7-a765-14ec6626c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:36.735884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 558/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:37.021819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:37.023662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:37.131234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1fc9-fe8a-4b0e-a275-a149abada6a4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:37.170884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:37.204062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:37.204659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:37.204933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:37.205199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:37.206809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:37.313316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:37.314706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bcc46-dfca-4d21-b0b8-e45b015bb4fa service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:37.332076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 566/1124] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:39.618352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:39.618955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:39.618955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:39.620242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 559/1125] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:39.625913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb086-62c4-4ccf-ae2d-2874fe17dbfd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:39.626309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb086-62c4-4ccf-ae2d-2874fe17dbfd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:39.626454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb086-62c4-4ccf-ae2d-2874fe17dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:39.692448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0b7eb086-62c4-4ccf-ae2d-2874fe17dbfd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:39.693602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b7eb086-62c4-4ccf-ae2d-2874fe17dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:39.715617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:39.793397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 567/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:40.079229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:40.080767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:40.184341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0fe3-fb90-415b-8315-f620bf8ebbe7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:40.205366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:40.258188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:40.258812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:40.259085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:40.259350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:40.260907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:40.366757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:40.368099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243de971-2845-4863-ad04-24dd1f627f55 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:40.385206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 560/1127] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:42.696299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:42.704776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:42.704776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:42.704776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 568/1128] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:42.705055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db822-4a94-4a62-9bfb-9e5682dab79d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:42.705055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db822-4a94-4a62-9bfb-9e5682dab79d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:42.705055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db822-4a94-4a62-9bfb-9e5682dab79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:42.768456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:42.771128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-386db822-4a94-4a62-9bfb-9e5682dab79d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:42.772333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-386db822-4a94-4a62-9bfb-9e5682dab79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:42.869307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 561/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:43.151903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:43.153463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:43.255165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b30a1-dd2d-480e-8afd-b77ab1aee5e7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:43.304053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:43.327634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:43.328979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:43.329523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:43.330086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:43.331755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:43.438518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:43.439910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9338d-cf0c-495e-8006-4c229418834a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:43.461160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 569/1130] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:45.690485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:45.694911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:45.694911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:45.694911 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 562/1131] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:45.697656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1500dd-16a1-4f20-b246-2d3b38748236 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:45.698020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1500dd-16a1-4f20-b246-2d3b38748236 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:45.698369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1500dd-16a1-4f20-b246-2d3b38748236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:45.769462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1f1500dd-16a1-4f20-b246-2d3b38748236 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:45.770682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f1500dd-16a1-4f20-b246-2d3b38748236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:45.799695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:45.866896 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 570/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:46.149515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:46.151160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:46.254389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bdaf8-2e32-4676-b5fb-6b554d23184f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:46.283471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:46.326792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:46.327319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:46.327592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:46.327856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:46.329405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:46.434193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:46.435648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a88290-8829-457d-85f5-068f8d7dba13 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:46.453326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 563/1133] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:48.636490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:48.637070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:48.637070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:48.638349 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 571/1134] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:48.644241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee2a1-e219-4b6b-9283-98f429f19e1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:48.644643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee2a1-e219-4b6b-9283-98f429f19e1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:48.644791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee2a1-e219-4b6b-9283-98f429f19e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:48.710997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c70ee2a1-e219-4b6b-9283-98f429f19e1c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:48.712194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c70ee2a1-e219-4b6b-9283-98f429f19e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:48.722815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:48.807865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 564/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:49.094339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:49.095907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:49.199191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e29b9-a060-4024-94d1-a997df21fc35 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:49.254361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:49.271883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:49.272480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:49.272786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:49.273058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:49.274989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:49.382105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:49.383575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2096a34-4044-4f0f-b154-47e0ebdd8926 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:49.401422 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 572/1136] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:51.566808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac3d6-5de5-410a-b171-edd6adfb184c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:51.567380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac3d6-5de5-410a-b171-edd6adfb184c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:51.567380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac3d6-5de5-410a-b171-edd6adfb184c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:51.568705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 565/1137] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:51.573871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1ab6-c976-4ad4-b166-18964b785265 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:51.574278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1ab6-c976-4ad4-b166-18964b785265 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:51.574402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c1ab6-c976-4ad4-b166-18964b785265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:51.638498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ca0c1ab6-c976-4ad4-b166-18964b785265 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:51.639698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca0c1ab6-c976-4ad4-b166-18964b785265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:51.677580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:51.735561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 573/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:52.034318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:52.034596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:52.034918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:52.036269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 566/1139] 10.222.0.13 () {54 vars in 965 bytes} [Mon Oct 31 14:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:52.042035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b268-ba24-421b-ae09-ad82326b03e6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:52.042316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b268-ba24-421b-ae09-ad82326b03e6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:52.042588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b268-ba24-421b-ae09-ad82326b03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:52.118248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c924b268-ba24-421b-ae09-ad82326b03e6 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:52.119464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c924b268-ba24-421b-ae09-ad82326b03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:52.193547 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 574/1140] 10.222.0.13 () {58 vars in 1062 bytes} [Mon Oct 31 14:08:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:52.202498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:52.204545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:52.306059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e228-3edc-45c6-924e-eab148b17c53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:52.343122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:52.380191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:52.380778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:52.381052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:52.381319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:52.382904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:52.487833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:52.489236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0fbd-124b-4070-8041-66b350516e2f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:52.507498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 567/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:55.057099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:55.057617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:55.057617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:55.058956 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:55.064920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c88d0-1833-4730-9abd-efa0df98f4dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:55.065349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c88d0-1833-4730-9abd-efa0df98f4dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:55.065452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c88d0-1833-4730-9abd-efa0df98f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:55.129441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-541c88d0-1833-4730-9abd-efa0df98f4dd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:55.130650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-541c88d0-1833-4730-9abd-efa0df98f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:55.148102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:55.230109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:55.514432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:55.516033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:55.556984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:55.622497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d764-7bc6-4dde-b92e-3676348f9b31 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:55.694256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:55.694880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:55.695157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:55.695421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:55.697119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:55.782399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:55.808020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:55.809454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdaca51-cb80-4c31-94e1-db846336e965 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:55.827414 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 576/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:08:57.956140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:57.956707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:57.956707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:57.958033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:08:57.963185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98a95-ca31-4e6d-9e50-bda1c1fae76b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:57.963652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98a95-ca31-4e6d-9e50-bda1c1fae76b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:57.963751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98a95-ca31-4e6d-9e50-bda1c1fae76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:58.030674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bee98a95-ca31-4e6d-9e50-bda1c1fae76b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:08:58.031800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bee98a95-ca31-4e6d-9e50-bda1c1fae76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:58.127370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:08:58.408484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:08:58.410018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:58.510746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b975-4d8f-4b02-8296-86fe2fbffcbe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:08:58.557645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:08:58.581975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:08:58.582611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:08:58.582946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:08:58.583214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:08:58.584809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:08:58.693324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:08:58.694029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23ac1-642d-437c-b940-f0fee5bf6da4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:08:58.712627 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 570/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:08.125893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:08.710305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=66 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:18.761700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b80a9-5fc3-4dd5-8f79-c4cf25b0254c None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:18.762223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b80a9-5fc3-4dd5-8f79-c4cf25b0254c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:18.762223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b80a9-5fc3-4dd5-8f79-c4cf25b0254c None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:18.763579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 578/1148] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:18.769503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023ec8-34c4-4c3e-9cc4-d53040d0dfd5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:18.769950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023ec8-34c4-4c3e-9cc4-d53040d0dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:18.770059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023ec8-34c4-4c3e-9cc4-d53040d0dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:18.835656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf023ec8-34c4-4c3e-9cc4-d53040d0dfd5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:18.836897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf023ec8-34c4-4c3e-9cc4-d53040d0dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:18.932853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 571/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:19.226670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:19.226960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:19.227237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:19.228560 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 579/1150] 10.222.0.13 () {54 vars in 962 bytes} [Mon Oct 31 14:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:19.234151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a9be-bb35-45ad-92d6-5f2148f67f9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:19.234428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a9be-bb35-45ad-92d6-5f2148f67f9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:19.234718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a9be-bb35-45ad-92d6-5f2148f67f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:19.309095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d982a9be-bb35-45ad-92d6-5f2148f67f9d None None] MFA Rules not processed for user `22e15ff208c1453ab8318e64575dc2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:19.310267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d982a9be-bb35-45ad-92d6-5f2148f67f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:19.330057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:19.383731 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 572/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 31 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:19.391392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:19.392909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:19.494372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946b55e-8cdd-4d66-8f3b-b4bbcfbcd947 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:19.566063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:19.566678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:19.566957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:19.567222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:19.568782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:19.621858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:19.675949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:19.677373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410565a-6aeb-4495-b943-5b4ef6e3225c service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:19.696308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 580/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:21.971615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:21.972144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:21.972144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:21.973421 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 573/1153] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:21.978896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84015c-fc42-45e4-b5b4-eb37d1fbf7bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:21.979325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84015c-fc42-45e4-b5b4-eb37d1fbf7bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:21.979440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84015c-fc42-45e4-b5b4-eb37d1fbf7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:22.045452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6e84015c-fc42-45e4-b5b4-eb37d1fbf7bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:22.046640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6e84015c-fc42-45e4-b5b4-eb37d1fbf7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:22.139356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 581/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:22.420402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:22.421978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:22.547036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7139b-bc16-4055-8c82-b7082867006c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:22.596369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:22.639255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:22.640468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:22.640748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:22.641020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:22.641650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:22.642765 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:09:22.642765 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:09:22.642765 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:09:22.643930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6cb12-dd2a-4685-9ec2-e185603125f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:22.662843 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 574/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Oct 31 14:09:22 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:09:24.801580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:24.802149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:24.802149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:24.803557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 582/1156] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:24.808933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf181d-0f92-4ae2-9580-36a49a720260 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:24.809363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf181d-0f92-4ae2-9580-36a49a720260 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:24.809515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf181d-0f92-4ae2-9580-36a49a720260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:24.874600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9cf181d-0f92-4ae2-9580-36a49a720260 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:24.875839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9cf181d-0f92-4ae2-9580-36a49a720260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:24.971722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 575/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:25.263015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:25.264515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:25.274269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:25.407277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e63f6-7b6a-4628-b99a-3849d7858cf7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:25.486116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:25.517400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:25.517931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:25.518201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:25.518463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:25.520054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:25.606964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:25.609135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c93f8-671b-4b8b-8be5-903581e75958 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:25.626301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 583/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:27.966853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:27.967435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:27.967435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:27.969401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 576/1159] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:27.974665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6690d33-7791-4512-82f5-141af36c7a4e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:27.975077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6690d33-7791-4512-82f5-141af36c7a4e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:27.975212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6690d33-7791-4512-82f5-141af36c7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:28.041945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d6690d33-7791-4512-82f5-141af36c7a4e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:28.043181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6690d33-7791-4512-82f5-141af36c7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:28.088399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:28.138364 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 584/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:28.422573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:28.424152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:28.448297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:28.526407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef036a0-39ab-455d-bf41-3b647aa29363 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:28.599040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:28.599618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:28.599891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:28.600155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:28.601718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:28.673535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:28.708371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:28.709812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a3b9-3eb4-4970-bbaa-93bd74e807dd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:28.728387 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 577/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:30.926112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:30.926760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:30.926760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:30.928025 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 585/1162] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:30.933465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74d2e-98a9-40a7-95e3-8ba7b0463494 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:30.933914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74d2e-98a9-40a7-95e3-8ba7b0463494 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:30.934017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74d2e-98a9-40a7-95e3-8ba7b0463494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:30.999613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9f74d2e-98a9-40a7-95e3-8ba7b0463494 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:31.000729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9f74d2e-98a9-40a7-95e3-8ba7b0463494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:31.095049 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:31.386469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:31.388021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:31.490733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b84dd8-b01d-49ff-b782-2113aa1f0f23 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:31.561673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:31.563137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:31.563795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:31.564071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:31.564343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:31.565923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:31.673575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:31.674966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ebd9e-7646-4f06-8588-a0ed3bbb43a3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:31.692334 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 586/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:34.015749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:34.016330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:34.016330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:34.017607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 579/1165] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:34.022808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a618-99e6-4b7a-b9a1-c235cc25d118 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:34.023212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a618-99e6-4b7a-b9a1-c235cc25d118 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:34.023357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a618-99e6-4b7a-b9a1-c235cc25d118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:34.090156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ed14a618-99e6-4b7a-b9a1-c235cc25d118 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:34.091388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ed14a618-99e6-4b7a-b9a1-c235cc25d118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:34.144415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:34.187498 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 587/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:34.482376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:34.483954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:34.519935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:34.585648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b42a9-1e12-4da6-893a-11e4a9f17b32 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:34.656625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:34.657217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:34.657491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:34.657757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:34.659358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:34.740342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:34.770132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:34.771704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b11b0-fad6-4a3b-a125-a403721795b8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:34.790221 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 580/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:37.302949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:37.303532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:37.303532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:37.304804 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 588/1168] 10.222.0.13 () {54 vars in 927 bytes} [Mon Oct 31 14:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:09:37.310162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0c25-fca7-480a-a604-3abf3c0efd91 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:37.310563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0c25-fca7-480a-a604-3abf3c0efd91 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:37.310851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf0c25-fca7-480a-a604-3abf3c0efd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:37.375620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-abcf0c25-fca7-480a-a604-3abf3c0efd91 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:09:37.376798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abcf0c25-fca7-480a-a604-3abf3c0efd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:37.470216 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 581/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Mon Oct 31 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:09:37.767631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:09:37.769147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:37.872032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8a99-e029-41cd-9a93-6ca303a6d19a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:09:37.945763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:09:37.946363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:09:37.946653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:09:37.946925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:09:37.948516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:09:37.957811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:38.057719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:09:38.059126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9da1f-24b7-4524-b0ae-0cd5618c3ce4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:09:38.077839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 589/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:09:47.468713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:09:48.075122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=50 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:22.956944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:22.958203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:22.958203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.036627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:11:23.037719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:23.136339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 582/1171] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:11:23.144202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.145259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.145372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.164742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:11:23.165905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:23.174029 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 590/1172] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:11:23.178491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.187857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba68882-ee14-43bf-b8b7-79b733cb584d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.192959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.193539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.193813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.194078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.194741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:11:23.195039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.196060 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:11:23.196060 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:11:23.196060 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:11:23.196931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.208547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 583/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:11:23.217821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.226798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15af6-2d1e-4ebe-a45e-6b65d8f06767 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.231200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.231779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.232050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.232314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.232938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.233935 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:11:23.233935 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:11:23.233935 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:11:23.235149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.357764 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 591/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:11:23 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:11:23.361859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.372532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae2d3-0662-4195-a4c3-1bc82547b617 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.422382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:23.429499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.430095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.430401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.430709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.431339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.432345 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:11:23.432345 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:11:23.432345 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:11:23.433580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.487739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 584/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:11:23 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:11:23.492396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.502402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c538c5-4ebd-441a-9078-2b06de930042 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.507574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.508154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.508427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.508694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.509323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.510957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.524987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 592/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:11:23.529158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.538939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dc22e-2814-4f01-ad6c-5f68ae9a3f7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.543551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.544138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.544414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.544682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.545316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.546994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588e06-9293-4743-9d2e-3776d428923c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.560670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 585/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:11:23.564666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.575150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d6bbc-5c50-4bb3-ad5b-ecfe155b9939 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.579708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.580341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.580612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.580879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] PATH_INFO: `/v3/projects/d4a1f49fdab4401281a6333ed31dfb69/users/36ddf8b823a94fb7a5a6601c5b9f7872/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.595606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a1f49fdab4401281a6333ed31dfb69, user_id=36ddf8b823a94fb7a5a6601c5b9f7872, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.598897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bb69e-75be-483a-a0a7-f1e800ec1c97 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.669684 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 593/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:11:23 2022] PUT /identity/v3/projects/d4a1f49fdab4401281a6333ed31dfb69/users/36ddf8b823a94fb7a5a6601c5b9f7872/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:11:23.680552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7599-0d2f-4829-827f-5e63a7acbed0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.680832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7599-0d2f-4829-827f-5e63a7acbed0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.681216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7599-0d2f-4829-827f-5e63a7acbed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.709751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d5c7599-0d2f-4829-827f-5e63a7acbed0 None None] MFA Rules not processed for user `36ddf8b823a94fb7a5a6601c5b9f7872`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:11:23.710974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d5c7599-0d2f-4829-827f-5e63a7acbed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:23.772692 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 586/1179] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:11:23.786102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e241-1ddc-47cf-85a9-b5a25294ad3e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.786388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e241-1ddc-47cf-85a9-b5a25294ad3e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.786690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e241-1ddc-47cf-85a9-b5a25294ad3e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.788038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 594/1180] 10.222.0.13 () {54 vars in 963 bytes} [Mon Oct 31 14:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:11:23.792897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbcf5-fee7-4971-80b0-b200b55a7da1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.793186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbcf5-fee7-4971-80b0-b200b55a7da1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.793464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbcf5-fee7-4971-80b0-b200b55a7da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.852562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5eccbcf5-fee7-4971-80b0-b200b55a7da1 None None] MFA Rules not processed for user `e4f863d5b33d4f10a053481933f03555`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:11:23.853779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5eccbcf5-fee7-4971-80b0-b200b55a7da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:23.927939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 587/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 31 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:11:23.935604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7e241-1ddc-47cf-85a9-b5a25294ad3e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:23.946632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7e241-1ddc-47cf-85a9-b5a25294ad3e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:23.950057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:23.950673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:23.950960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:23.951234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:23.960151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:23.961573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:23.970307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 595/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:11:24.017115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b8af-fbe6-494e-9156-3e9a2aa28092 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:24.017559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b8af-fbe6-494e-9156-3e9a2aa28092 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:24.017666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b8af-fbe6-494e-9156-3e9a2aa28092 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:24.018956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 588/1183] 10.222.0.13 () {52 vars in 830 bytes} [Mon Oct 31 14:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:11:24.022670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:24.084807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1bff7-ca89-4d66-ab6c-deaaa3ceb3a9 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:24.089398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:24.090018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:24.090300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:24.090574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] PATH_INFO: `/v3/users/36ddf8b823a94fb7a5a6601c5b9f7872` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:24.091722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ddf8b823a94fb7a5a6601c5b9f7872)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:24.092736 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:11:24.092736 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:11:24.092736 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:11:24.093941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:24.307602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ddf8b823a94fb7a5a6601c5b9f7872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:24.308257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ddf8b823a94fb7a5a6601c5b9f7872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:24.396421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ddf8b823a94fb7a5a6601c5b9f7872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:24.420288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ddf8b823a94fb7a5a6601c5b9f7872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:24.421043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ddf8b823a94fb7a5a6601c5b9f7872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:24.431491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:24.441278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 596/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:11:24 2022] DELETE /identity/v3/users/36ddf8b823a94fb7a5a6601c5b9f7872 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:11:24.451678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:24.451678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:24.451678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:24.466196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:11:24.467500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:24.476624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:24.524944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 589/1185] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:11:24.535242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:24.536663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:24.613800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34fd-369a-4bae-ba39-bd9816ef2348 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:24.617350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:24.618003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:24.618480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:24.618990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:24.628539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:24.630490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404590d0-62d9-4f51-a945-30a984048c5f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:24.639814 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 597/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:11:25.141234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:11:25.142719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:11:25.155503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c59a3c-a8a4-4f60-afab-07100f0590ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:11:25.160245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:11:25.160916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:11:25.161284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:11:25.161531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] PATH_INFO: `/v3/projects/d4a1f49fdab4401281a6333ed31dfb69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:11:25.164589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a1f49fdab4401281a6333ed31dfb69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:11:25.164589 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:11:25.164589 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:11:25.164589 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:11:25.164841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:11:25.277092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a1f49fdab4401281a6333ed31dfb69', 'request_id': 'req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:25.345187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a1f49fdab4401281a6333ed31dfb69', 'request_id': 'req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:25.351808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a1f49fdab4401281a6333ed31dfb69', 'request_id': 'req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:25.370237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] The token cache is being invalidate because project d4a1f49fdab4401281a6333ed31dfb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:11:25.370524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:25.371201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ee168ef-cffd-44a5-ae4b-fa086b22d0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:11:25.372862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 590/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:11:25 2022] DELETE /identity/v3/projects/d4a1f49fdab4401281a6333ed31dfb69 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:11:34.635609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=38 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:11:35.367240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:37.618188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0cf8-9009-4e45-8381-a57dc226b3f7 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:37.618857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0cf8-9009-4e45-8381-a57dc226b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:37.618857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0cf8-9009-4e45-8381-a57dc226b3f7 None None] PATH_INFO: `/v3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:37.620163 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 598/1188] 10.222.0.25 () {54 vars in 925 bytes} [Mon Oct 31 14:14:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:14:37.648662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86452a-a084-435c-bfc1-46c0e0e00ef9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:37.649119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86452a-a084-435c-bfc1-46c0e0e00ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:37.649227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86452a-a084-435c-bfc1-46c0e0e00ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:37.700521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b86452a-a084-435c-bfc1-46c0e0e00ef9 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:14:37.701716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b86452a-a084-435c-bfc1-46c0e0e00ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:14:37.772645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 591/1189] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:14:40.698385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d490-b25f-4b19-a810-046d3e1757c2 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:40.699028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d490-b25f-4b19-a810-046d3e1757c2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:40.699028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d490-b25f-4b19-a810-046d3e1757c2 None None] PATH_INFO: `/v3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:40.700212 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 599/1190] 10.222.0.39 () {54 vars in 925 bytes} [Mon Oct 31 14:14:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:14:40.707748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c233d-2442-431f-9821-ce4bed85fb49 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:40.708217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c233d-2442-431f-9821-ce4bed85fb49 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:40.708323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c233d-2442-431f-9821-ce4bed85fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:40.727403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d82c233d-2442-431f-9821-ce4bed85fb49 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:14:40.728569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d82c233d-2442-431f-9821-ce4bed85fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:14:40.736905 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 592/1191] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 31 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:14:41.600592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2086a-b509-45cb-b508-98b146a89374 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:41.600887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2086a-b509-45cb-b508-98b146a89374 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:41.601159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2086a-b509-45cb-b508-98b146a89374 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:41.602590 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 600/1192] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:14:41.607680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:41.607966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:41.608242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:41.628030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:14:41.629729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:14:41.638429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 593/1193] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:14:41.646753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2086a-b509-45cb-b508-98b146a89374 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:14:41.660274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2086a-b509-45cb-b508-98b146a89374 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:14:41.665164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:14:41.665750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:41.666024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:41.666293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:41.674557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:14:41.676156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40103f-d788-416b-865e-96ae810a7647 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:14:41.685426 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 601/1194] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:14:44.287387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:14:44.297374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56e06c-0710-48a4-a3f5-858e50b8064a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:14:44.302988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:14:44.303586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:14:44.303865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:14:44.304135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:14:44.312218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:14:44.313871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1518ee-8806-4fb3-a023-a0e08e07a13e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:14:44.323880 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 594/1195] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:14:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:14:51.681599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:14:54.320016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=56 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:18.048178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:18.048724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:18.048724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:18.049983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 602/1196] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:15:18.055110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d327c-a010-44ad-a077-2a9cf9c8944e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:18.055555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d327c-a010-44ad-a077-2a9cf9c8944e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:18.055655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d327c-a010-44ad-a077-2a9cf9c8944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:18.075174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c11d327c-a010-44ad-a077-2a9cf9c8944e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:15:18.076359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c11d327c-a010-44ad-a077-2a9cf9c8944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:18.134419 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 595/1197] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:15:18.289185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:15:18.290940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:18.392458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64c11f-54c1-4f5a-8346-a3a16525c020 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:15:18.398660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:15:18.399262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:18.399538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:18.399808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:18.407839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:15:18.409471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79fe07-952e-4101-9194-78e7b2195a86 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:15:18.418891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 603/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:15:19.493765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4170-4abb-4a80-a20d-4a4390c15a6e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:19.494339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4170-4abb-4a80-a20d-4a4390c15a6e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:19.494339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4170-4abb-4a80-a20d-4a4390c15a6e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:19.495672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 596/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:15:19.500431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b525a0-0c74-4017-813f-63fb727ecb4c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:19.500866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b525a0-0c74-4017-813f-63fb727ecb4c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:19.500963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b525a0-0c74-4017-813f-63fb727ecb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:19.519916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-52b525a0-0c74-4017-813f-63fb727ecb4c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:15:19.521615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52b525a0-0c74-4017-813f-63fb727ecb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:19.529307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 604/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:15:19.679831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4170-4abb-4a80-a20d-4a4390c15a6e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:15:19.693711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4170-4abb-4a80-a20d-4a4390c15a6e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:15:19.699040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:15:19.699625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:19.699901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:19.700161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:19.708996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:15:19.710748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d36c7a-91fc-4ebc-9bdc-0665c2af6ecb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:15:19.720314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 597/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:15:23.793911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:23.794464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:23.794464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:23.795833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 605/1202] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:15:23.800981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbc5e-065f-4eaa-a153-34101425273c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:23.802003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbc5e-065f-4eaa-a153-34101425273c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:23.802124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbc5e-065f-4eaa-a153-34101425273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:23.821132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-822cbc5e-065f-4eaa-a153-34101425273c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:15:23.822311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-822cbc5e-065f-4eaa-a153-34101425273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:23.829969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 598/1203] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:15:24.118202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:15:24.120007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:24.178311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeac75-8137-4dca-83f5-eff6c9e572d8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:15:24.181779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:15:24.182371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:24.182668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:24.182941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:24.191657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:15:24.193105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ac3e9-d644-4444-aeed-8d5260b9b943 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:15:24.202252 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 606/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:15:26.337577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae83d9-5955-4be5-819a-d36ed77b78c9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:26.338150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae83d9-5955-4be5-819a-d36ed77b78c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:26.338150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae83d9-5955-4be5-819a-d36ed77b78c9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:26.339484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 599/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 14:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:15:26.344627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf234-3079-4f1a-b8b2-cbd1751c2ec3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:26.345034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf234-3079-4f1a-b8b2-cbd1751c2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:26.345172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf234-3079-4f1a-b8b2-cbd1751c2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:26.364840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b35cf234-3079-4f1a-b8b2-cbd1751c2ec3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:15:26.366035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b35cf234-3079-4f1a-b8b2-cbd1751c2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:15:26.373660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 607/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 14:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:15:26.664213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae83d9-5955-4be5-819a-d36ed77b78c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:15:26.674770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae83d9-5955-4be5-819a-d36ed77b78c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:15:26.678245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:15:26.678871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:15:26.679146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:15:26.679416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:15:26.687955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:15:26.689365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c175a3-40ba-4e45-8790-930b7cd3ab29 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:15:26.698971 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 600/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:15:36.359546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=78 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:15:36.694877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=42 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:17.119131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd561a-d1ea-4762-876d-3e894d7f605f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:17.119677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd561a-d1ea-4762-876d-3e894d7f605f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:17.119677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd561a-d1ea-4762-876d-3e894d7f605f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:17.120940 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 608/1208] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:17.126661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d3c-815d-410e-92c7-f44a057e85f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:17.127122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d3c-815d-410e-92c7-f44a057e85f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:17.127342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d3c-815d-410e-92c7-f44a057e85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:17.148576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d17f0d3c-815d-410e-92c7-f44a057e85f8 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:17.149853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d17f0d3c-815d-410e-92c7-f44a057e85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:17.158644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 601/1209] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:27.142967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:48.926369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1e1b-ece3-434e-9cd6-908bd1b67b26 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:48.927531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1e1b-ece3-434e-9cd6-908bd1b67b26 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:48.928038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1e1b-ece3-434e-9cd6-908bd1b67b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:48.953228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cc4a1e1b-ece3-434e-9cd6-908bd1b67b26 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:48.957716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cc4a1e1b-ece3-434e-9cd6-908bd1b67b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:48.971240 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 609/1210] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:48.981307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055f9e7-9e88-4b35-8671-3c5133e441e0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:48.981874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055f9e7-9e88-4b35-8671-3c5133e441e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:48.981874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055f9e7-9e88-4b35-8671-3c5133e441e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:48.998877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:48.999549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.000107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.018139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8055f9e7-9e88-4b35-8671-3c5133e441e0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.018139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8055f9e7-9e88-4b35-8671-3c5133e441e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.032031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.033289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.039016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 602/1211] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.055416 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 610/1212] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:16:49.059190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.059190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.059190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.062887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.083224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51ebd3-9e90-46d8-bcde-2c29e9507960 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.094421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.094956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.095233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.095506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.095771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.096174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.096476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.097390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.097524 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:16:49.097524 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:16:49.097524 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:16:49.098413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.120149 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 603/1213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:16:49.122410 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 611/1214] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:16:49.124783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.137435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.146102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9ab6-762f-4939-a044-591ca42a6769 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.163816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579c93f-d002-46dd-949d-3b8e6f1ff3cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.167440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.168079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.168358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.168635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.169302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.169605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.173501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.190318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 604/1215] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.192120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.193056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.193338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.193917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.194577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.196673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c1ffa-f9b3-4112-a1d9-2bcea8cdd3ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.199041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.221373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b292ee-93bb-45fb-8291-a406331cf037 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.239643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.240194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.240476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.240844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.241492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.242515 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:16:49.242515 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:16:49.242515 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:16:49.243776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b2fd-d40e-4275-9306-d723f18e6cab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.309225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 612/1216] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:16:49.310364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.310675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.310953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.339255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.340449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.368346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 605/1217] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:49.369886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844d0d-ae00-4142-9775-108e23b8d024 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.370023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844d0d-ae00-4142-9775-108e23b8d024 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.370340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844d0d-ae00-4142-9775-108e23b8d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.406651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79844d0d-ae00-4142-9775-108e23b8d024 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.408137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79844d0d-ae00-4142-9775-108e23b8d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.424710 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 613/1218] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.425964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.436466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7c47-7c72-4c7b-aac9-108167ffde06 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.476620 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 606/1219] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.478897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.479430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.480297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.501222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.501757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.502035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.502525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.503209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.504338 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:16:49.504338 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:16:49.504338 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:16:49.505553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028e86-426e-47db-84e5-1817b55ef5d9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.508466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.509610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.518361 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 607/1220] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.519383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.529941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98319776-9369-4def-aa89-62cd4b0b2879 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.534794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.535381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.535660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.535933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.536667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.538669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092b368-eefb-4104-9e4e-78f793c32d20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.577348 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 614/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:49.578694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752bba1-52dc-4bcc-a142-a6ac005f1f59 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.585141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752bba1-52dc-4bcc-a142-a6ac005f1f59 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.585141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752bba1-52dc-4bcc-a142-a6ac005f1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.599668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1752bba1-52dc-4bcc-a142-a6ac005f1f59 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.600962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1752bba1-52dc-4bcc-a142-a6ac005f1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.609053 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 615/1222] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.610184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d94ab-1e7c-4915-a753-c7a9aaa5b071 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.610500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d94ab-1e7c-4915-a753-c7a9aaa5b071 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.610816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d94ab-1e7c-4915-a753-c7a9aaa5b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.623511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 608/1223] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:49.630907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a067f4-ca65-4229-9c2a-4918aabf2f17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.630907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a067f4-ca65-4229-9c2a-4918aabf2f17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.630907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a067f4-ca65-4229-9c2a-4918aabf2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.631890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2f5d94ab-1e7c-4915-a753-c7a9aaa5b071 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.632382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f5d94ab-1e7c-4915-a753-c7a9aaa5b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.641160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 616/1224] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.642455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a80b2-f77a-43bb-bdd5-74556990b0d9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.643342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a80b2-f77a-43bb-bdd5-74556990b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.643627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a80b2-f77a-43bb-bdd5-74556990b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.646247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f2a067f4-ca65-4229-9c2a-4918aabf2f17 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.648057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2a067f4-ca65-4229-9c2a-4918aabf2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.656639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 609/1225] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.657837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.658125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.658398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.664604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a70a80b2-f77a-43bb-bdd5-74556990b0d9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.665775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a70a80b2-f77a-43bb-bdd5-74556990b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.674781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 617/1226] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.682465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438ce65-4824-4e8c-958b-5a5d1f01c3f5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.682465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438ce65-4824-4e8c-958b-5a5d1f01c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.682465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438ce65-4824-4e8c-958b-5a5d1f01c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.682888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.682888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.688644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 610/1227] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.689631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.697208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5438ce65-4824-4e8c-958b-5a5d1f01c3f5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.698532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5438ce65-4824-4e8c-958b-5a5d1f01c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.703477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19d79-0beb-4504-940d-6cbaacb95f24 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.706975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 618/1228] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.711991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057976-4d90-4e74-961c-b8688862ef40 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.712278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057976-4d90-4e74-961c-b8688862ef40 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.712577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057976-4d90-4e74-961c-b8688862ef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.715449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.716169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.716450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.716720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.717500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.719125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.730525 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 611/1229] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:49.731456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.733830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-75057976-4d90-4e74-961c-b8688862ef40 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.735116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-75057976-4d90-4e74-961c-b8688862ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.743378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f407f1-b530-4997-9c84-48a8f0f92d77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.743866 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 619/1230] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.745034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.745318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.745708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.751486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.752019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.752297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.752568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.753200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.754822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.765022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.765319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 612/1231] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:49.766126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.766261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.775200 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 620/1232] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.775978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.777039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a83e3-5708-4784-aecc-5cc674db6fd0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.780569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:49.781883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.782510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.782820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.783096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.783733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.784036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.785610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27e87c-c750-473f-98cc-de57983301be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.785990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b47f0-22a6-40c7-a8ee-544b83154dce None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.790966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.794233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.794233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.794233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.794233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.794233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.794699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.798327 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 613/1233] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.799599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.799878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.800152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.819377 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 621/1234] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.819377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.823378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba87d1-4bf4-440c-a8de-4eee75d77961 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.825712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:49.827029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:49.827959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.828543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.828825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.829127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.829762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.830070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.831741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.834962 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 614/1235] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:49.835740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.851073 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 622/1236] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.851073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.851381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2b94-3550-4b79-9f60-55425bc74d80 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.851381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.851381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.851381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.851723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.852140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.853728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.855129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f73424-a1a4-41f6-bd86-c6cf2f03c3e0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.859844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.860425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.860719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.860975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.861600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.861898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.863506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.864434 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 615/1237] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:49.865469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.876088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-40cc-4ec8-9653-62369b3fbf62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.876621 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 623/1238] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.877509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.880639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.881860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.882149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.882761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.883396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.885557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.887888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e1cd-d7a6-428c-9085-48cefe04d3da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.892671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.893257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.893537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.894220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.894885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:49.895192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.895648 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 616/1239] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:49.896205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.896785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.907313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd073-f7cd-4697-af39-6aa11ca3e714 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.916243 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 624/1240] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:49.916243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:49.916515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.916515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.916515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.916515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.916848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.916848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:49.920222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f459-768e-478e-99a6-8fde1d06c514 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:49.924892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:49.925467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:49.925745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:49.926019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:49.926423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:49.926655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:49.929079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.053608 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 617/1241] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.054564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.081825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 625/1242] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:49 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.083074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.123687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078ad31-93ca-43a4-a8cd-65523382d6d4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.146059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6e64-d781-4d31-8c66-3fc0aa09eb6c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.151089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.151689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.151970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.152241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.152863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.154862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.182365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.183018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.183319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.183592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.184235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:50.184535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.186188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.197678 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 618/1243] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:50.198436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.208555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95757-ef7f-4b71-9c93-a1172748ac23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.213101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.213748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.214025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.214293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] PATH_INFO: `/v3/projects/3bf56238ad814d74872b58fc538861b3/users/216bdda9123846b182dde878d34d152d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.229364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf56238ad814d74872b58fc538861b3, user_id=216bdda9123846b182dde878d34d152d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.232049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.281540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 626/1244] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.282341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.312570 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 619/1245] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:50 2022] PUT /identity/v3/projects/3bf56238ad814d74872b58fc538861b3/users/216bdda9123846b182dde878d34d152d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:50.312570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.345159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d666-bf67-47d6-a088-986d4fa25b1b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.362559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:50.381828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0f692-6a3a-42e6-af83-f1235d1e8d3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.386546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.387281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.387638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.387906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] PATH_INFO: `/v3/projects/00c0158bb115492eb04ab83a4cd824d6/users/1b12dc29f05a4a7886d1e5673a1bbbd6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.400126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:50.402163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.402798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.403076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.403354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.403979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.404159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c0158bb115492eb04ab83a4cd824d6, user_id=1b12dc29f05a4a7886d1e5673a1bbbd6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.405897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.406849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.513945 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 620/1246] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:50 2022] PUT /identity/v3/projects/00c0158bb115492eb04ab83a4cd824d6/users/1b12dc29f05a4a7886d1e5673a1bbbd6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:50.514770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.546662 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 627/1247] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/projects => generated 397 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.546662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.576936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf872-e99b-4e6b-b937-37abad504291 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.606306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0caf7-1926-403e-9a45-6abc9af67ace admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.610939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.611536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.611811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.612081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.612704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.614669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.630800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.631433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.631715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.634355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.634355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.634534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.685102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 628/1248] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.686112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.695413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfd293-b548-4c03-9d23-f141e803f25a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.699870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.700428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.700706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.700973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.701572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.703524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.727760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 621/1249] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.729025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.783332 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 629/1250] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.784233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:50.792379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4296b1-dbef-470a-b680-be9c234ad4ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.794813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd248d-26c6-4195-a09d-43e76c6c3c13 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:50.797353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.797961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.798308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.798583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.799247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.799426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:50.800016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.800297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.800568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.801188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:50.801336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9040ea-dd7a-49c0-aafd-1ee772cbd29c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.803257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c7e4-417e-4390-ab2e-6e0a2478c4eb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:50.891563 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 630/1251] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.892965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.893250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.893521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.916138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 622/1252] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:50.917405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:50.917643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:50.917910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:50.922493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] MFA Rules not processed for user `216bdda9123846b182dde878d34d152d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:50.923731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:50.930704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:50.945339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] MFA Rules not processed for user `1b12dc29f05a4a7886d1e5673a1bbbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:50.946514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:50.972104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:50.989948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 631/1253] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:50.990778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.015161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 623/1254] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:51.016204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.056028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d427782-3080-4e17-abd5-5a0dfd33aa30 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.060612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.061213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.061489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.062095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.062753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.064691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.080028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94a0f1-9d56-4c9a-b3af-81e0021b7c6f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.085151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.088446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.088446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.088446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.088446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.088803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.098250 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 624/1255] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.099100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.108009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ddbd-c358-494b-af6c-3913f95f4907 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.112458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.112997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.113268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.113533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.114122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.116004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.146483 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 632/1256] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:50 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.146483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.154437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095737-0a8d-4f3b-b967-5b887667b276 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.159000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.159571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.159844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.160108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.160728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.162314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.172326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 633/1257] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.173082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.182201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef97912-3d72-41d6-a737-82d0f03c9eaa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.186684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.187246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.187520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.187786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.188371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.189868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.200595 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 634/1258] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.201327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.210917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9bc04-645a-4729-b47d-14a51cd9c5cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.215357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.215892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.216200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.216470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.217067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.218943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.223689 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 625/1259] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.223689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.234235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3055-a28f-4770-bd38-00ac83896727 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.238778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.239353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.239625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.239906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.240493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.242902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.307177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 635/1260] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.307177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.314223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fdb2b-1e16-4372-9d21-6f43e616e6d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.320046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.322840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.322840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.322840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.322840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.323357 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 626/1261] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.323478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.324336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.375142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:51.385666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a41ee-c13e-44a4-9979-168a5da053f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.390683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.391293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.391644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.391921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.392551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.394214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.404831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 627/1262] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.405565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.415760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac6766-6098-461c-bece-f2d7adeb3e6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.420259 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 636/1263] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.420259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.421971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.422564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.422869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.423137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.423898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.425537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.436382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 628/1264] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.437209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.449409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2bbe-4edc-4d88-9ecb-36da9f590860 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.483464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5aa4-c8b9-4fbc-9c75-62cf0e6d25e6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.488360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.488965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.489243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.489514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.490148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.492341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.502432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 637/1265] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.503274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.505022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.505796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.506894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.507175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.507810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.509406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.513283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae014-763f-43f4-9263-f7571df327a4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.518322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.518930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.519206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.519417 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 629/1266] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.519549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.520089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.520265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.521669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.529720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35391d-2844-4dfb-b48e-426238c38052 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.531594 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 638/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.532314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.536953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:51.537814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.538424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.538753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.539036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.540043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.541668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.543514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46aa7-32e2-479c-93c0-842d81438ea2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.549475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.549475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.549475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.549788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.550434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.551596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 630/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.552541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.553588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.563162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb21ce-6dd6-413c-a69f-9bf2bdc64b23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.567897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.568531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.569351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.569645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] PATH_INFO: `/v3/projects/fdbf9550103848c7a635aab654594f3a/users/1b95a2ca22b242de98e605dc3d3a6119/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.584437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbf9550103848c7a635aab654594f3a, user_id=1b95a2ca22b242de98e605dc3d3a6119, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.587157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.623802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 639/1269] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.624653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.634064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63d97-40bc-4fb1-9928-4c92419fcafb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.638893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.639673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.640141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.640766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.641386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.643342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.655851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 631/1270] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:51 2022] PUT /identity/v3/projects/fdbf9550103848c7a635aab654594f3a/users/1b95a2ca22b242de98e605dc3d3a6119/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:51.655851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.708431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8473-3ae8-4ba7-acb4-4fcfe56c9c30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.713106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.713672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.713947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.714219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.714870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.716491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.727188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 632/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.727960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.736280 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 640/1272] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:51.736280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.740438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80b095-03b3-4fd3-a1e6-e9b45647ea8e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.742841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.743491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.743767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.744038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] PATH_INFO: `/v3/projects/20124268b4184ea1acd2e6739083bf07/users/c36464b029104224b1910fde95882e03/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.746629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102344-a22e-47a7-be2f-20736fd8abd6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.751371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.752076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.752414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.752748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] PATH_INFO: `/v3/projects/5d70666d05314990a04d8178e7ec929b/users/d84b156065f64bea8d49ed172496aa10/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.758770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20124268b4184ea1acd2e6739083bf07, user_id=c36464b029104224b1910fde95882e03, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.761419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.767546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d70666d05314990a04d8178e7ec929b, user_id=d84b156065f64bea8d49ed172496aa10, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.770190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.828620 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 633/1273] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:51 2022] PUT /identity/v3/projects/20124268b4184ea1acd2e6739083bf07/users/c36464b029104224b1910fde95882e03/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:51.829549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.842847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:51.845744 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 641/1274] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:51 2022] PUT /identity/v3/projects/5d70666d05314990a04d8178e7ec929b/users/d84b156065f64bea8d49ed172496aa10/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:51.846760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.894519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3d5a5-42df-4736-80e0-fa02119daa5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.914536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd37f-02bd-4f25-b289-99cd8d6c76ad admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.919459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.920061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.920338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.920610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.921244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.922885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.934038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 642/1275] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.934461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.944426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f95fb-2b9a-40b8-bdb7-820108a560a4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.949277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.949860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.950135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.950409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.951207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.952832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d544d1-9d2a-4e45-ae37-77dabcf282c0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.953904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.954508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.954816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.955081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.955708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:51.957271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:51.963724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 643/1276] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.964970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.965259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.966024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.967863 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 634/1277] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:51.968456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:51.978896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6413-2142-4fbd-a7d6-67774bcc1dc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:51.983811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:51.984464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:51.984739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:51.985006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] PATH_INFO: `/v3/projects/6aab05bad7ad4234976fe7f87403205f/users/a42ab28845dd4d78b8e7d7532b278bed/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:51.987058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:51.988261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:51.995795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 644/1278] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:51.999845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.000854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aab05bad7ad4234976fe7f87403205f, user_id=a42ab28845dd4d78b8e7d7532b278bed, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.003787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb27d-5b5b-42e2-8789-92c912f04d28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.009230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9c337-ba58-41c6-9fce-9f815adaefba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.013901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.014492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.014786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.015048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.015673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.017234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5fd50-0b3e-4320-8826-1e35439ab16e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.027673 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 645/1279] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:52.028855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.029132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.029404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.056674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] MFA Rules not processed for user `c36464b029104224b1910fde95882e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:52.057897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:52.069632 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 635/1280] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:51 2022] PUT /identity/v3/projects/6aab05bad7ad4234976fe7f87403205f/users/a42ab28845dd4d78b8e7d7532b278bed/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:52.070900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.071185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.071457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.099276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] MFA Rules not processed for user `d84b156065f64bea8d49ed172496aa10`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:52.101025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:52.129212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:52.132726 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 646/1281] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:52.136519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.143562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebede-f4bd-4e87-a80e-d93ed159c49a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.168667 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 636/1282] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:52.171476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.193104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:52.201242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.208832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.208832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.208832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] PATH_INFO: `/v3/projects/6f4f3f0e120047f7b5551138ea057b27/users/1b000dc2e8764770b3fd4d9a9830bfc6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.217149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4f3f0e120047f7b5551138ea057b27, user_id=1b000dc2e8764770b3fd4d9a9830bfc6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.219845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.236160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b980cf-1ca7-4489-877e-5aa2fbab1e54 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.240668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.241318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.241598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.241872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] PATH_INFO: `/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb/users/47ed4a24b02a4642b7f1fafd1e5cc31e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.256291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4037c12c9684e6ba0a9c59d4d098ffb, user_id=47ed4a24b02a4642b7f1fafd1e5cc31e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.259001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.296897 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 647/1283] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:52 2022] PUT /identity/v3/projects/6f4f3f0e120047f7b5551138ea057b27/users/1b000dc2e8764770b3fd4d9a9830bfc6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:52.297694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.338174 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 637/1284] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:52 2022] PUT /identity/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb/users/47ed4a24b02a4642b7f1fafd1e5cc31e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:52.341338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.358837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaab4c1-917a-4895-8387-81da903bb4ff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.393389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666d2a-5a36-4dda-a7a4-5f11872fd35c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.397754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.398358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.398660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.398938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.415035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.415692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.415971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.416246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] PATH_INFO: `/v3/projects/769ebe7a63954854b7b890abca721c3e/users/532b380fd71b43cb97b8b1a50f624413/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.430809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ebe7a63954854b7b890abca721c3e, user_id=532b380fd71b43cb97b8b1a50f624413, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.433483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120e24f-90ac-4e97-8108-669e94a533d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.458005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.460069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.469494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 638/1285] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:52.470252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.479540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6fc7a-2d05-43b4-bad4-a626999c5fd0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.484058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.484690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.484968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.485240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] PATH_INFO: `/v3/projects/083202bc18da4766a8a01cd45c2bd538/users/d096bc2c0c8f47539540c526dbe438c8/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.501246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=083202bc18da4766a8a01cd45c2bd538, user_id=d096bc2c0c8f47539540c526dbe438c8, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.506183 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 648/1286] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:52 2022] PUT /identity/v3/projects/769ebe7a63954854b7b890abca721c3e/users/532b380fd71b43cb97b8b1a50f624413/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:52.506317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.506414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.506414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.506414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.529284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:52.534820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] MFA Rules not processed for user `a42ab28845dd4d78b8e7d7532b278bed`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:52.534820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:52.589148 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 639/1287] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:52 2022] PUT /identity/v3/projects/083202bc18da4766a8a01cd45c2bd538/users/d096bc2c0c8f47539540c526dbe438c8/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:52.592908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.606570 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 649/1288] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:52.611353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.631875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:52.665177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c333-017d-4e13-889e-f24464053ecd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.669823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.670987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.671245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.671513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.672728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.674659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fad909-d379-4a09-b2bf-3db245eab91b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.678830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cde9f3-c06d-406e-9d12-9f0a9dba3cde None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.686197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.686844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.687124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.687394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.688039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.689964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.772989 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 640/1289] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:52.772989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a355-acc5-4a95-97f4-c2688acb6eca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.772989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a355-acc5-4a95-97f4-c2688acb6eca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.772989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a355-acc5-4a95-97f4-c2688acb6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.799519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 650/1290] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:52.799519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.804184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48a9a355-acc5-4a95-97f4-c2688acb6eca None None] MFA Rules not processed for user `1b000dc2e8764770b3fd4d9a9830bfc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:52.805496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48a9a355-acc5-4a95-97f4-c2688acb6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:52.888643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4633-ccc7-4799-8820-3665ab6ad778 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.893466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.894482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.894852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.895192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.895901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.897965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 641/1291] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:52.898271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.899236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.899524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.899793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.917921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 651/1292] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:52.919238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.931722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190e7c4-d18f-4a56-90d5-5b72f8fc08e7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.934045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] MFA Rules not processed for user `532b380fd71b43cb97b8b1a50f624413`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:52.935296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:52.938390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.939032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.939380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.939723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.940441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.942259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.953401 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 652/1293] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:52.953401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:52.966002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3a9e0-776f-4189-ac88-59d9e2d7eb6c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:52.971969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:52.973230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:52.973582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:52.973927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:52.974728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:52.977524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:52.992274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:53.020845 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 642/1294] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:53.022401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.033994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c128b-36bb-44ca-8614-f58dbbecb0f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.046960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.046960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.046960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.046960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.047434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.047434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.075132 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 653/1295] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:52 2022] POST /identity/v3/projects => generated 395 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.075968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.126282 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 643/1296] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.129107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.130326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:53.146579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0dd61-7950-4b1d-9cd7-3f167d42373e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.153621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.154169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:53.154498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.154881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.155223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.155940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.157954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.203809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f8a7-ffb0-4595-8112-a8291d56f092 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.240775 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 654/1297] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.241680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.253614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b43405-bc8a-40a6-9218-1135123d0ddd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.260743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.264125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.264125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.264421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.264536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.264536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] PATH_INFO: `/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb/users/47ed4a24b02a4642b7f1fafd1e5cc31e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.264708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.264708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.264905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4037c12c9684e6ba0a9c59d4d098ffb, user_id=47ed4a24b02a4642b7f1fafd1e5cc31e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.266971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.281397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 655/1298] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:53 2022] PUT /identity/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb/users/47ed4a24b02a4642b7f1fafd1e5cc31e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:53.282790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.347197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.348912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.358637 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 644/1299] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:53.364432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.368202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8683-2a5a-4a93-a2bd-e818c1a81b46 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.370415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee7ca7-ad4b-473c-8b89-d1d134315f6c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.373623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.374300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.374588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.374885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] PATH_INFO: `/v3/projects/083202bc18da4766a8a01cd45c2bd538/users/d096bc2c0c8f47539540c526dbe438c8/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.375725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.376597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.376977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.377087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083202bc18da4766a8a01cd45c2bd538, user_id=d096bc2c0c8f47539540c526dbe438c8, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.377427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.378148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.379787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.380275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.396139 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 656/1300] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:53 2022] PUT /identity/v3/projects/083202bc18da4766a8a01cd45c2bd538/users/d096bc2c0c8f47539540c526dbe438c8/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:53.397601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.477095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929acb5-d5b6-4c58-bc4b-015ed5103e66 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.478104 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 645/1301] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.479927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.481457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:53.570336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.571771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.571771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.572015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.572705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.575172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c1188-f53e-4a13-8e39-04eeb1c4109e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.578216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52a02-56fa-4dee-b743-4d7f3808a5d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.584553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.584553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.584553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.584932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.585460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.587196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.593562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:53.606284 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 646/1302] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:53.608325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.626635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f06462-dc42-4016-9e1b-cafdf3f7fbc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.632357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.633045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.633263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.633540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.634184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.636225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2376b-5c0c-4d7f-bff7-9daad9e2a7b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.651013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 647/1303] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:53.652388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.652741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.653079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.682713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] MFA Rules not processed for user `47ed4a24b02a4642b7f1fafd1e5cc31e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:53.683921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:53.692800 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 657/1304] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/users => generated 304 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.695129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34855e-d25a-42db-b904-af688662a782 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.695411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34855e-d25a-42db-b904-af688662a782 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.695683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34855e-d25a-42db-b904-af688662a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.753758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4f34855e-d25a-42db-b904-af688662a782 None None] MFA Rules not processed for user `d096bc2c0c8f47539540c526dbe438c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:53.755097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4f34855e-d25a-42db-b904-af688662a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:53.772951 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 648/1305] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:53.773914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.793832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3012d54-bfa3-4e6c-bb9d-5f24a94a07b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.798885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.799504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.799782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.800054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.800701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:53.802829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:53.891381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 658/1306] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:53.892521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34855e-d25a-42db-b904-af688662a782 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.904562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34855e-d25a-42db-b904-af688662a782 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.914674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:53.914674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:53.914674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:53.914674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] PATH_INFO: `/v3/projects/e3692bf623c7467bb70b13e09061ec88/users/e30797ae321d498e9fe224458d4dd557/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:53.918523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 649/1307] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:53 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:53.918523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:53.935722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559c89-5af4-4888-8a73-07e87936a889 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:53.936935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3692bf623c7467bb70b13e09061ec88, user_id=e30797ae321d498e9fe224458d4dd557, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.171240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.172329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.172329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.172329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.172329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] PATH_INFO: `/v3/projects/c3ed8da6387c49109d583c76c6088f6d/users/5fccff465af041299cce6697d83bab88/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.173120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ed8da6387c49109d583c76c6088f6d, user_id=5fccff465af041299cce6697d83bab88, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.173120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9a95d-52ff-4ec4-af6d-29c21caded92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.173394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 659/1308] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:53 2022] PUT /identity/v3/projects/e3692bf623c7467bb70b13e09061ec88/users/e30797ae321d498e9fe224458d4dd557/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.173394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 650/1309] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:53 2022] PUT /identity/v3/projects/c3ed8da6387c49109d583c76c6088f6d/users/5fccff465af041299cce6697d83bab88/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24222c5-cdb7-40ba-9549-036ae274df28 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24222c5-cdb7-40ba-9549-036ae274df28 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24222c5-cdb7-40ba-9549-036ae274df28 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 651/1310] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:54.173579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24222c5-cdb7-40ba-9549-036ae274df28 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.173898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb83c-7cee-4742-8d0e-8fa5877cb08b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.173898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:54.196317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24222c5-cdb7-40ba-9549-036ae274df28 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.206004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.207132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.207561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.207932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] PATH_INFO: `/v3/users/1b000dc2e8764770b3fd4d9a9830bfc6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.209258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b000dc2e8764770b3fd4d9a9830bfc6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.211276 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:16:54.211276 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:16:54.211276 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:16:54.213013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.213597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.214378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.214863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.215444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.216254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.218425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.232830 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 660/1311] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:54.238596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.249595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5168d-3c86-4f74-b713-e25a3b5a8cf0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.254750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.255346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.255623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.255939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.257136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.258828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2f9a-1439-4c96-aa9c-3609419c5ad2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.269354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 661/1312] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:54.270506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8559b2-43c1-4e5c-ba1b-a679fb003b95 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.270846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8559b2-43c1-4e5c-ba1b-a679fb003b95 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.271121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8559b2-43c1-4e5c-ba1b-a679fb003b95 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.272360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 662/1313] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:16:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:54.273141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8559b2-43c1-4e5c-ba1b-a679fb003b95 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.284847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8559b2-43c1-4e5c-ba1b-a679fb003b95 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.289591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.290133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.290410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.290708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.295143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.295143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.303900 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 663/1314] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:54.304659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.313670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848ab6-ccf2-4417-962a-267da3472183 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.318057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.318594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.319465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.319734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.323931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.323931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959f9ba-1e4a-451d-99c4-4f19f2753f82 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.331271 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 664/1315] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:54.332526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.332814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.333091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.379711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:54.381982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.430862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b000dc2e8764770b3fd4d9a9830bfc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:54.431876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b000dc2e8764770b3fd4d9a9830bfc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:54.435476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:54.465460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 665/1316] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:54.466484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.468341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.484992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c389a-13e5-4ad1-9707-645f2cddc40f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.491969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.492716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.493061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.493414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] PATH_INFO: `/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8/users/86ae84c5d5c34f39b4878cfad6a8e8f9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.508605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b000dc2e8764770b3fd4d9a9830bfc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:54.517428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2a7ebf89e4ea0acbf0b9de3970fb8, user_id=86ae84c5d5c34f39b4878cfad6a8e8f9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.523259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb56264-44de-4d5e-a48f-9e02d37693a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.535497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b000dc2e8764770b3fd4d9a9830bfc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:54.540403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b000dc2e8764770b3fd4d9a9830bfc6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:54.558573 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 652/1317] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:54 2022] DELETE /identity/v3/users/1b000dc2e8764770b3fd4d9a9830bfc6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.559536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.561526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.597488 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 666/1318] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:54 2022] PUT /identity/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8/users/86ae84c5d5c34f39b4878cfad6a8e8f9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.599172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.599455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.599725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.628527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:54.629766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.644987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88e69d-7259-4594-87f2-0166b8482e38 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.721471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.722150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.722429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.722729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] PATH_INFO: `/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c/users/ce0b76bcaff64f9bb77573043989d7ac/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.738009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 667/1319] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:54.739175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.740621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.742277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb83dd719afa4c5f8c4f6d73e8530b1c, user_id=ce0b76bcaff64f9bb77573043989d7ac, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.750817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.762744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe267d-21b2-44ca-ad81-0d55078a4892 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.769539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.770230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.770507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.770811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] PATH_INFO: `/v3/projects/e3692bf623c7467bb70b13e09061ec88/users/e30797ae321d498e9fe224458d4dd557/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.773681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3692bf623c7467bb70b13e09061ec88, user_id=e30797ae321d498e9fe224458d4dd557, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.776430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.795633 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 668/1320] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:54 2022] PUT /identity/v3/projects/e3692bf623c7467bb70b13e09061ec88/users/e30797ae321d498e9fe224458d4dd557/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.796417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.798101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.813455 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 653/1321] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:54 2022] PUT /identity/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c/users/ce0b76bcaff64f9bb77573043989d7ac/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.814492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.881577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3c1b-8df7-4d2d-aa3b-ef8ccdf03323 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.896739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377636da-ff1f-4753-8b53-1152c5e03dd8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:54.903745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.904383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.909000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.909000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.909000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:54.948598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:54.949271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.949545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.949812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] PATH_INFO: `/v3/projects/c3ed8da6387c49109d583c76c6088f6d/users/5fccff465af041299cce6697d83bab88/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.952158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ed8da6387c49109d583c76c6088f6d, user_id=5fccff465af041299cce6697d83bab88, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.955455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870566ed-ffae-4d47-891f-76aa02a90198 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.978370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 669/1322] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:54 2022] PUT /identity/v3/projects/c3ed8da6387c49109d583c76c6088f6d/users/5fccff465af041299cce6697d83bab88/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:54.978370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:54.978370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:54.978370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:54.979997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:54.981872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:54.992695 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 654/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:54.993809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:54.999093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:55.001151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.004755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e27e-9872-47bd-8d76-1481e42170ae service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.062430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.107686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.112157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.112635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.114150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.115876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.117864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efe8db-2ad2-4205-878a-f24cd5c63058 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.132444 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 670/1324] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:55.136429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 655/1325] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:55.137051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.137051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.137496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.142912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.205075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] MFA Rules not processed for user `e30797ae321d498e9fe224458d4dd557`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:55.206323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.276017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.278025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd576d3e-4fcf-4e14-a2c9-128c5566e014 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.301025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.301864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.302287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.302810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.304788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.316554 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 656/1326] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:55.317570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.333094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774bc6-2b2d-4b1d-9a06-67844a33bae6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.339978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.341553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.341903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.347434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.347434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.347434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5ba85-d5f5-4739-8307-a6df46c20eba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.356627 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 657/1327] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:55.357985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.358490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.359008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.387264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.387449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] MFA Rules not processed for user `5fccff465af041299cce6697d83bab88`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:55.388461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.388861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.395644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.401106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 671/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:55.401919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.412243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fe78-5285-42fb-9ec0-a3ff99fdda3d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.423424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.424718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.425903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.426337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] PATH_INFO: `/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8/users/86ae84c5d5c34f39b4878cfad6a8e8f9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.430754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2a7ebf89e4ea0acbf0b9de3970fb8, user_id=86ae84c5d5c34f39b4878cfad6a8e8f9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.434877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.453522 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 672/1329] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:55 2022] PUT /identity/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8/users/86ae84c5d5c34f39b4878cfad6a8e8f9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:55.454901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.457067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.472745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 658/1330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:55.473819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.504065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26fe35-0b11-4ab2-b8da-1411e8bae6bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.549291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c87b3-bc87-4539-ae2f-3e0b8e87ab1b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.556744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.558295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.559073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.561714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.594954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.595770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.596054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.596453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] PATH_INFO: `/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c/users/ce0b76bcaff64f9bb77573043989d7ac/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.599061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb83dd719afa4c5f8c4f6d73e8530b1c, user_id=ce0b76bcaff64f9bb77573043989d7ac, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.602610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888659-effb-48eb-9f38-ba5338f501bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.625658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 659/1331] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:55 2022] PUT /identity/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c/users/ce0b76bcaff64f9bb77573043989d7ac/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:55.625658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1c12-3dc4-492d-8c90-153ac67f015d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.625658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1c12-3dc4-492d-8c90-153ac67f015d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.625658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1c12-3dc4-492d-8c90-153ac67f015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.661935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6eff1c12-3dc4-492d-8c90-153ac67f015d None None] MFA Rules not processed for user `86ae84c5d5c34f39b4878cfad6a8e8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:55.668958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6eff1c12-3dc4-492d-8c90-153ac67f015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.669040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:55.669040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:55.683776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 673/1332] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:55.685263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:55.688315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.760941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.807089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eac5c0-94e1-4431-af50-1d35fce45e77 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:55.817849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 660/1333] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:55.825951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.826391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.826900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.871167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] MFA Rules not processed for user `ce0b76bcaff64f9bb77573043989d7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:55.872846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:55.907197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:55.908098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:55.908473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:55.908847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:55.911312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:55.992075 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 661/1334] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:55.993069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.009108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d099-06ae-49ab-94d3-22649faf7394 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.016283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:56.016710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.016960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:56.017067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.017250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.047949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.047949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf3c9-23b1-4ad1-a106-9b2221452852 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.078966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 674/1335] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:56.106128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.108199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.123480 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 662/1336] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:56.208610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.208899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.209170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.210681 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 675/1337] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:56.216660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:16:56.233045 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 31 14:16:56.233045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.326580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d07e-0d28-4773-8dd6-657f68d097a8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.333389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ed4a24b02a4642b7f1fafd1e5cc31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4037c12c9684e6ba0a9c59d4d098ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:56.334173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.334590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.334985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] PATH_INFO: `/v3/projects/3bf56238ad814d74872b58fc538861b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.336889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: Authorizing `identity:get_project(project_id=3bf56238ad814d74872b58fc538861b3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.340212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.342683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 663/1338] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:16:56 2022] GET /identity/v3/projects/3bf56238ad814d74872b58fc538861b3 => generated 379 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:56.420262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.425389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:56.502577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.520290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128c32-998b-43af-8d04-ce122428fd73 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.539683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:56.540884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.541257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.541630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.545087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41359f-e860-4954-8246-c084ed79bcad None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.550794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:56.551922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.552337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.552808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] PATH_INFO: `/v3/projects/6f4f3f0e120047f7b5551138ea057b27` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.555354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:56.555964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4f3f0e120047f7b5551138ea057b27)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.557557 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:16:56.557557 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:16:56.557557 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:16:56.559116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.559241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.560902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.581756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 664/1339] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:56.587111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.611485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cb43d-d142-4579-ab51-4eb1dbc7ac94 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.628459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:56.629204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:56.629652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:56.630024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:56.636740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:56.769694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4f3f0e120047f7b5551138ea057b27', 'request_id': 'req-934b8e77-ca65-4143-b86b-3f637ae5dec8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:56.809753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:56.811839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:56.829479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 665/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:56.859297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.875120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4f3f0e120047f7b5551138ea057b27', 'request_id': 'req-934b8e77-ca65-4143-b86b-3f637ae5dec8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:56.883815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64907663-c6f1-4ce7-80ed-4d2399ff02ef service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:56.885640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4f3f0e120047f7b5551138ea057b27', 'request_id': 'req-934b8e77-ca65-4143-b86b-3f637ae5dec8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:56.945446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] The token cache is being invalidate because project 6f4f3f0e120047f7b5551138ea057b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:16:56.945624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:56.947162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:56.949823 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 676/1341] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:56 2022] DELETE /identity/v3/projects/6f4f3f0e120047f7b5551138ea057b27 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:56.951768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:56.955164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.007947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:57.009435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.009884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.010593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] PATH_INFO: `/v3/users/532b380fd71b43cb97b8b1a50f624413` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.012644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] RBAC: Authorizing `identity:delete_user(user_id=532b380fd71b43cb97b8b1a50f624413)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:57.016058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:57.074344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8e77-ca65-4143-b86b-3f637ae5dec8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:57.081912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:57.082887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.083496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.085133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.088651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.107581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:57.170355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:57.172124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0783d-a9d3-4577-ad35-4a27f47801be service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:57.181994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 677/1342] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:57.183355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fe59-79ef-4529-8c4a-c39ba42db7bd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.183643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fe59-79ef-4529-8c4a-c39ba42db7bd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.183923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992fe59-79ef-4529-8c4a-c39ba42db7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.226647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c992fe59-79ef-4529-8c4a-c39ba42db7bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:57.227867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c992fe59-79ef-4529-8c4a-c39ba42db7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.259491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 678/1343] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:57.267977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.268407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.268722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.273066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532b380fd71b43cb97b8b1a50f624413'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.274335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532b380fd71b43cb97b8b1a50f624413'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.312785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:57.312785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.321708 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 679/1344] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:57.322736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:57.324274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.338518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10743c-278d-46c4-9fe5-03d2d07eb593 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:57.343517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:57.344276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.344719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.345059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] PATH_INFO: `/v3/users/c36464b029104224b1910fde95882e03` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.346272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36464b029104224b1910fde95882e03)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:57.348404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:57.361385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532b380fd71b43cb97b8b1a50f624413'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.380928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532b380fd71b43cb97b8b1a50f624413'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.382662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532b380fd71b43cb97b8b1a50f624413'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.398652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 666/1345] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:56 2022] DELETE /identity/v3/users/532b380fd71b43cb97b8b1a50f624413 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:57.398652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:57.408919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:57.480305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df405-308d-4d53-9acc-27003e25adec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:57.489453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:57.492728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.493713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.494099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.494885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:16:57.495360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:57.497162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafbb9b-9542-449b-b5ef-ad6bd33b87f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:57.514811 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 667/1346] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:57.516236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89ca5-1d4b-4335-b0e5-e5a52b0b3f86 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.516872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89ca5-1d4b-4335-b0e5-e5a52b0b3f86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.516872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89ca5-1d4b-4335-b0e5-e5a52b0b3f86 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.519918 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 668/1347] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:57.525316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda534-9b9f-4435-a6e6-1d7ad27d7d9f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.525628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda534-9b9f-4435-a6e6-1d7ad27d7d9f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.525901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda534-9b9f-4435-a6e6-1d7ad27d7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.530535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36464b029104224b1910fde95882e03'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.531810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36464b029104224b1910fde95882e03'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.550889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5eeda534-9b9f-4435-a6e6-1d7ad27d7d9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:57.552107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5eeda534-9b9f-4435-a6e6-1d7ad27d7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.560896 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 669/1348] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:57.561929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.562214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.562481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.563937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 670/1349] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:16:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:57.567506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:57.570132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.583573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36464b029104224b1910fde95882e03'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.594855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012baa0-2e73-477c-87ae-7ff648d7cfec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:57.600509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:57.601119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.601395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.601627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36464b029104224b1910fde95882e03'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.601740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.602334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:57.602647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36464b029104224b1910fde95882e03'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:57.604884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7d8c-9a7f-498c-9c61-b3fbccde2189 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:57.635682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 680/1350] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:57 2022] DELETE /identity/v3/users/c36464b029104224b1910fde95882e03 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:57.636937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:16:57.639018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.732319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 671/1351] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:57 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:57.733779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:57.734118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:57.734330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:57.783529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:57.784764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.804627 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 31 14:16:57.804627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:57.809390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.813340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:57.890607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 672/1352] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:57.891780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:57.896861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:57.902323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32efc0-4356-4cb1-8c24-5f3e8c2c5b90 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:57.999189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065ff5-10a6-46f4-a2e5-1bbbda69881f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.002901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47ed4a24b02a4642b7f1fafd1e5cc31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4037c12c9684e6ba0a9c59d4d098ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.003231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.003593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.003789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.003789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] PATH_INFO: `/v3/projects/3bf56238ad814d74872b58fc538861b3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.004871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.004979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: Authorizing `identity:get_project(project_id=3bf56238ad814d74872b58fc538861b3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.005514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.005863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.008319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d0fa7-b61a-4f6e-8a53-e2722e6297a4 tempest-FlavorsAccessTestJSON-1429034273 tempest-FlavorsAccessTestJSON-1429034273-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.025373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 681/1353] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:16:57 2022] GET /identity/v3/projects/3bf56238ad814d74872b58fc538861b3 => generated 379 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:16:58.028216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.030900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.031390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.057691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:58.082955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:58.085049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.115581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.117031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.155549 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 673/1354] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:58.155889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.164133 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 682/1355] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:58.164133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.164133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.184201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec809804-c25d-455d-955e-7e959d87e819 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.195800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c479-783e-40d2-8716-7d8cac6d41d1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.200083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.200964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.201310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.201805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.207813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.209864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.209864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.209864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.210741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.212783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.221703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.227520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.254737 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 683/1356] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:58.254737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.275639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde4735-ddbb-4e38-8977-aba8d2645f7f service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.288005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.288629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.288911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.289186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.305603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.307499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.322893 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 684/1357] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:58.356798 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 674/1358] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:58 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:58.361281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.376451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97885a1-64c9-4664-b891-6b657aadb918 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.382808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.385113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.385398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.387345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.387345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.390129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.414401 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 685/1359] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:58.417225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.428748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eaf09-1151-4f8f-add5-a58c8dda01b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.437957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.438857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.444244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.444244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.444244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.444244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3d9d4-2f26-41f4-97ed-d287e72f2f06 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.456574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 675/1360] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:16:58.461573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.492295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc04f-b4d1-47ed-b61a-b068a0991815 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.509508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.510317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.511156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.511342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] PATH_INFO: `/v3/projects/d2ca339a73544ce39507e91743c54bed/users/7ba9f2c654f3471db6a41451f9d72f0f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.527098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.527620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.527903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.546115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ca339a73544ce39507e91743c54bed, user_id=7ba9f2c654f3471db6a41451f9d72f0f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.552845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d41bb-2d57-448a-83ae-cbd20e3f0e5e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:58.553681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] MFA Rules not processed for user `1b12dc29f05a4a7886d1e5673a1bbbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:58.555194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.658030 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 686/1361] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:16:58 2022] PUT /identity/v3/projects/d2ca339a73544ce39507e91743c54bed/users/7ba9f2c654f3471db6a41451f9d72f0f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:58.658572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 676/1362] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:58.676238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.676908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.677249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.703907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.723262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.724369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:58.765753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] MFA Rules not processed for user `7ba9f2c654f3471db6a41451f9d72f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:58.767197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.855994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 687/1363] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:58.856466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:58.858019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:58.864772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5b04-f56f-4201-9119-d108cc25e266 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.961517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:58.966200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c466-9f7a-42bd-adeb-6ac4824e03f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:58.972291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:58.972655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:58.973153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:58.974122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] PATH_INFO: `/v3/users/216bdda9123846b182dde878d34d152d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:58.975696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=216bdda9123846b182dde878d34d152d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:58.977848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.031460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.032191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.032489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.032762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.035322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.125476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.127137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.166379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 677/1364] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:16:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:16:59.167462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.183035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216bdda9123846b182dde878d34d152d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.184070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216bdda9123846b182dde878d34d152d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.194440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b5ef-18bd-4b9b-bf72-8f2de4dad7dc service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.208088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.208851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.209134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.209444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.210083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.218191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.309001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216bdda9123846b182dde878d34d152d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.323150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216bdda9123846b182dde878d34d152d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.323980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216bdda9123846b182dde878d34d152d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.337441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 688/1365] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:58 2022] DELETE /identity/v3/users/216bdda9123846b182dde878d34d152d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:59.338279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.339637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.344934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:59.351598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 678/1366] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:16:59 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:59.352379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.354292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.409707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810787a-87c5-4cf1-8022-205701d15449 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.424420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a045-79ca-40e0-bc65-1c9edd5343b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.429960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.430599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.430905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.431181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] PATH_INFO: `/v3/projects/769ebe7a63954854b7b890abca721c3e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.441746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ebe7a63954854b7b890abca721c3e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.441746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.479234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.486200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.486200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.486200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] PATH_INFO: `/v3/projects/20124268b4184ea1acd2e6739083bf07` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.486200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20124268b4184ea1acd2e6739083bf07)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.486200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.576975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ebe7a63954854b7b890abca721c3e', 'request_id': 'req-816d458e-585d-46eb-a8a1-2501568095cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.606721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20124268b4184ea1acd2e6739083bf07', 'request_id': 'req-1d1d85a8-a6b3-4760-919d-bef145de6fc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.651667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ebe7a63954854b7b890abca721c3e', 'request_id': 'req-816d458e-585d-46eb-a8a1-2501568095cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.657797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ebe7a63954854b7b890abca721c3e', 'request_id': 'req-816d458e-585d-46eb-a8a1-2501568095cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.670356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] The token cache is being invalidate because project 769ebe7a63954854b7b890abca721c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:16:59.670708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.671379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-816d458e-585d-46eb-a8a1-2501568095cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.672883 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 679/1367] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:59 2022] DELETE /identity/v3/projects/769ebe7a63954854b7b890abca721c3e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:59.674055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.674332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.674648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.701752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] MFA Rules not processed for user `1b95a2ca22b242de98e605dc3d3a6119`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:59.702990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.709054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20124268b4184ea1acd2e6739083bf07', 'request_id': 'req-1d1d85a8-a6b3-4760-919d-bef145de6fc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.716151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20124268b4184ea1acd2e6739083bf07', 'request_id': 'req-1d1d85a8-a6b3-4760-919d-bef145de6fc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.728092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] The token cache is being invalidate because project 20124268b4184ea1acd2e6739083bf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:16:59.728375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.729034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d1d85a8-a6b3-4760-919d-bef145de6fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:16:59.730816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 689/1368] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:16:59 2022] DELETE /identity/v3/projects/20124268b4184ea1acd2e6739083bf07 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:16:59.732072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b8c0-56a0-4505-aad3-bccb0a415f00 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.732355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b8c0-56a0-4505-aad3-bccb0a415f00 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.732672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b8c0-56a0-4505-aad3-bccb0a415f00 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.734432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 690/1369] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:16:59.735345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.735757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.741435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.755840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:16:59.757112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.771359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 680/1370] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:59.772716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.773987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.819304 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 691/1371] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:16:59.819966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.821249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.833122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f0d2-7060-4057-9882-17a351eac290 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.838370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.839026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.839299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.839566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] PATH_INFO: `/v3/users/ce0b76bcaff64f9bb77573043989d7ac` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.840781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0b76bcaff64f9bb77573043989d7ac)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.841555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aad1f4-3879-4a18-a07b-c029bdc247b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.842816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.846145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.846779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.847058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.847330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.847956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.850701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:16:59.880859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:16:59.967149 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 681/1372] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:16:59 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:16:59.968069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:16:59.969632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:16:59.984929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6a01d-faea-461a-8bf1-f978d118d9bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:16:59.990699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:16:59.991413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:16:59.991759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:16:59.992105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] PATH_INFO: `/v3/users/e30797ae321d498e9fe224458d4dd557` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:16:59.993420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30797ae321d498e9fe224458d4dd557)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:16:59.995385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.102512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0b76bcaff64f9bb77573043989d7ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.103214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0b76bcaff64f9bb77573043989d7ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.182431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30797ae321d498e9fe224458d4dd557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.183138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30797ae321d498e9fe224458d4dd557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.195913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0b76bcaff64f9bb77573043989d7ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.211044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0b76bcaff64f9bb77573043989d7ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.211791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef14adce-e513-4f1c-94de-77091af96649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0b76bcaff64f9bb77573043989d7ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.224301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 692/1373] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:59 2022] DELETE /identity/v3/users/ce0b76bcaff64f9bb77573043989d7ac => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:00.225567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.225845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.226112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.247328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:00.248527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.283561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30797ae321d498e9fe224458d4dd557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.309438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30797ae321d498e9fe224458d4dd557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.310421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30797ae321d498e9fe224458d4dd557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:00.332082 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 682/1374] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:16:59 2022] DELETE /identity/v3/users/e30797ae321d498e9fe224458d4dd557 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:00.332082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.353418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.364206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 693/1375] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:00.364953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.369999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.378438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:00.463627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4979-5826-46ee-98d1-1d09d8a69968 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.475059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.475694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.476016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.476294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.476935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.479030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.496477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874bdad-f184-464e-9a36-ad29dad98b49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.532451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:00.558445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 683/1376] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:00 2022] POST /identity/v3/projects => generated 403 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:00.559856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.562882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.563672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.565465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.566062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.567675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.572340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.593727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.596763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.634530 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 694/1377] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:00.636384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.647883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:00.655392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:00.669472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4fdb-6e37-4545-bcc4-bf4b7b6585fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.678691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.679924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.683002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.683367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.685858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.686154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.698897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 684/1378] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:00.700082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.715555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a0ce-5650-462e-8e85-e8425e8c5137 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.723389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.725623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.726079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.726488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.727758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.731039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.814142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837d8bd-c24c-401b-8700-170de22879d2 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.829119 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 685/1379] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:00 2022] POST /identity/v3/users => generated 308 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:00.831918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.842946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc2e39-bcc5-4ea8-b184-1cbec05d62e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:00.848854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.850871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.851150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.851422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] PATH_INFO: `/v3/projects/5bb0c76542864a8f83ce7719407ba5de/users/adb981f54446460c914e637637bc4d56/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.874279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:00.875221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:00.875504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:00.884842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:00.885436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb0c76542864a8f83ce7719407ba5de, user_id=adb981f54446460c914e637637bc4d56, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.885436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.968552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:00.969978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:00.982372 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 695/1380] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:00.983075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:00.984399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.000698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52fce5-e317-49a8-81ce-aedd4ed6d3e9 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.006738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 686/1381] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:00 2022] PUT /identity/v3/projects/5bb0c76542864a8f83ce7719407ba5de/users/adb981f54446460c914e637637bc4d56/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.006738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.023511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:01.028351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:01.102442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.103126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.103402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.103671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] PATH_INFO: `/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.110254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb83dd719afa4c5f8c4f6d73e8530b1c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.112259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.156373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386ed67-ce7a-45c3-bc7a-d72bef854c86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.162275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.163485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.164246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.164246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.165127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.167185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.181754 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 687/1382] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:01.181754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.181754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.193506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971ea05-e1fd-44cd-88dd-122db247287a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.198162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.199298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.199591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.199851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] PATH_INFO: `/v3/projects/e3692bf623c7467bb70b13e09061ec88` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.200988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3692bf623c7467bb70b13e09061ec88)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.202933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.281563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb83dd719afa4c5f8c4f6d73e8530b1c', 'request_id': 'req-60115ded-1254-4443-93a2-cd7b9ac9eb9d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.306192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3692bf623c7467bb70b13e09061ec88', 'request_id': 'req-b1ea1f2b-2636-4664-aa88-1110531015a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.371897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb83dd719afa4c5f8c4f6d73e8530b1c', 'request_id': 'req-60115ded-1254-4443-93a2-cd7b9ac9eb9d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.380297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb83dd719afa4c5f8c4f6d73e8530b1c', 'request_id': 'req-60115ded-1254-4443-93a2-cd7b9ac9eb9d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.393194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] The token cache is being invalidate because project fb83dd719afa4c5f8c4f6d73e8530b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:01.393507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.394095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.396047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 696/1383] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:00 2022] DELETE /identity/v3/projects/fb83dd719afa4c5f8c4f6d73e8530b1c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.397570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.399620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.429830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3692bf623c7467bb70b13e09061ec88', 'request_id': 'req-b1ea1f2b-2636-4664-aa88-1110531015a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.440355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3692bf623c7467bb70b13e09061ec88', 'request_id': 'req-b1ea1f2b-2636-4664-aa88-1110531015a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.462962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] The token cache is being invalidate because project e3692bf623c7467bb70b13e09061ec88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:01.464045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.465708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.468657 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 688/1384] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:01 2022] DELETE /identity/v3/projects/e3692bf623c7467bb70b13e09061ec88 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.470074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.472377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.482730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60115ded-1254-4443-93a2-cd7b9ac9eb9d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.496642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:01.546789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.547155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1f2b-2636-4664-aa88-1110531015a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.547402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.547675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.547944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.548695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.550653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.552118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.552771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.553230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.553515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] PATH_INFO: `/v3/projects/938466b238384c99a84417bed70b3f7d/users/b1da3fe8004747d78cc13a5707451708/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.575451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938466b238384c99a84417bed70b3f7d, user_id=b1da3fe8004747d78cc13a5707451708, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.575925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 697/1385] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:01.577187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.578166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79805a-89a4-49e6-91f7-181555e995c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.582233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.604065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1056b-a10d-4c9b-a21e-7db49119f0ce admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.610062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.611089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.611371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.615504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] PATH_INFO: `/v3/projects/3bf56238ad814d74872b58fc538861b3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.615504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf56238ad814d74872b58fc538861b3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.615504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.672273 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 689/1386] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:01 2022] PUT /identity/v3/projects/938466b238384c99a84417bed70b3f7d/users/b1da3fe8004747d78cc13a5707451708/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.673251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ff20-2cb0-452f-94ba-c38f851ffadb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.673604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ff20-2cb0-452f-94ba-c38f851ffadb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.673940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ff20-2cb0-452f-94ba-c38f851ffadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.694133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3b72ff20-2cb0-452f-94ba-c38f851ffadb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:01.695480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b72ff20-2cb0-452f-94ba-c38f851ffadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.705573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:01.751673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf56238ad814d74872b58fc538861b3', 'request_id': 'req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.757954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 690/1387] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:01.759431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5a39-14bd-4a42-956c-0c206e3889f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.759721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5a39-14bd-4a42-956c-0c206e3889f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.760000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5a39-14bd-4a42-956c-0c206e3889f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.778897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-39bd5a39-14bd-4a42-956c-0c206e3889f3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:01.780098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39bd5a39-14bd-4a42-956c-0c206e3889f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.813241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf56238ad814d74872b58fc538861b3', 'request_id': 'req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.820971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf56238ad814d74872b58fc538861b3', 'request_id': 'req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.835188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] The token cache is being invalidate because project 3bf56238ad814d74872b58fc538861b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:01.835480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.836151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:01.840503 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 698/1388] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:01 2022] DELETE /identity/v3/projects/3bf56238ad814d74872b58fc538861b3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.840503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.840503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 691/1389] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 692/1390] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:01.857033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.859328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.878217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c8d42-0ead-4df4-a292-43567e6eec55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.884477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.885300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.885684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.886067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.886840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.889315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a6d05-ba46-4b98-9ac6-d7293a5d436e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.905740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 693/1391] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:01.907256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ead8b-adc7-4e2c-ae80-b64890534a7d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.907555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ead8b-adc7-4e2c-ae80-b64890534a7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.907847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ead8b-adc7-4e2c-ae80-b64890534a7d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.909615 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 694/1392] 10.222.0.13 () {54 vars in 961 bytes} [Mon Oct 31 14:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:01.910698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.911037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.911333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.925240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5559-d42f-4e0f-8150-2cc1adb1b0c8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.931791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:01.932689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:01.933187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.933633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.933900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.934173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] PATH_INFO: `/v3/projects/5bb0c76542864a8f83ce7719407ba5de/users/adb981f54446460c914e637637bc4d56/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.936241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb0c76542864a8f83ce7719407ba5de, user_id=adb981f54446460c914e637637bc4d56, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:01.939395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00dbe-cc95-4069-9cc5-096ac0cfeda0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:01.942202 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 695/1393] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:01.943031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:01.945011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:01.955799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 699/1394] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:01 2022] PUT /identity/v3/projects/5bb0c76542864a8f83ce7719407ba5de/users/adb981f54446460c914e637637bc4d56/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:01.956630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d379e-0d01-4b55-bfe9-6fe653edb759 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:01.957502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996873-f04d-4fdf-a071-a705d6f4f3ec None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:01.957921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996873-f04d-4fdf-a071-a705d6f4f3ec None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:01.958350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996873-f04d-4fdf-a071-a705d6f4f3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:01.983256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-13996873-f04d-4fdf-a071-a705d6f4f3ec None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:01.983256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13996873-f04d-4fdf-a071-a705d6f4f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.016583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:02.030397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.031074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.031361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.031627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] PATH_INFO: `/v3/users/47ed4a24b02a4642b7f1fafd1e5cc31e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.033194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ed4a24b02a4642b7f1fafd1e5cc31e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.046422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.058776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 700/1395] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:02.060155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.064402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.064402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.081553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:02.082766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.152204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 701/1396] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:02.154111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.167633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1f049-4d94-4bb8-a096-4fc3131779b3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.172154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.172814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.173091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.173426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] PATH_INFO: `/v3/projects/938466b238384c99a84417bed70b3f7d/users/b1da3fe8004747d78cc13a5707451708/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.175317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=938466b238384c99a84417bed70b3f7d, user_id=b1da3fe8004747d78cc13a5707451708, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.178759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50678f-a2af-493e-a2e4-3d2b5ca97a7d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.189725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 702/1397] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:02 2022] PUT /identity/v3/projects/938466b238384c99a84417bed70b3f7d/users/b1da3fe8004747d78cc13a5707451708/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:02.194588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.194779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.195039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.215605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:02.216828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.283416 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 703/1398] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:02.284312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.284860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ed4a24b02a4642b7f1fafd1e5cc31e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:02.285757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ed4a24b02a4642b7f1fafd1e5cc31e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:02.348860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ed4a24b02a4642b7f1fafd1e5cc31e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:02.352537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fb933-0d4d-47f7-9a47-a27926b86550 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.358172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.358866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.359131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.359399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.360184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:02.360495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.362555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb86f-62d8-4fd2-91d8-a3ebb4d0637a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.370111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ed4a24b02a4642b7f1fafd1e5cc31e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:02.371624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ed4a24b02a4642b7f1fafd1e5cc31e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:02.382411 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 704/1399] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:02.382411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.382411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.382411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.395260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 696/1400] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:01 2022] DELETE /identity/v3/users/47ed4a24b02a4642b7f1fafd1e5cc31e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:02.399024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.399024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.414265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] MFA Rules not processed for user `adb981f54446460c914e637637bc4d56`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:02.415846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.420818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:02.489247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca562-cef5-4e4d-a98f-75a7519cbcb5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.500273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.500468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.500725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.500996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.501684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:02.507930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.507930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.526545 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 697/1401] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:02.527446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.531228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.534346 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 705/1402] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:02.535955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.542032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.615198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe1a09-489d-4089-acce-ecb5f3b96a33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.620537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.621204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.621483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.621750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.623630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.646674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b8d77-d214-40a9-a671-4a6d9b05069f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.652896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.653568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.653852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.654253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.656500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.670839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.675981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.697410 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 706/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:02.699706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.702571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:02.733878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a10-04b5-41a7-a5db-65cc7783ab52 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.755195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.756827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.756827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.757124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.761558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.764676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.772190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:02.807707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.809302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.837242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 698/1404] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:02.839995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.855335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea7c8d-f074-4366-98bd-0212c7b1f56e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:02.860146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:02.860768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:02.861188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:02.861650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:02.862279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:02.864426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:02.911637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:02.921343 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 707/1405] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:02 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:02.925816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:02.929110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.011803 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 699/1406] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:02 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:03.012567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.056158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8fb2-6f12-4b22-837f-bb9d668db6a7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.091433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334762-233a-49e1-aef9-809b9a67620b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.097800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.102443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.102443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.102443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.102443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.103378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.169084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.169709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.169986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.170262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.243508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.245246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.257120 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 708/1407] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:03.257973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.259777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.276505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 700/1408] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:03 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:03.277777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.282308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85c46-5905-4fcf-bb0d-2b97fccf03ca service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.290290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.291112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.291254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.291527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] PATH_INFO: `/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.293298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4037c12c9684e6ba0a9c59d4d098ffb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.295471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.300677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd39b-a278-427c-b242-aa97c1b40fbf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.319657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.320280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.320565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.320840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.321470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.323428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.426797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4037c12c9684e6ba0a9c59d4d098ffb', 'request_id': 'req-cf74a254-4315-44b2-9b47-ac5be0b89a51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.458457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 701/1409] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:03 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:03.458457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.472004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822492e-e489-4ede-ba6e-bf8aa0a5d762 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.526141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4037c12c9684e6ba0a9c59d4d098ffb', 'request_id': 'req-cf74a254-4315-44b2-9b47-ac5be0b89a51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.538138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4037c12c9684e6ba0a9c59d4d098ffb', 'request_id': 'req-cf74a254-4315-44b2-9b47-ac5be0b89a51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.547746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.548320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.548608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.548872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.549508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.550989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] The token cache is being invalidate because project e4037c12c9684e6ba0a9c59d4d098ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:03.551172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.551537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.552465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.561609 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 702/1410] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:03.562314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.564620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.569957 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 709/1411] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:03 2022] DELETE /identity/v3/projects/e4037c12c9684e6ba0a9c59d4d098ffb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:03.574213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.577507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb151fe-0796-42a7-8934-3e0be1b8eb1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.578830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.583381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.583978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.584861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.585255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] PATH_INFO: `/v3/users/7ba9f2c654f3471db6a41451f9d72f0f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.586506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba9f2c654f3471db6a41451f9d72f0f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.588760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.603275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a254-4315-44b2-9b47-ac5be0b89a51 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.620086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.620086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.620086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.620086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.621548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.623372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.637465 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 710/1412] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:03.637465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.641918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.659377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045c64d-6a6d-4135-b670-10cc4569aee6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.665452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.666344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.666907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.667275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.668080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.670794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45af0-a8ab-4479-bd10-86502187bb97 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.674078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:03.684926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 711/1413] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:03.686449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.686814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.687141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.711756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:03.713048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.721084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 712/1414] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:03.721913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.731957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f92141-52c4-4ea9-98ad-c1197047d24b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.736743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.737345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.737624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.737901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.738550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.740172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.750926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 713/1415] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:03.751769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.762602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2067a-4d54-4d39-bc7f-690f26aef9c2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:03.768033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:03.768772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.769123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.769470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] PATH_INFO: `/v3/projects/f42cdb7fcf084add9a265b99dc412219/users/966c0b1c2b3540c0b12c59fa3d5b8c78/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.787991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42cdb7fcf084add9a265b99dc412219, user_id=966c0b1c2b3540c0b12c59fa3d5b8c78, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:03.791128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcae2e-fb75-4078-b5d4-18a9208bafc8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:03.827072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba9f2c654f3471db6a41451f9d72f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.827878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba9f2c654f3471db6a41451f9d72f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.898723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba9f2c654f3471db6a41451f9d72f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.915607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba9f2c654f3471db6a41451f9d72f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.916405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba9f2c654f3471db6a41451f9d72f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:03.917087 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 714/1416] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:03 2022] PUT /identity/v3/projects/f42cdb7fcf084add9a265b99dc412219/users/966c0b1c2b3540c0b12c59fa3d5b8c78/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:03.918663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9da2b-de87-4fbd-9cb3-1f3b1f4d82a2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:03.918849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9da2b-de87-4fbd-9cb3-1f3b1f4d82a2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:03.919129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9da2b-de87-4fbd-9cb3-1f3b1f4d82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:03.942526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-00c9da2b-de87-4fbd-9cb3-1f3b1f4d82a2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:03.944697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-00c9da2b-de87-4fbd-9cb3-1f3b1f4d82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:03.945206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 703/1417] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:03 2022] DELETE /identity/v3/users/7ba9f2c654f3471db6a41451f9d72f0f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:03.948838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:03.950261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.046776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 715/1418] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:04.046776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cc33-37e5-4617-ad41-c81255c3fa35 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.047296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cc33-37e5-4617-ad41-c81255c3fa35 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.047842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647cc33-37e5-4617-ad41-c81255c3fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.107239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3647cc33-37e5-4617-ad41-c81255c3fa35 None None] MFA Rules not processed for user `966c0b1c2b3540c0b12c59fa3d5b8c78`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:04.108238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3647cc33-37e5-4617-ad41-c81255c3fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.124251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90efccf-6f52-4ed7-83ba-b843940657af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.147758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.149896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.150184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.150751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] PATH_INFO: `/v3/projects/eb75daf89aa94f9c8e49fad1815b6ae9/users/f571d46aa0a548e88b01416f582083d2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.169317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb75daf89aa94f9c8e49fad1815b6ae9, user_id=f571d46aa0a548e88b01416f582083d2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.173021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.211854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 716/1419] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:04.213350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.213689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.214189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.239997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:04.242873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.257256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 717/1420] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:04.257256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.267242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 704/1421] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:03 2022] PUT /identity/v3/projects/eb75daf89aa94f9c8e49fad1815b6ae9/users/f571d46aa0a548e88b01416f582083d2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:04.267242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.269474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.279316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753d3c6-c657-4bc3-ab27-48ee605dd7bb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.295475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:04.346040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.346685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.346962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.347231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.348301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:04.348600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.350945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.365505 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 718/1422] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:04.366969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.371386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.373780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205f19-8883-49b5-b58f-9b88aa017e66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.379645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.379807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.380301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.380530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.381366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.383593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64fae-8861-4132-b70c-e1f07d079813 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.451147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc31c9f-2f2b-465d-84fe-a974b766bfa0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.457633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.458583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.458955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.459321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.473216 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 705/1423] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/projects => generated 389 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:04.475797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.476948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.476948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.483497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.485405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.502937 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 719/1424] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:04.504664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.519697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f4969-4623-48b4-baa4-614f4e9c8a71 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.532177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] MFA Rules not processed for user `f571d46aa0a548e88b01416f582083d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:04.533489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:04.637172 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 706/1425] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:04.638267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.663258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.663878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.664153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.664422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.665310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.671694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.703013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:04.737657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee6b83-1806-4165-a213-c27ae94a2aa5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.744424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.745041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.745318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.745588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.747482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.749130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.804883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 720/1426] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:04.808684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.889382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 707/1427] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:04.894302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:04.909883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c87c4-342d-4636-a10b-3439af25bfe8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.931352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb5fe-b236-49f1-a38b-7db0ba8418a5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:04.937669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.938299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.938581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.938887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.939675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.941709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:04.984465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:04.985635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:04.985921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:04.986187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:04.986964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:04.989042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.079858 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 721/1428] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/projects => generated 399 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:05.080939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.091797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 708/1429] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:04 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:05.092389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.139345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718138-6987-4cfc-ad35-3238d0521805 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.189847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343ab9-9637-4a3d-b55f-35b78961b310 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.202734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.203366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.203644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.204264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.204592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.206196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.225992 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 722/1430] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:05.229374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.239732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:05.263098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b5f63-f6eb-433c-8b94-ebfdfed83676 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.269263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.270869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.271169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.271442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] PATH_INFO: `/v3/projects/d2ca339a73544ce39507e91743c54bed` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.273616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ca339a73544ce39507e91743c54bed)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.275666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.280056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.280811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.281242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.281750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.282702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.285009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.374654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 709/1431] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:05 2022] POST /identity/v3/users => generated 306 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:05.374654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.384675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0191af-6c38-4fff-9dd6-8ef92ab6d993 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.391555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.392167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.392448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.392772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.393508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.397924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.410432 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 710/1432] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:05.412868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.439628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d678f-9e1c-49f4-b038-04216274b3ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.445931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.447524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.447813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.448089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] PATH_INFO: `/v3/projects/1924118badf84a37a47eeb10ec30c081/users/b0babe6434484d79aa3ee7f728ed702e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.488736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1924118badf84a37a47eeb10ec30c081, user_id=b0babe6434484d79aa3ee7f728ed702e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.491021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ca339a73544ce39507e91743c54bed', 'request_id': 'req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:05.492303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.604973 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 711/1433] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:05 2022] PUT /identity/v3/projects/1924118badf84a37a47eeb10ec30c081/users/b0babe6434484d79aa3ee7f728ed702e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:05.604973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.623734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ca339a73544ce39507e91743c54bed', 'request_id': 'req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:05.632431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ca339a73544ce39507e91743c54bed', 'request_id': 'req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:05.646267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] The token cache is being invalidate because project d2ca339a73544ce39507e91743c54bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:05.647017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:05.648140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:05.653156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 723/1434] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:05 2022] DELETE /identity/v3/projects/d2ca339a73544ce39507e91743c54bed => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:05.654215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.655858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:05.681827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813769-62b3-47dc-a344-128ef362563d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.696427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.697743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.698011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.698287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.699190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.702224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.717128 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 712/1435] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:05.717747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.720739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:05.734862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680f2c3-6301-46d4-be69-d2e974e85c80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.742125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.742768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.743171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.743447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.744079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.746472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.749795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc18fc4-cf2f-484c-a8c6-b175106ba0a1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.754911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.755376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.755654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.755926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.757122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.758999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 713/1436] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:05.758999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.759306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.763717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:05.770692 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 724/1437] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:05.770692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.774092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:05.780733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f05a4-96a4-4d85-a70f-841c074c6540 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.785877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.786592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.786895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.787165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] PATH_INFO: `/v3/users/adb981f54446460c914e637637bc4d56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.787348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d551a0-1a96-4a55-aadb-dd9ba56f29ee admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:05.788524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb981f54446460c914e637637bc4d56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.791032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.792195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:05.792878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:05.793287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:05.793697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] PATH_INFO: `/v3/projects/2285c840f25d4184a0239ae137f38c93/users/dd4491fefc5f4c44a560d6da02ae546a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:05.807318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:05.813034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285c840f25d4184a0239ae137f38c93, user_id=dd4491fefc5f4c44a560d6da02ae546a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:05.815832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:05.920583 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 725/1438] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:05 2022] PUT /identity/v3/projects/2285c840f25d4184a0239ae137f38c93/users/dd4491fefc5f4c44a560d6da02ae546a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:05.920583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:05.994825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f73db-033c-44cc-9278-1e78716fe928 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:06.000550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:06.001309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.001502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.001774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] PATH_INFO: `/v3/projects/1924118badf84a37a47eeb10ec30c081/users/b0babe6434484d79aa3ee7f728ed702e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.006801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1924118badf84a37a47eeb10ec30c081, user_id=b0babe6434484d79aa3ee7f728ed702e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:06.009402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:06.033546 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 726/1439] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:05 2022] PUT /identity/v3/projects/1924118badf84a37a47eeb10ec30c081/users/b0babe6434484d79aa3ee7f728ed702e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:06.045809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:06.063433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb981f54446460c914e637637bc4d56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:06.065046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb981f54446460c914e637637bc4d56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:06.105185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:06.138213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb981f54446460c914e637637bc4d56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:06.160282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb981f54446460c914e637637bc4d56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:06.161677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb981f54446460c914e637637bc4d56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:06.182384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0a29-9cb5-48ad-8b95-86f89fa24fca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:06.188199 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 714/1440] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:05 2022] DELETE /identity/v3/users/adb981f54446460c914e637637bc4d56 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:06.188199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:06.194050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:06.194700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.194777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.194777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.202173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] PATH_INFO: `/v3/projects/1460237b2f76428ab48d1c7b97304818/users/c872e1855266474bb330f986ef9bdaeb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.237223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1460237b2f76428ab48d1c7b97304818, user_id=c872e1855266474bb330f986ef9bdaeb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:06.240080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732f52f-91b6-4716-92fa-dfa0b2062cd4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:06.299962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3fd11-9c77-451f-a732-4daa5696253c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:06.306133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:06.307223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.307710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.308198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.309036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:06.311374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:06.332121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 727/1441] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:06 2022] PUT /identity/v3/projects/1460237b2f76428ab48d1c7b97304818/users/c872e1855266474bb330f986ef9bdaeb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:06.344670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 715/1442] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:06.345048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f588-4398-4436-a14f-b7d0635966ee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.345339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f588-4398-4436-a14f-b7d0635966ee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.345612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f588-4398-4436-a14f-b7d0635966ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.346666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:06.359510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12594930-39e0-404a-86ce-71dbfce4dfc6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:06.390872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bae9f588-4398-4436-a14f-b7d0635966ee None None] MFA Rules not processed for user `b0babe6434484d79aa3ee7f728ed702e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:06.392467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bae9f588-4398-4436-a14f-b7d0635966ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.441585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:06.442692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.443183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.443813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] PATH_INFO: `/v3/projects/2285c840f25d4184a0239ae137f38c93/users/dd4491fefc5f4c44a560d6da02ae546a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.447340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285c840f25d4184a0239ae137f38c93, user_id=dd4491fefc5f4c44a560d6da02ae546a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:06.450984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ffb8-24ff-4ca9-ba67-9a0c27dffe72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:06.481021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 716/1443] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:06 2022] PUT /identity/v3/projects/2285c840f25d4184a0239ae137f38c93/users/dd4491fefc5f4c44a560d6da02ae546a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:06.482832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d637-3fba-4e47-850e-603e7a15ffdb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.483262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d637-3fba-4e47-850e-603e7a15ffdb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.483538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d637-3fba-4e47-850e-603e7a15ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.527965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0f2d637-3fba-4e47-850e-603e7a15ffdb None None] MFA Rules not processed for user `c872e1855266474bb330f986ef9bdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:06.529413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0f2d637-3fba-4e47-850e-603e7a15ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.573088 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 728/1444] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:06.587518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.587817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.588093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.670207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] MFA Rules not processed for user `dd4491fefc5f4c44a560d6da02ae546a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:06.671645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.716254 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 717/1445] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:06.716254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.716254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.716254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.760277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] MFA Rules not processed for user `966c0b1c2b3540c0b12c59fa3d5b8c78`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:06.761663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.855731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 729/1446] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:06.857707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:06.860129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.918022 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 718/1447] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:06.920019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:06.921919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:06.980817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caf179-8687-4a3a-8607-8159e2b34fc6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:06.982213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:06.983538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:06.983925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:06.984298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:06.985185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:06.987491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.071601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b20c8e-1698-4c5c-9ac5-be2587bc26ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.077740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.078748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.079225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.079570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.081733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.097937 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 730/1448] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:06 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:07.099828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.122384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.167299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:07.187750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.190047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.206871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 719/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:07.206871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.206871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.229803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd527-2ace-404a-8f3f-cb5f6b00761a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.269766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:07.279080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0217c-05df-4163-ad9d-610a69ede106 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.285365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.286086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.286461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.286885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.289263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.307434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.308126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.308409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.308684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] PATH_INFO: `/v3/projects/5bb0c76542864a8f83ce7719407ba5de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.309803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb0c76542864a8f83ce7719407ba5de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.311982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.355810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.357478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.368053 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 731/1450] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:07.368965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.378965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287a57-3882-426b-b916-d33dfe7d889f service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.383901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.384503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.384802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.385051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.385828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.387899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf746f87-0f6b-4b1b-9702-60d008c4f623 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.433713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb0c76542864a8f83ce7719407ba5de', 'request_id': 'req-17f53008-0c40-4b18-8ccc-f015259bafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:07.475871 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 732/1451] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:07 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:07.477183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.477462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.477732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.532172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:07.533388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.542852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb0c76542864a8f83ce7719407ba5de', 'request_id': 'req-17f53008-0c40-4b18-8ccc-f015259bafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:07.549659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb0c76542864a8f83ce7719407ba5de', 'request_id': 'req-17f53008-0c40-4b18-8ccc-f015259bafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:07.564090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] The token cache is being invalidate because project 5bb0c76542864a8f83ce7719407ba5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:07.564471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:07.565916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:07.569381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 720/1452] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:07 2022] DELETE /identity/v3/projects/5bb0c76542864a8f83ce7719407ba5de => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:07.575923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.577947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.624959 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 733/1453] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:07.626748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.627942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.697095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53008-0c40-4b18-8ccc-f015259bafc3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.703551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.708323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.708323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.708323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.708323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.726894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776d077-cec2-4074-9f06-069a76fe9b30 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.733280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.734066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.734346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.734646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.735488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.737192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9fcf-403e-43e7-a097-888760987969 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.768122 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 734/1454] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:07.769655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631828-7711-468c-a809-0f203b6a0786 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.770013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631828-7711-468c-a809-0f203b6a0786 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.770432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631828-7711-468c-a809-0f203b6a0786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.775740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:07.812664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-28631828-7711-468c-a809-0f203b6a0786 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:07.816389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28631828-7711-468c-a809-0f203b6a0786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.837038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 735/1455] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:07.838049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631828-7711-468c-a809-0f203b6a0786 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.839808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.843292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479dff9-e91f-47e9-a98b-57b6d6fe6470 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.859056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631828-7711-468c-a809-0f203b6a0786 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:07.868052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:07.869247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.873084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.873084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] PATH_INFO: `/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5/users/8d56bdac410c4a829047abea07fdc619/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.882658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 721/1456] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:07.889605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:07.889982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:07.890350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:07.911860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d4d6dac49d48f09e68e9a14f8eb1c5, user_id=8d56bdac410c4a829047abea07fdc619, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:07.921587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:07.948610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:07.948610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:07.960757 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 722/1457] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:07.963306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:07.992383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de13cf-5c44-48a6-87be-e063c4152b62 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.008850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.009570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.009779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.010056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.010770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:08.011079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.017141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.033790 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 736/1458] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:07 2022] PUT /identity/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5/users/8d56bdac410c4a829047abea07fdc619/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:08.035431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.040714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:08.068379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 723/1459] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:17:08.068379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.090504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c402b-a132-4406-a4a5-fa8a43296229 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.149998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:08.230646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.231279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.231560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.231830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.235801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.238117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.263854 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 724/1460] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:08.263854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.313108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ca9c-8ab2-452c-b125-baf87dbb48c8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.315765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629e8c-124d-4253-968c-48276c3e79a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.329132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.329764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.330044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.330318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.330984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.335256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.335882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.336347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.336471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.348089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.503241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.505025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.522823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 725/1461] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:08 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:08.526580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.535698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 737/1462] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:17:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:17:08.539217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.542191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:08.586513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33409f-6382-4971-8ace-91c035e1a27f service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.696049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd06-5027-4c5f-86b6-48e8e82394a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:08.725698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.725698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.725698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.725698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] PATH_INFO: `/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5/users/8d56bdac410c4a829047abea07fdc619/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.729654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d4d6dac49d48f09e68e9a14f8eb1c5, user_id=8d56bdac410c4a829047abea07fdc619, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.732634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.766894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:08.768345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:08.769473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:08.770482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:08.771406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] PATH_INFO: `/v3/users/f571d46aa0a548e88b01416f582083d2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:08.777167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f571d46aa0a548e88b01416f582083d2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:08.781446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:08.793511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 726/1463] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:08 2022] PUT /identity/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5/users/8d56bdac410c4a829047abea07fdc619/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:08.795633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:08.810742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.023741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f571d46aa0a548e88b01416f582083d2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:09.024410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f571d46aa0a548e88b01416f582083d2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:09.038502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62c1d-84e2-41c1-a9eb-692aecc6c276 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:09.059501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:09.060141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.060461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.060753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.061130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.061420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:09.063520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e5ca0-7267-4ec1-9733-9ab2167e6d3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:09.120901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f571d46aa0a548e88b01416f582083d2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:09.122300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.145547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f571d46aa0a548e88b01416f582083d2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:09.148632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b0b2e8-32b8-49f0-a155-92e868e4517e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f571d46aa0a548e88b01416f582083d2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:09.188960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 738/1464] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:08 2022] DELETE /identity/v3/users/f571d46aa0a548e88b01416f582083d2 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:09.191578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11223ebd-a608-4bc6-9796-72fbfeab810c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.194257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11223ebd-a608-4bc6-9796-72fbfeab810c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.195077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 727/1465] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:08 2022] POST /identity/v3/users => generated 297 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:09.195192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11223ebd-a608-4bc6-9796-72fbfeab810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.196997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.201476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.202027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.274843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:09.277345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:09.322601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-11223ebd-a608-4bc6-9796-72fbfeab810c None None] MFA Rules not processed for user `8d56bdac410c4a829047abea07fdc619`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:09.336601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11223ebd-a608-4bc6-9796-72fbfeab810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:09.453476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.527433 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 728/1466] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:09.557443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:09.560067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:09.603575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 739/1467] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:09.605369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.608228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.608764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.619895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bf64-4da1-495b-ac61-3383b00aa0bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:09.647506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:09.648636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.649162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.651094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.655945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:09.666030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:09.675171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:09.698318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 729/1468] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:09.699793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:09.708335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:09.722358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:09.733855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:09.911151 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 740/1469] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:09.993578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:09.994321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5137-5187-4242-874d-45ab24643210 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:09.995155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a05d6-288f-4311-8f7a-a94dfda1310f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:09.995155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:09.995155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.995155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.995485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.995485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:09.995636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:09.995732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:09.995822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:09.995822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:09.995822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:09.995822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:09.995822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:10.003450 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 730/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:10.013118 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 741/1471] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:10.023756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:10.045506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:10.056553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:10.076052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1735-6436-43d8-8c53-95b60fa9b672 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:10.086746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:10.087369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:10.087649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:10.087922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:10.089526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86874d9e-19c1-45ec-8c42-3fac0cf682d4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:10.099138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:10.101597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:10.104838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:10.105745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:10.106183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:10.106611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835/users/9b87369957d542438b859bc25c5a3570/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:10.122018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 742/1472] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:17:10.135584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:10.140042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:10.277108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=465aab87dfd14f8da1d020e45e348835, user_id=9b87369957d542438b859bc25c5a3570, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:10.279919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d426-5d1f-42fb-94f7-1dfcca7e2774 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:10.338987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545a-d3fe-4a06-9bd5-22b592818f5e service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:10.385959 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 731/1473] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:10 2022] PUT /identity/v3/projects/465aab87dfd14f8da1d020e45e348835/users/9b87369957d542438b859bc25c5a3570/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:10.391993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:10.392367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:10.392773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:10.397893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:10.398692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:10.398928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:10.399089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:10.417889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:10.428130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:10.451557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] MFA Rules not processed for user `9b87369957d542438b859bc25c5a3570`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:10.453202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:10.453786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 743/1474] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:10.603756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:10.605088 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 732/1475] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:10.622440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a88b-a169-447e-bc1c-d2830bc534a6 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:10.803956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:10.807066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:10.807521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:10.807618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:10.808258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:10.810340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:10.835862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:10.898848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:10.998777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 744/1476] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:10 2022] POST /identity/v3/projects => generated 393 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:11.002679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.027395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374d15-1a2f-45b1-ae82-f0394fc6342a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.235952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:11.236294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.237132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.237132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.247847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:11.253043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:11.391021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 733/1477] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:11 2022] POST /identity/v3/users => generated 303 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:11.394805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.419552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b034ab-3dd6-4bdf-84d0-5ad4e31ad116 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.431717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:11.432344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.432629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.432916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.433644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:11.435574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:11.463403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.476825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 745/1478] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:11.483205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:11.486570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3c95-825a-4aed-89df-9b4347f4d920 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.502979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:11.503664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.503944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.504214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] PATH_INFO: `/v3/projects/339562f9b4484bb39b68cc856afc6360/users/047ee001d4a442949e5683818e08f970/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.537775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=339562f9b4484bb39b68cc856afc6360, user_id=047ee001d4a442949e5683818e08f970, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:11.541043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:11.626311 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 734/1479] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:11 2022] PUT /identity/v3/projects/339562f9b4484bb39b68cc856afc6360/users/047ee001d4a442949e5683818e08f970/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:11.630542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.634299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:11.646999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e44fb-54e1-460a-b60a-65faaec222a8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.774195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.775691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:11.799830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:11.800412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.800686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.800935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.801573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:11.803877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:11.829056 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 746/1480] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:11.833606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:11.845765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3d47-e1e8-4bf3-af5b-477004c9f685 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.852040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:11.853071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.853563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.853997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] PATH_INFO: `/v3/projects/339562f9b4484bb39b68cc856afc6360/users/047ee001d4a442949e5683818e08f970/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.856262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=339562f9b4484bb39b68cc856afc6360, user_id=047ee001d4a442949e5683818e08f970, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:11.859301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61017d0c-d46a-44a4-bd60-62c7f695fb1b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:11.894964 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 747/1481] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:11 2022] PUT /identity/v3/projects/339562f9b4484bb39b68cc856afc6360/users/047ee001d4a442949e5683818e08f970/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:11.901274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:11.901899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:11.903139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:11.941594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa24f-7704-4f94-b19f-5aad787042bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:11.971313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] MFA Rules not processed for user `047ee001d4a442949e5683818e08f970`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:11.977447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:12.057525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.059042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.059478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.059900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] PATH_INFO: `/v3/projects/eb75daf89aa94f9c8e49fad1815b6ae9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.066380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb75daf89aa94f9c8e49fad1815b6ae9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.070450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.134895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 748/1482] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:12.136269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:12.155735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa7c8f-f2f6-4e2c-a8ed-fbde8292943a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:12.161458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.163102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.163585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.164044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.164865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.167499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.307761 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 749/1483] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:12 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:12.308943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:12.317837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb75daf89aa94f9c8e49fad1815b6ae9', 'request_id': 'req-c33da55f-e573-483a-9741-a4654295df71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:12.372588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:12.413300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb75daf89aa94f9c8e49fad1815b6ae9', 'request_id': 'req-c33da55f-e573-483a-9741-a4654295df71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:12.422497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb75daf89aa94f9c8e49fad1815b6ae9', 'request_id': 'req-c33da55f-e573-483a-9741-a4654295df71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:12.461507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] The token cache is being invalidate because project eb75daf89aa94f9c8e49fad1815b6ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:12.462027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:12.466513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:12.468695 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 735/1484] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:11 2022] DELETE /identity/v3/projects/eb75daf89aa94f9c8e49fad1815b6ae9 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:12.472442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:12.473911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:12.506982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:12.514606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dcdad-b528-4ce2-aa26-750999035094 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:12.541036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.542917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.548716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.548716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.548716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.556209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.700961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da55f-e573-483a-9741-a4654295df71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:12.734354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 750/1485] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:12 2022] POST /identity/v3/users => generated 297 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:12.745258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.746491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.747430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:12.748135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.748411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] PATH_INFO: `/v3/users/dd4491fefc5f4c44a560d6da02ae546a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.748706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:12.752823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4491fefc5f4c44a560d6da02ae546a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.755298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:12.760358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.771004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18adb-c67d-46c1-be75-6023d9420118 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:12.791475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.792158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.792638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.792984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.793973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.795917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.829840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 751/1486] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:12.834817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:12.846935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71e78-0289-429f-aeb8-45d51a4635a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:12.864919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:12.864919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.864919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.864919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.865300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:12.865300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89632c-2f5f-4090-919b-57309bd3eebd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:12.882153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 752/1487] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:17:12.883619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:12.883953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:12.884265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:12.922506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] MFA Rules not processed for user `b1da3fe8004747d78cc13a5707451708`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:12.924041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.083926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4491fefc5f4c44a560d6da02ae546a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:13.085267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4491fefc5f4c44a560d6da02ae546a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:13.099907 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 753/1488] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:13.101356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:13.134206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d384b5e-777c-498a-b4d5-b6339ab93bb4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:13.140920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:13.141657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.141941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.142222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] PATH_INFO: `/v3/projects/f4645e1d7d9d442bb7597d350852de9f/users/16c0e502b4cb45a0a21ab6c66793373c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.166295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4491fefc5f4c44a560d6da02ae546a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:13.171722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4645e1d7d9d442bb7597d350852de9f, user_id=16c0e502b4cb45a0a21ab6c66793373c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:13.185040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae6702-6e89-468d-aa07-1acc47a3010d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:13.206203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4491fefc5f4c44a560d6da02ae546a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:13.206203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4491fefc5f4c44a560d6da02ae546a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:13.235682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 736/1489] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:12 2022] DELETE /identity/v3/users/dd4491fefc5f4c44a560d6da02ae546a => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:13.236743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:13.238975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.246329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:13.254148 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 754/1490] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:13 2022] PUT /identity/v3/projects/f4645e1d7d9d442bb7597d350852de9f/users/16c0e502b4cb45a0a21ab6c66793373c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:13.260895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced452-6a46-4bd1-a098-e22aaa4b6312 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.261594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced452-6a46-4bd1-a098-e22aaa4b6312 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.262066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced452-6a46-4bd1-a098-e22aaa4b6312 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.265421 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 755/1491] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:17:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:13.269283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1355ba-d4f0-4251-9141-7bdee0036b89 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.270735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1355ba-d4f0-4251-9141-7bdee0036b89 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.275091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1355ba-d4f0-4251-9141-7bdee0036b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.359588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61a33-996a-4136-9cef-cafa717fc2f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:13.363600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2f1355ba-d4f0-4251-9141-7bdee0036b89 None None] MFA Rules not processed for user `16c0e502b4cb45a0a21ab6c66793373c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:13.366128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f1355ba-d4f0-4251-9141-7bdee0036b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.451264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:13.507010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:13.507736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.508021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.508293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.516807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.532102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 756/1492] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:13.533680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.534362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.534475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.575440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:13.578880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.596520 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 757/1493] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:13.597498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:13.599717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.627442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c6428-8539-4345-b823-43e70f513024 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:13.640340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:13.641370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.641660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.642451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.645372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.708476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:13.708476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b166452-9928-41f5-ae08-a0d881d3fcd7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:13.719772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 737/1494] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:13.721461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.721789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.722143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.791118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:13.791118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.816413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:13.818297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:13.849979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 758/1495] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:13.849979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:13.860192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:13.862280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c18ea7-7ee7-4122-8d10-f09077745796 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:13.879890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:13.880519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:13.880798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:13.881637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:13.907449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:13.909078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:13.920181 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 738/1496] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:13.947205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:13.957185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:13.961203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 759/1497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:14.160498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:14.185111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f22d75-8761-4ab1-91fc-e3b9232525ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:14.192272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9f2c-5e12-4a9f-ad3d-2c83efbea2fb service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:14.207107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:14.207688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:14.208846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.209442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.210052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.210284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.210395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.210567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.212841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:14.241310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:14.247394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f572ccb-155a-46da-a741-d19d186da63a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:14.284031 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 739/1498] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:17:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:17:14.334803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:14.337462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f247-2b3f-48e5-950d-68cea588b4ea service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:14.352725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.367688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.367688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.367688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 740/1499] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:14.368035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 760/1500] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:14 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:14.369371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:14.393319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:14.416136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96404d0c-b88b-46f8-93a6-8f13e0f5da1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:14.428353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:14.429012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.429289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.429561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.431749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:14.436431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:14.453749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 741/1501] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:14 2022] GET /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 393 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:14.702206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338fab4-a600-4b43-87f1-0277c892f454 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.702206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338fab4-a600-4b43-87f1-0277c892f454 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.702206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338fab4-a600-4b43-87f1-0277c892f454 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.702206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 761/1502] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:14.703174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:14.750308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:14.776189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8c34c-5b29-4c0c-992d-9d6458da6dd6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:14.783921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:14.786349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.786349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.786349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.793453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:14.795746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:14.797529 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 742/1503] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:14 2022] GET /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 393 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:14.969841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:14.970159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:14.970394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:14.971772 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 762/1504] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:14.978787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:15.001870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:15.038529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1791c9-d562-4a93-bc4b-cc5a6b574ce2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:15.049082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:15.049569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:15.061574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:15.063965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:15.063965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:15.089046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabb27d-797f-4a24-9e49-2155395cea3d tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:15.098755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 743/1505] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:14 2022] GET /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 393 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:15.306029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:15.310083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:15.485629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:15.511278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d6d8-29e6-4eea-81e1-4e1adbd8b248 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:15.517241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:15.518046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:15.518399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:15.519385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] PATH_INFO: `/v3/projects/2285c840f25d4184a0239ae137f38c93` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:15.521438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2285c840f25d4184a0239ae137f38c93)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:15.524068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:15.726889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2285c840f25d4184a0239ae137f38c93', 'request_id': 'req-46c359ab-aeac-4d91-9d4d-066f53bbe720'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:15.836017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2285c840f25d4184a0239ae137f38c93', 'request_id': 'req-46c359ab-aeac-4d91-9d4d-066f53bbe720'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:15.846089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2285c840f25d4184a0239ae137f38c93', 'request_id': 'req-46c359ab-aeac-4d91-9d4d-066f53bbe720'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:15.867123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] The token cache is being invalidate because project 2285c840f25d4184a0239ae137f38c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:15.867876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:15.871775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:15.876515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 763/1506] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:15 2022] DELETE /identity/v3/projects/2285c840f25d4184a0239ae137f38c93 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:15.880416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e78a5-00c9-4008-ae84-5fc1029bbe13 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:15.881791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e78a5-00c9-4008-ae84-5fc1029bbe13 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:15.882229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e78a5-00c9-4008-ae84-5fc1029bbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:15.923760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d38e78a5-00c9-4008-ae84-5fc1029bbe13 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:15.925996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d38e78a5-00c9-4008-ae84-5fc1029bbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.092476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.094366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.133271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 744/1507] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:16.141530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.141827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.142100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.208015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:16.215458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.260111 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 745/1508] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:16.276569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.281569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c359ab-aeac-4d91-9d4d-066f53bbe720 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:16.295345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:16.298295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.298596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.298902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.300530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e4973-deb1-4d1d-8047-25d44535bbf9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:16.302583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.315495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:16.316635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.317123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.317708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.318763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:16.319393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:16.324883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:16.354850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 746/1509] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:16.359302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.389841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1b1a-b224-4f5b-a80b-66017cccd1f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:16.403347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:16.405295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.406771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.407118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.409541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:16.412758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:16.517140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 747/1510] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:16 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:16.523011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.544314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:16.546029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ef19d-3772-44ae-9b34-6150dbcc426f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:16.547083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:16.592225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 764/1511] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:16.661026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.661026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.661326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.689125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:16.692019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.699636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:16.769201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaff7a-3af9-4891-8177-c669867cd499 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:16.784217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:16.786142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.787089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.788139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.791897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:16.798736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:16.862088 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 765/1512] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 31 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:16.887683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.889162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:16.905191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca7079-7aee-40cf-bb27-7a28eae5f9ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:16.913366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:16.913366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:16.913366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:16.913366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:16.940749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 748/1513] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:16 2022] POST /identity/v3/users => generated 297 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:16.942510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:16.952202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:16.955846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:16.976862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d759c-6e61-4329-af5f-a7a56656aadc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:17.004178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:17.004809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.005084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.005356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.006040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:17.007005 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 766/1514] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:17.008217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:17.060213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:17.064233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 749/1515] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:17.079703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56774c8f-a047-4999-8af4-55ce67c5984a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:17.089250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:17.091203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.091563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.091987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.092826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:17.095348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de668-4749-4b86-b341-3694075191a0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:17.123124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:17.137606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 767/1516] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:17.142078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad797-1b55-4cc5-9de3-71cdfb02c5f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:17.154093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:17.155395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.156097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.156763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] PATH_INFO: `/v3/projects/c6ad5376561e4bd2aac88f1558542813/users/ad3f1af0e8614f68bd139de9d6c40adb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.186985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ad5376561e4bd2aac88f1558542813, user_id=ad3f1af0e8614f68bd139de9d6c40adb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:17.191518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0f83-abcd-4f2c-896a-1c4fb6f340e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:17.289661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 750/1517] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:17 2022] PUT /identity/v3/projects/c6ad5376561e4bd2aac88f1558542813/users/ad3f1af0e8614f68bd139de9d6c40adb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:17.300818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.301208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.305341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.403167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] MFA Rules not processed for user `ad3f1af0e8614f68bd139de9d6c40adb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:17.409536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:17.555223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.555628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.555984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.557961 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 751/1518] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:17.571122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:17.574157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:17.621992 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 768/1519] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:17.626164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:17.788983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:17.790557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:17.851436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744ab58-0f62-4554-ab1c-69e18a34abab None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:17.860634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:17.862420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.863637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.864512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.866172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:17.872121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd34e6-42a4-4d62-b682-f3188e73004c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:17.884326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:17.911331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfaac-8632-4cb4-95d9-eb35e9f8937f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:17.924616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:17.925994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:17.928548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:17.928548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:17.929753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:17.933844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:17.949100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 752/1520] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:17 2022] GET /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 393 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:18.032338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 769/1521] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:17 2022] POST /identity/v3/projects => generated 393 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:18.036120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.087081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f147b-b70e-4dd6-a51f-841da447dbd2 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.113118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.113448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.115092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.118244 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 770/1522] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:18.124720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:18.155081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:18.257635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.258253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.258531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.258833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.260722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:18.266113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:18.349500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.375593 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 753/1523] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:18 2022] POST /identity/v3/users => generated 303 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:18.376604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.391881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5678-6c69-40cc-8579-3152d211f817 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.405143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.407752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.407752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.407752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.407752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:18.408517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:18.446249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 754/1524] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:18.449488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.476910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b3dd-0502-43bf-a9f3-780223ab3b0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.502181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.510659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.513212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.514386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] PATH_INFO: `/v3/projects/bcf214800a0741f2aa6b3718c908e6b6/users/ebce4f19e52947cab0feab4da53506c5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.535284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a779b4-4774-48ac-9383-75afe511be49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.553096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.553854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.554156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.554448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.557847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:18.560582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:18.566628 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 771/1525] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:18 2022] GET /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 393 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:18.574390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf214800a0741f2aa6b3718c908e6b6, user_id=ebce4f19e52947cab0feab4da53506c5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:18.579373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:18.673191 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 755/1526] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:18 2022] PUT /identity/v3/projects/bcf214800a0741f2aa6b3718c908e6b6/users/ebce4f19e52947cab0feab4da53506c5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:18.677403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.694248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481e08-e1f2-4afc-8c9b-bae09953add6 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.885269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.885948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.886223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.886571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.887325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:18.892032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f9c57-1fce-44ec-bfe4-9d9acb93c08f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:18.940976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 772/1527] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:18.941863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:18.958223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ff3-d791-4714-aa02-f67718afc74f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:18.981702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:18.986092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:18.988428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:18.989561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] PATH_INFO: `/v3/projects/bcf214800a0741f2aa6b3718c908e6b6/users/ebce4f19e52947cab0feab4da53506c5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:18.998646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf214800a0741f2aa6b3718c908e6b6, user_id=ebce4f19e52947cab0feab4da53506c5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:19.007909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9757a-7ad0-4015-94fe-0e4996b37266 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:19.074073 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 756/1528] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:18 2022] PUT /identity/v3/projects/bcf214800a0741f2aa6b3718c908e6b6/users/ebce4f19e52947cab0feab4da53506c5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:19.088304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.088733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.089143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.157732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] MFA Rules not processed for user `ebce4f19e52947cab0feab4da53506c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:19.165550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:19.237364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:19.310838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.311138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.311407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.312986 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 757/1529] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:19.327240 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 773/1530] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:19.330238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:17:19.336650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:19.439026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2bf08-ec07-42a8-91ee-87fe314b64d4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:19.444578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:19.445366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.445644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.445912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.460061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:19.464655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:19.495070 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 774/1531] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:19.498656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:19.546811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:19.578448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dbeeb-780c-4daf-8568-b5991eb3ae0e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:19.578890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:19.584133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '047ee001d4a442949e5683818e08f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339562f9b4484bb39b68cc856afc6360', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:19.584843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.585123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.585388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] PATH_INFO: `/v3/projects/f4645e1d7d9d442bb7597d350852de9f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.586509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4645e1d7d9d442bb7597d350852de9f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:19.588670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:19.603143 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 758/1532] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:17:19 2022] GET /identity/v3/projects/f4645e1d7d9d442bb7597d350852de9f => generated 393 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:19.700873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc02c13-e200-4e57-b883-596988e80d1a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:19.713961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:19.714976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.715450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.715922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] PATH_INFO: `/v3/users/ad3f1af0e8614f68bd139de9d6c40adb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.745612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3f1af0e8614f68bd139de9d6c40adb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:19.754517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:19.829251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:19.831490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:19.856097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bd78e-e8e1-4acc-bac3-845bf0ec2366 tempest-FlavorsAccessNegativeTestJSON-956442112 tempest-FlavorsAccessNegativeTestJSON-956442112-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:19.866987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:19.867757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:19.868023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:19.868298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] PATH_INFO: `/v3/users/9b87369957d542438b859bc25c5a3570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:19.872152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b87369957d542438b859bc25c5a3570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:19.874565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:19.992884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3f1af0e8614f68bd139de9d6c40adb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:19.996443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3f1af0e8614f68bd139de9d6c40adb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.068872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3f1af0e8614f68bd139de9d6c40adb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.072520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:20.096910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3f1af0e8614f68bd139de9d6c40adb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.098531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-726b102f-0ce8-4272-a320-e8f4a85512f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3f1af0e8614f68bd139de9d6c40adb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.111914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b87369957d542438b859bc25c5a3570'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.116216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b87369957d542438b859bc25c5a3570'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.151613 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 775/1533] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:19 2022] DELETE /identity/v3/users/ad3f1af0e8614f68bd139de9d6c40adb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:20.156211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:20.160859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:20.160859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:20.206965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b87369957d542438b859bc25c5a3570'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.240038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:20.241367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:20.250048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b87369957d542438b859bc25c5a3570'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.252452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f8f6fa2-21c9-4ab3-b89e-09e3eaf6ce49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b87369957d542438b859bc25c5a3570'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:20.301109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 759/1534] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:19 2022] DELETE /identity/v3/users/9b87369957d542438b859bc25c5a3570 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:20.309131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:20.311035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:20.311697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:20.408414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:20.413115 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 776/1535] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:20.413279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:20.429679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:20.431204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:20.605209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab6709-9cb2-44d6-a79f-ef877550f8d3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:20.702174 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 760/1536] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:20.705981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:20.706761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:20.707146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:20.707516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:20.725238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:20.726561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:20.728230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad345-8b8b-4a87-a4f4-1397fc4cae50 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:20.755428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 777/1537] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:20.764328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f7082-a00b-4f30-86d2-0720fadf32f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:20.780938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:20.782090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:20.782598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:20.783108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:20.806359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:20.808379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb65b3-282c-4878-ad10-101cc30d179e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:20.832077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 761/1538] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:21.291395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c7-54b9-4b93-9859-da5a06a2239a None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.291944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c7-54b9-4b93-9859-da5a06a2239a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.292219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c7-54b9-4b93-9859-da5a06a2239a None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.294386 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 778/1539] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:21.311323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.311882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.311974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.352687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:21.354947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.420487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.420774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.421118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.441352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:21.455604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] MFA Rules not processed for user `1b95a2ca22b242de98e605dc3d3a6119`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:21.458837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.514674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:21.530580 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 762/1540] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:21.531554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:21.533259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.579598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08172c42-84e6-4fd4-a986-841f2ad7c94c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:21.597079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:21.598014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.598249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.598581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] PATH_INFO: `/v3/projects/c6ad5376561e4bd2aac88f1558542813` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.600803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ad5376561e4bd2aac88f1558542813)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:21.603050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:21.620547 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 779/1541] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:21.621597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:21.631743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.695827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890f5e-648b-4596-b6da-4c0b1ac07869 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:21.717665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:21.717665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.717665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.717665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.736718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:21.746044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:21.770337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 780/1542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:21.770892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:21.772361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.794013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ad5376561e4bd2aac88f1558542813', 'request_id': 'req-c0c0591d-25d7-4991-85de-eeff45235668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:21.809981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d24a3-2792-4373-863d-15532109ee3a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:21.892212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ad5376561e4bd2aac88f1558542813', 'request_id': 'req-c0c0591d-25d7-4991-85de-eeff45235668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:21.903833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ad5376561e4bd2aac88f1558542813', 'request_id': 'req-c0c0591d-25d7-4991-85de-eeff45235668'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:21.925605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:21.925605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.925605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.925605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] PATH_INFO: `/v3/projects/465aab87dfd14f8da1d020e45e348835` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.926309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=465aab87dfd14f8da1d020e45e348835)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:21.928567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] The token cache is being invalidate because project c6ad5376561e4bd2aac88f1558542813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:21.929367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:21.929477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:21.930223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:21.931797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 763/1543] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:21 2022] DELETE /identity/v3/projects/c6ad5376561e4bd2aac88f1558542813 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:21.939176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:21.941278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:21.969735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0591d-25d7-4991-85de-eeff45235668 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:21.982946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:21.983611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:21.983890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:21.984165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] PATH_INFO: `/v3/users/ebce4f19e52947cab0feab4da53506c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:21.985338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebce4f19e52947cab0feab4da53506c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:21.990285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:22.104819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465aab87dfd14f8da1d020e45e348835', 'request_id': 'req-a5befc58-faa5-4bdf-80c8-10e78bd04977'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.184803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465aab87dfd14f8da1d020e45e348835', 'request_id': 'req-a5befc58-faa5-4bdf-80c8-10e78bd04977'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.192426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465aab87dfd14f8da1d020e45e348835', 'request_id': 'req-a5befc58-faa5-4bdf-80c8-10e78bd04977'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.218197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebce4f19e52947cab0feab4da53506c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.219382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebce4f19e52947cab0feab4da53506c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.219906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] The token cache is being invalidate because project 465aab87dfd14f8da1d020e45e348835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:22.220623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.222446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.227969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 781/1544] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:21 2022] DELETE /identity/v3/projects/465aab87dfd14f8da1d020e45e348835 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:22.237155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:22.237155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:22.313525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:22.320607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebce4f19e52947cab0feab4da53506c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.321140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5befc58-faa5-4bdf-80c8-10e78bd04977 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:22.326756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:22.327521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:22.327804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:22.328153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] PATH_INFO: `/v3/users/047ee001d4a442949e5683818e08f970` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:22.334062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=047ee001d4a442949e5683818e08f970)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:22.334062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:22.346302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebce4f19e52947cab0feab4da53506c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.347758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebce4f19e52947cab0feab4da53506c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.377084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 764/1545] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:21 2022] DELETE /identity/v3/users/ebce4f19e52947cab0feab4da53506c5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:22.607750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047ee001d4a442949e5683818e08f970'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.610111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047ee001d4a442949e5683818e08f970'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.703470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047ee001d4a442949e5683818e08f970'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.733742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047ee001d4a442949e5683818e08f970'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.738510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047ee001d4a442949e5683818e08f970'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:22.767213 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 782/1546] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:22 2022] DELETE /identity/v3/users/047ee001d4a442949e5683818e08f970 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:22.945389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:22.947343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:23.017128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:23.140297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ace26-db17-4626-9d49-1a9af7b6ad3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:23.259073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:23.259714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:23.260057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:23.260345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] PATH_INFO: `/v3/projects/bcf214800a0741f2aa6b3718c908e6b6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:23.261983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf214800a0741f2aa6b3718c908e6b6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:23.263943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:23.483384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf214800a0741f2aa6b3718c908e6b6', 'request_id': 'req-f746211e-2332-4d31-aaf9-60328e1da15b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.591094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:23.592557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:23.611657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf214800a0741f2aa6b3718c908e6b6', 'request_id': 'req-f746211e-2332-4d31-aaf9-60328e1da15b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.617066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227d42-86db-4020-a150-2f6eea20eaab admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:23.623691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf214800a0741f2aa6b3718c908e6b6', 'request_id': 'req-f746211e-2332-4d31-aaf9-60328e1da15b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.648176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] The token cache is being invalidate because project bcf214800a0741f2aa6b3718c908e6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:23.648176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.648176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f746211e-2332-4d31-aaf9-60328e1da15b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.648910 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 765/1547] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:22 2022] DELETE /identity/v3/projects/bcf214800a0741f2aa6b3718c908e6b6 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:23.655113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbfad-2892-4668-802f-4317a9b912c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:23.656164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbfad-2892-4668-802f-4317a9b912c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:23.656979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbfad-2892-4668-802f-4317a9b912c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:23.700812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a1bbfad-2892-4668-802f-4317a9b912c7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:23.702407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a1bbfad-2892-4668-802f-4317a9b912c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:23.756696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:23.757596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:23.757822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:23.758498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] PATH_INFO: `/v3/projects/339562f9b4484bb39b68cc856afc6360` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:23.760443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=339562f9b4484bb39b68cc856afc6360)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:23.763867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:23.812685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:23.829124 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 766/1548] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:23.837972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:23.838466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:23.838828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:23.869316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:23.870943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:23.891315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339562f9b4484bb39b68cc856afc6360', 'request_id': 'req-40458039-94de-4249-8aef-ba5e91104dcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.963100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339562f9b4484bb39b68cc856afc6360', 'request_id': 'req-40458039-94de-4249-8aef-ba5e91104dcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.970891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339562f9b4484bb39b68cc856afc6360', 'request_id': 'req-40458039-94de-4249-8aef-ba5e91104dcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:23.999700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 767/1549] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:24.000727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.008438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] The token cache is being invalidate because project 339562f9b4484bb39b68cc856afc6360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:24.008687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.013828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.016327 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 783/1550] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:23 2022] DELETE /identity/v3/projects/339562f9b4484bb39b68cc856afc6360 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:24.020168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.022113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1143b-a6bf-471e-be2f-88ab51507c3e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.023937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:24.037633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.038244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.038559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.038852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.039584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:24.039769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.041755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.044751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:24.049124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40458039-94de-4249-8aef-ba5e91104dcd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.056919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 768/1551] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:24.057664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.058393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.058768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.059108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] PATH_INFO: `/v3/users/16c0e502b4cb45a0a21ab6c66793373c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.061216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.061829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c0e502b4cb45a0a21ab6c66793373c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.064287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.066904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:24.089226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4274be-32f3-48e4-b8e5-1b69de58162b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.095475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.096146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.096441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.096781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.097549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.099764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.203245 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 769/1552] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:24 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:24.207310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.274763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c0e502b4cb45a0a21ab6c66793373c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.275593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c0e502b4cb45a0a21ab6c66793373c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.343721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c0e502b4cb45a0a21ab6c66793373c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.344077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ef199-30ee-4979-95c5-60508da85e3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.360808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c0e502b4cb45a0a21ab6c66793373c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.361681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c0e502b4cb45a0a21ab6c66793373c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:24.362919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.370647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.370942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.371187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.371829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.373855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.392527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 784/1553] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:24 2022] DELETE /identity/v3/users/16c0e502b4cb45a0a21ab6c66793373c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:24.477551 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 770/1554] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:24 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:24.482245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.484004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:24.577398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a6dd8-e24c-443b-b88e-e0019bd99a45 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.582728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.583352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.583728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.584069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.584607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.586196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.602664 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 785/1555] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:24.604732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.616343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af80-77a8-4896-afc8-f64ceb6021e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.622079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.622988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.623457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.623660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.624522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.626540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f940dac-1fa0-432b-82eb-515d15eeed64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.642478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 771/1556] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:24.643263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.655438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776b1c-2b14-4ef7-a4e8-0b9afd117449 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:24.671536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:24.672270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.672549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.672816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] PATH_INFO: `/v3/projects/e164f541525243458e4be4496b3e45b4/users/6aa4944077944f2793ceb2f911f054af/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.752858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e164f541525243458e4be4496b3e45b4, user_id=6aa4944077944f2793ceb2f911f054af, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:24.756879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:24.849532 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 786/1557] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:24 2022] PUT /identity/v3/projects/e164f541525243458e4be4496b3e45b4/users/6aa4944077944f2793ceb2f911f054af/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:24.862700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:24.862700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:24.862700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:24.903674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] MFA Rules not processed for user `6aa4944077944f2793ceb2f911f054af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:24.905281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:24.966588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:24.982993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:24.984915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.012237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 772/1558] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:25.035999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.069833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:25.088435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed82c2-87d9-407f-bf5b-42b18c0bce5d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.095300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.096156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.096591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.096864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] PATH_INFO: `/v3/projects/f4645e1d7d9d442bb7597d350852de9f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.098182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4645e1d7d9d442bb7597d350852de9f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.100843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.135062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb98ac-4290-4039-9d73-aed477643ada None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.140360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.140981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.141262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.141533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.142217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.144381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a312-9d54-4728-bd5a-fd9b1fe916d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.232171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4645e1d7d9d442bb7597d350852de9f', 'request_id': 'req-7791c1bd-0977-4512-988c-3531cce0b565'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:25.247596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 773/1559] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:25.249210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097db0e-845d-447a-a7de-6b7d85ea5e40 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.249712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097db0e-845d-447a-a7de-6b7d85ea5e40 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.250186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097db0e-845d-447a-a7de-6b7d85ea5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.270585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4097db0e-845d-447a-a7de-6b7d85ea5e40 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:25.272455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4097db0e-845d-447a-a7de-6b7d85ea5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.315824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4645e1d7d9d442bb7597d350852de9f', 'request_id': 'req-7791c1bd-0977-4512-988c-3531cce0b565'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:25.322447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4645e1d7d9d442bb7597d350852de9f', 'request_id': 'req-7791c1bd-0977-4512-988c-3531cce0b565'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:25.337219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] The token cache is being invalidate because project f4645e1d7d9d442bb7597d350852de9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:25.337538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:25.338193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:25.340157 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 787/1560] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:24 2022] DELETE /identity/v3/projects/f4645e1d7d9d442bb7597d350852de9f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:25.340654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.343085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.350328 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 774/1561] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:25.351740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.352028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.352304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.374795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:25.416059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.428064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c1bd-0977-4512-988c-3531cce0b565 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.458648 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 775/1562] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:25.500363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.500363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.500363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2aa43-8ac4-4464-8c01-71ac6e18e399 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.500633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.500633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.500633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.500633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.500911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:25.500911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.500911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1b670-a615-4a27-9b9f-65a27a224fa2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.500911 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 776/1563] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:25.501645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.501783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.502001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.502106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.502260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.502357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.502709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.503399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.505648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.526295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:25.527986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:25.537321 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 777/1564] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:25.542129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.555411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad826a3-8da8-45ef-a2f3-503c311440e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.561343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.561967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.562253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.562598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.563557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:25.563722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.565309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.590429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 778/1565] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:25.595014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.605839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71c27-4939-4342-863b-5e60b349ae32 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.611474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.612139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.612405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.612672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.613520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.615927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.878326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 788/1566] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/users => generated 300 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:25.883105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.896324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef180-08db-41e4-b664-a5fa773435f6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:25.904293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:25.909208 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 779/1567] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:25.909340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:25.909340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:25.909340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:25.909340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:25.909340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:25.912679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.924752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 789/1568] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:25.929085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:25.933418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:25.940411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a680dd3-220b-4533-b430-3b667a09027a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.015400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.016594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.017806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.018492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] PATH_INFO: `/v3/projects/8f0e3746289646adad0928729ee2a102/users/ee7484a36e464dda9d1455f1f2a345ce/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.043818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0e3746289646adad0928729ee2a102, user_id=ee7484a36e464dda9d1455f1f2a345ce, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.049220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.058239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4ab82-d061-4bb3-af19-d177e30979e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.063899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.064766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.065110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.065452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.066205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.072743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.165050 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 790/1569] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:25 2022] PUT /identity/v3/projects/8f0e3746289646adad0928729ee2a102/users/ee7484a36e464dda9d1455f1f2a345ce/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:26.169026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.209664 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 780/1570] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:25 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:26.210891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.220534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc4d7-8612-4224-b37a-202edfb1916e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.238998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e387e1-33a1-4b70-80fb-8707220686dc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.244798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.245410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.245690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.245964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.246608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.248392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.259428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 791/1571] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:17:26.264121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.276901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fce489-e5ef-425b-b183-127e3f4a7fa4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.282321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.283051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.283440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.283842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] PATH_INFO: `/v3/projects/8f0e3746289646adad0928729ee2a102/users/ee7484a36e464dda9d1455f1f2a345ce/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.285959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0e3746289646adad0928729ee2a102, user_id=ee7484a36e464dda9d1455f1f2a345ce, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.288457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.289062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.289229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.289335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.289615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.290828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.292616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cca2e-0eda-4ffe-b946-d553685b8264 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.300431 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 792/1572] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:26 2022] PUT /identity/v3/projects/8f0e3746289646adad0928729ee2a102/users/ee7484a36e464dda9d1455f1f2a345ce/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:26.308799 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 781/1573] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:26.309794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.312470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b897a-e822-48f8-8746-93e3fda478e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.312762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b897a-e822-48f8-8746-93e3fda478e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.313038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b897a-e822-48f8-8746-93e3fda478e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.374685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa5b897a-e822-48f8-8746-93e3fda478e3 None None] MFA Rules not processed for user `ee7484a36e464dda9d1455f1f2a345ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:26.375960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa5b897a-e822-48f8-8746-93e3fda478e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:26.420791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:26.435740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef8927-8048-404b-9485-a67ca8db2d43 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.461116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.461862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.462174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.462416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.463141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.464917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.476936 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 793/1574] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:17:26.481824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.493662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2ebb4-0b8d-4f84-803b-aeceba4d275e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.494967 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 782/1575] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:26.499746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.500475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.500682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.500969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] PATH_INFO: `/v3/projects/2e81693181954320aa60226f0afafe42/users/dc453f1e0cd04ff5859a43e039212d55/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.503526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:26.504949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.505201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.505473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.525202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e81693181954320aa60226f0afafe42, user_id=dc453f1e0cd04ff5859a43e039212d55, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.528473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235edf3c-3550-4c8a-97f2-97fc0f9367de admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.547443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] MFA Rules not processed for user `6aa4944077944f2793ceb2f911f054af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:26.547443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:26.595210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 794/1576] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:26 2022] PUT /identity/v3/projects/2e81693181954320aa60226f0afafe42/users/dc453f1e0cd04ff5859a43e039212d55/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:26.607001 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 783/1577] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:26.608530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.608971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.609248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.613917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.615400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:26.638356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] MFA Rules not processed for user `dc453f1e0cd04ff5859a43e039212d55`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:26.639745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:26.699950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d551-c02a-453a-ba89-66d6d1cd6d59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.720271 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 795/1578] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:26.725212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.762162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:26.769379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.770068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.770485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.770720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.772995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:26.788209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb379e5-dd57-42dc-baa1-114fe05636a6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.793206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.793802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.794081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.794353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.795227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.796931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.834881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.836518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:26.845244 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 784/1579] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:17:26.868298 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 796/1580] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:26 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:26.869473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:26.888536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525820b0-9c43-488b-af38-7cdc736cfca6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:26.956271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:26.956902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:26.957174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:26.957441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:26.958060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:26.960616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.047666 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 785/1581] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:26 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:27.051497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.063079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb44c-d7a5-4770-b21f-1ef744a677fb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.069587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.070120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.070398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.070698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.071761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.073114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.088649 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 797/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:27.093209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.104307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ec88c-4187-4e50-820d-cb4be10e9f3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.112948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.113861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.114465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.114979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] PATH_INFO: `/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd/users/a7a05a96876148d3b83be3501593aba4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.145921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ad4cb34af4cf1bab3ce3f12ea3edd, user_id=a7a05a96876148d3b83be3501593aba4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.149703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.243101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 786/1583] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:27 2022] PUT /identity/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd/users/a7a05a96876148d3b83be3501593aba4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:27.247273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.258133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3a2f9-b5c4-402a-bf38-a3c23304808e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.305890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:27.319647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.320254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.320529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.320795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.321427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.324455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32151e-ac0b-43c6-94d7-8d6b4d5747c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.336177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 798/1584] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:27.346693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.375944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842dd7a-bc01-4316-841e-d5008543b0b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.392541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.393544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.393825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.394099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] PATH_INFO: `/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd/users/a7a05a96876148d3b83be3501593aba4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.396145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ad4cb34af4cf1bab3ce3f12ea3edd, user_id=a7a05a96876148d3b83be3501593aba4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.398868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.412853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 787/1585] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:27 2022] PUT /identity/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd/users/a7a05a96876148d3b83be3501593aba4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:27.424441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.424749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.425022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.455599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] MFA Rules not processed for user `a7a05a96876148d3b83be3501593aba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:27.458342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:27.543993 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 799/1586] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:27.559848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.613891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:27.630584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a591d6-d991-467c-a393-4d413d05a503 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.636127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.636719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.636999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.637266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.645071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.646855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.655852 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 788/1587] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:27.755079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:27.756459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:27.771665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef599b3-f6a5-4478-9ee0-9bc4758818fe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:27.777055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:27.777647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:27.777924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:27.778197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:27.836103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:27.837803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a05024-3029-4942-b044-eaf7ebc2dc6d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:27.852573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 800/1588] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:17:28.284765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:28.351838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dcd0a-687f-4407-accd-f2f0441f4c9e service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:28.356357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:28.356976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:28.357258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:28.357556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] PATH_INFO: `/v3/users/dc453f1e0cd04ff5859a43e039212d55` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:28.358681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc453f1e0cd04ff5859a43e039212d55)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:28.360597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:28.588550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc453f1e0cd04ff5859a43e039212d55'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:28.589199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc453f1e0cd04ff5859a43e039212d55'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:28.659175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc453f1e0cd04ff5859a43e039212d55'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:28.674978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc453f1e0cd04ff5859a43e039212d55'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:28.675842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc453f1e0cd04ff5859a43e039212d55'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:28.689855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 789/1589] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:28 2022] DELETE /identity/v3/users/dc453f1e0cd04ff5859a43e039212d55 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:28.694794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:28.695265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:28.695361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:28.715174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:28.716370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:28.778956 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 801/1590] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:28.788641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:28.790089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:28.848581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e50f5-7a08-475a-bd74-06e34446d358 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:28.852087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:28.852757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:28.853029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:28.853295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:28.862293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:28.863739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:28.873892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 790/1591] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:29.333148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:29.335589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:29.354729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c42e33-9ad1-4d1a-aa33-70c6532188d6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:29.361252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:29.362255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:29.362636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:29.363074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] PATH_INFO: `/v3/projects/2e81693181954320aa60226f0afafe42` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:29.368227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e81693181954320aa60226f0afafe42)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:29.374702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:29.374702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:29.498854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e81693181954320aa60226f0afafe42', 'request_id': 'req-137e2f23-1cb9-46cb-9943-84a9d2a4d944'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:29.561142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e81693181954320aa60226f0afafe42', 'request_id': 'req-137e2f23-1cb9-46cb-9943-84a9d2a4d944'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:29.580675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e81693181954320aa60226f0afafe42', 'request_id': 'req-137e2f23-1cb9-46cb-9943-84a9d2a4d944'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:29.603933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] The token cache is being invalidate because project 2e81693181954320aa60226f0afafe42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:29.604223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:29.605649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:29.608257 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 802/1592] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:29 2022] DELETE /identity/v3/projects/2e81693181954320aa60226f0afafe42 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:29.612230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:29.617915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:29.626778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96a687-3c75-42ee-be97-3abb83c4c4f0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:29.732320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:29.732957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:29.732957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:29.733377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] PATH_INFO: `/v3/users/a7a05a96876148d3b83be3501593aba4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:29.736625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a05a96876148d3b83be3501593aba4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:29.738977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:30.022555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a05a96876148d3b83be3501593aba4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:30.023313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a05a96876148d3b83be3501593aba4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:30.120853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a05a96876148d3b83be3501593aba4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:30.142183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a05a96876148d3b83be3501593aba4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:30.148265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48435759-afc7-4764-9b0f-526bfb2e2e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a05a96876148d3b83be3501593aba4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:30.168815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 791/1593] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:29 2022] DELETE /identity/v3/users/a7a05a96876148d3b83be3501593aba4 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:31.714713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:31.714713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:31.732409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2f23-1cb9-46cb-9943-84a9d2a4d944 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:31.815438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:31.816085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:31.816363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:31.816634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] PATH_INFO: `/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:31.817756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8ad4cb34af4cf1bab3ce3f12ea3edd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:31.820267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.036559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8ad4cb34af4cf1bab3ce3f12ea3edd', 'request_id': 'req-bbfbf69d-afc1-488e-89c8-93fa97650242'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:32.104004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8ad4cb34af4cf1bab3ce3f12ea3edd', 'request_id': 'req-bbfbf69d-afc1-488e-89c8-93fa97650242'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:32.111148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8ad4cb34af4cf1bab3ce3f12ea3edd', 'request_id': 'req-bbfbf69d-afc1-488e-89c8-93fa97650242'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:32.137759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] The token cache is being invalidate because project 4b8ad4cb34af4cf1bab3ce3f12ea3edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:32.138163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:32.141932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbfbf69d-afc1-488e-89c8-93fa97650242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:32.143949 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 803/1594] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:31 2022] DELETE /identity/v3/projects/4b8ad4cb34af4cf1bab3ce3f12ea3edd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:32.148783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ecf5-8c70-4147-8a30-d271b04e223d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.149317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ecf5-8c70-4147-8a30-d271b04e223d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.149317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ecf5-8c70-4147-8a30-d271b04e223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.182934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0b6ecf5-8c70-4147-8a30-d271b04e223d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:32.184298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0b6ecf5-8c70-4147-8a30-d271b04e223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:32.287650 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 792/1595] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:32.292745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.294298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.297361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.304447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba08cc-e7ac-4fa4-9c8e-bd61c4972d96 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.304798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba08cc-e7ac-4fa4-9c8e-bd61c4972d96 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.305133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba08cc-e7ac-4fa4-9c8e-bd61c4972d96 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.308119 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 793/1596] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:17:32.325833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.325833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.325833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.344664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:32.348482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:32.353716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:32.355835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:32.366173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 804/1597] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:32.371920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.385249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd1d1-0972-4bb2-98f5-5eb0451bcd28 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.392508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.395070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.395070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.395070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.395070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:32.395070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.396487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.412870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:32.427523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:32.438093 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 805/1598] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:32.439736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.456942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed5fa4-5ef1-449a-bac6-1126dc48cd07 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.463646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.464412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.464618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.465623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.466859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.469182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.512975 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 794/1599] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:32.557091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 806/1600] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:32 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:32.562504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.577324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763d81e-8ec0-414c-8955-a32c1a78e1cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.678698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.680469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.680904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.681344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.683391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.687924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.772312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.776439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:32.802683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 795/1601] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:32 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:32.807880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.822210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167a1b-d297-404d-ba59-ef3fc8174bf1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.828303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.829558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.829946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.830310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.831573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.833341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.846874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 796/1602] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:32.851558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.861338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6526f-a830-4659-8221-07a7b935c302 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.866591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.867255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.867533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.867857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.868475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.870086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.872302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14708-9425-4a40-8a00-9c7d79dcf65b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.881400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.882193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.882662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.882905 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 797/1603] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:32.883093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.886949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:32.894189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.908546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca375-1cef-43eb-b23a-985620d20680 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:32.908674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6261-12e2-430b-a5a6-15fa65b834d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:32.910981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 807/1604] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:32.913418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:32.914141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:32.914421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:32.914819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] PATH_INFO: `/v3/projects/bbf224bcc68b41cdbfb5e6cdf8017138/users/f468a0a0d40b45ed8d3e826a7988b00e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:32.931882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf224bcc68b41cdbfb5e6cdf8017138, user_id=f468a0a0d40b45ed8d3e826a7988b00e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:32.934582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.016129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.016523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.016962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.021173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 798/1605] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:32 2022] PUT /identity/v3/projects/bbf224bcc68b41cdbfb5e6cdf8017138/users/f468a0a0d40b45ed8d3e826a7988b00e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:33.054583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] MFA Rules not processed for user `f468a0a0d40b45ed8d3e826a7988b00e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:33.055912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:33.140472 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 808/1606] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:33.145157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.211474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:33.215476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723ba4c-9be0-43d0-ae88-9d0a811ffa65 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.230668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.233502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.233502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.233502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.233502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.235790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.346260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 799/1607] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:33 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:33.349613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.366259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3203a-d6e0-47c3-9fa5-a5198df45362 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.421285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:33.431290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.432201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.432565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.432897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.433599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.435806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.541338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 809/1608] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:33 2022] POST /identity/v3/users => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:33.542444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.556564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5608c4-9792-4ae9-ab46-2c126efd3b20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.562605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.563321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.563649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.564648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.564763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.568124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.581654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 800/1609] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:33.585897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.596159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bb43-b4a4-40cd-9803-48921927badf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.601382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.602039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.602318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.602590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] PATH_INFO: `/v3/projects/dd42526b4b8149618305b747eab15e99/users/7582c604c5eb40fdb0e41c78e2ea5df6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.620124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42526b4b8149618305b747eab15e99, user_id=7582c604c5eb40fdb0e41c78e2ea5df6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.622457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.735319 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 810/1610] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:33 2022] PUT /identity/v3/projects/dd42526b4b8149618305b747eab15e99/users/7582c604c5eb40fdb0e41c78e2ea5df6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:33.735515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.743038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0add-829f-4988-9f2b-a8a95eb33955 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.803394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.804070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.804417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.804755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.805487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.807205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a16a83-6b7b-46a1-88c2-37d52defa684 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.830134 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 801/1611] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:33.833953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:33.845451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f526-c491-44ad-bcdd-420f7ff8506f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:33.850994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:33.851687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.851804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.852099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] PATH_INFO: `/v3/projects/dd42526b4b8149618305b747eab15e99/users/7582c604c5eb40fdb0e41c78e2ea5df6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.855297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42526b4b8149618305b747eab15e99, user_id=7582c604c5eb40fdb0e41c78e2ea5df6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:33.858058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:33.871603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 811/1612] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:33 2022] PUT /identity/v3/projects/dd42526b4b8149618305b747eab15e99/users/7582c604c5eb40fdb0e41c78e2ea5df6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:33.882041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb34ce-1e34-486e-ba2c-3506cc707279 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:33.882326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb34ce-1e34-486e-ba2c-3506cc707279 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:33.882604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb34ce-1e34-486e-ba2c-3506cc707279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:33.914425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5abb34ce-1e34-486e-ba2c-3506cc707279 None None] MFA Rules not processed for user `7582c604c5eb40fdb0e41c78e2ea5df6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:33.920278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5abb34ce-1e34-486e-ba2c-3506cc707279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:34.001899 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 802/1613] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:34.095517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:34.166484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100c73-276b-4809-b36d-7658f6fb462f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:34.171166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:34.171788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:34.172081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:34.172344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] PATH_INFO: `/v3/users/f468a0a0d40b45ed8d3e826a7988b00e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:34.173471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f468a0a0d40b45ed8d3e826a7988b00e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:34.175512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:34.357087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f468a0a0d40b45ed8d3e826a7988b00e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:34.357667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f468a0a0d40b45ed8d3e826a7988b00e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:34.457883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f468a0a0d40b45ed8d3e826a7988b00e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:34.471363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f468a0a0d40b45ed8d3e826a7988b00e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:34.472119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f468a0a0d40b45ed8d3e826a7988b00e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:34.485265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 812/1614] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:34 2022] DELETE /identity/v3/users/f468a0a0d40b45ed8d3e826a7988b00e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:34.489581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:34.490050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:34.490188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:34.509806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:34.511258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:34.560134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:34.572696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 803/1615] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:34.582537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:34.584692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:34.616929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:34.644875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d119a-f19e-45ee-a990-503a145e3058 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:34.649099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:34.649688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:34.649960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:34.650227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:34.659623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:34.661048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:34.670571 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 813/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:35.054687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:35.056405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:35.069265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57098-f856-44be-bc35-0c539ba240a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:35.074606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:35.075403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:35.075708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:35.076045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] PATH_INFO: `/v3/projects/bbf224bcc68b41cdbfb5e6cdf8017138` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:35.077263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf224bcc68b41cdbfb5e6cdf8017138)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:35.079527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:35.243157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf224bcc68b41cdbfb5e6cdf8017138', 'request_id': 'req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.298046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf224bcc68b41cdbfb5e6cdf8017138', 'request_id': 'req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.313451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf224bcc68b41cdbfb5e6cdf8017138', 'request_id': 'req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.325333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] The token cache is being invalidate because project bbf224bcc68b41cdbfb5e6cdf8017138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:35.325638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.326287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.327849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 804/1617] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:35 2022] DELETE /identity/v3/projects/bbf224bcc68b41cdbfb5e6cdf8017138 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:35.332426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:35.342184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992073-4fd4-4af4-ab13-56719dffc23f service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:35.518114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:35.518774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:35.519054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:35.519326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] PATH_INFO: `/v3/users/7582c604c5eb40fdb0e41c78e2ea5df6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:35.520447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7582c604c5eb40fdb0e41c78e2ea5df6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:35.522927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:35.702940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7582c604c5eb40fdb0e41c78e2ea5df6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.703976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7582c604c5eb40fdb0e41c78e2ea5df6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.800705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7582c604c5eb40fdb0e41c78e2ea5df6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.821279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7582c604c5eb40fdb0e41c78e2ea5df6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.822233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df8b2e7c-158b-46a3-b06c-ce475c5c0dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7582c604c5eb40fdb0e41c78e2ea5df6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:35.836402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 814/1618] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:35 2022] DELETE /identity/v3/users/7582c604c5eb40fdb0e41c78e2ea5df6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:36.339642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:36.348254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:36.354877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b624-3fd5-4e11-9c92-c7d6e842b9ae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:36.422656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:36.423241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:36.423522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:36.423866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] PATH_INFO: `/v3/projects/dd42526b4b8149618305b747eab15e99` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:36.425104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd42526b4b8149618305b747eab15e99)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:36.427108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:36.554291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd42526b4b8149618305b747eab15e99', 'request_id': 'req-1ce219eb-8560-4765-b490-bb6148dc89a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:36.634993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd42526b4b8149618305b747eab15e99', 'request_id': 'req-1ce219eb-8560-4765-b490-bb6148dc89a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:36.641858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd42526b4b8149618305b747eab15e99', 'request_id': 'req-1ce219eb-8560-4765-b490-bb6148dc89a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:36.654107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] The token cache is being invalidate because project dd42526b4b8149618305b747eab15e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:36.654396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:36.655091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ce219eb-8560-4765-b490-bb6148dc89a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:36.656955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 805/1619] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:36 2022] DELETE /identity/v3/projects/dd42526b4b8149618305b747eab15e99 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:36.663817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:36.664499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:36.664838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:36.685866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:36.687151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:36.742298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:36.756241 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 815/1620] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:36.763364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:36.763698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:36.763928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:36.778398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:36.784030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:36.785237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:36.794579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 806/1621] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:36.799463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:36.809333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484723e9-49b0-4cc5-8351-dc60642638f8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:36.813944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:36.814544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:36.814876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:36.815269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:36.815907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:36.816202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:36.817798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:36.829176 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 816/1622] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:36.833500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:36.843088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50d92-e0c3-49e6-ae70-f83032fdf60f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:36.848612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:36.849216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:36.850018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:36.850481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:36.851196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:36.857296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:36.940735 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 807/1623] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:36 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:36.944987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:36.956309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcee0f-6b65-46fe-ae18-0ecddeb19bb6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:37.059361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:37.059978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.060351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.060505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.061155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:37.063341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:37.169099 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 817/1624] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:36 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:37.173196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:37.184585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120092-d2f6-48a4-825e-a0b821db6f1c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:37.190658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:37.190658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.190658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.195101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.195101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:37.195101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:37.203604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 808/1625] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:17:37.207652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:37.226943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc30ee8-3218-4caa-b6f2-f4e34720ee87 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:37.232085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:37.232766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.233150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.233516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.234257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:37.236039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf540b-0d91-4404-8c6a-67c49d205aa2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:37.250115 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 818/1626] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:37.254970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:37.269198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203c29-a08f-4412-bae7-432ee3b84502 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:37.274650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:37.275452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.275599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.275878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] PATH_INFO: `/v3/projects/23c727ce3707474d9cd8cbcd2d854526/users/f39fdca40d9b4035a56b79e13b375b4f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.293350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c727ce3707474d9cd8cbcd2d854526, user_id=f39fdca40d9b4035a56b79e13b375b4f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:37.296237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:37.385249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 809/1627] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:37 2022] PUT /identity/v3/projects/23c727ce3707474d9cd8cbcd2d854526/users/f39fdca40d9b4035a56b79e13b375b4f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:37.397354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.397634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.397898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.417058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:37.422051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:37.475859 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 819/1628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:37.486496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:37.488935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:37.546711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e626b-9d7d-4ae7-b1bc-7a3d29247ac6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:37.550328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:37.550968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:37.551242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:37.551512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:37.560764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:37.562209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:37.578826 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 810/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:38.548740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:38.550248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:38.605421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:38.625919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c893a-2c43-49d8-9edb-ed4ab90c1ed6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:38.631445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:38.632084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:38.633182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:38.633182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:38.634458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:38.697534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:38.699181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9346cd-b704-45ae-85ab-2d9f5147ddb0 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:38.709557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 820/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:42.776992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:42.778496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:42.800668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf123-bb5a-4f4b-994f-9067c0aa3924 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:42.806832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:42.807449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:42.807733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:42.808009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:42.809748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:42.888937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:42.890938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa30a7-0540-4370-a5aa-555e93200376 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:42.902132 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 811/1631] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:43.293781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697e7d-75fe-4319-a74d-53ceaceb655e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:43.294326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697e7d-75fe-4319-a74d-53ceaceb655e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:43.294326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697e7d-75fe-4319-a74d-53ceaceb655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:43.315446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fe697e7d-75fe-4319-a74d-53ceaceb655e None None] MFA Rules not processed for user `6aa4944077944f2793ceb2f911f054af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:43.316722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fe697e7d-75fe-4319-a74d-53ceaceb655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:43.402117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 821/1632] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:44.472266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:44.473531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:44.473971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:44.514486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] MFA Rules not processed for user `966c0b1c2b3540c0b12c59fa3d5b8c78`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:44.515988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:44.579461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:44.607993 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 812/1633] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:44.741626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930146-265e-4067-80cb-05100636ffcc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:44.742185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930146-265e-4067-80cb-05100636ffcc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:44.742438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930146-265e-4067-80cb-05100636ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:44.805208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cd930146-265e-4067-80cb-05100636ffcc None None] MFA Rules not processed for user `f39fdca40d9b4035a56b79e13b375b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:44.808481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd930146-265e-4067-80cb-05100636ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:44.914893 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 822/1634] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:44.920029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:44.935059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca450f-1ac2-4ebd-b99e-191658ac91da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:44.946841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:44.947559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:44.947922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:44.948456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:44.949155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:44.951865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.054755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 813/1635] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:44 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:45.058935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd930146-265e-4067-80cb-05100636ffcc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.072726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd930146-265e-4067-80cb-05100636ffcc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.097841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:45.143131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.143812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.144232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.144507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.145145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.147892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.267950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 823/1636] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:45 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:45.270545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.283431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef534-4696-44da-a134-0ec91b344303 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.288549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.289355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.289749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.290011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.290683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.292533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.304951 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 814/1637] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:45.309379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.344675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fdde3-e233-467d-a670-782d40e62ff8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.351978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.352734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.369590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.370173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] PATH_INFO: `/v3/projects/952f3ce772294049a0b616569a41a49e/users/af9f49caadab4b9fb768056518420524/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.401872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=952f3ce772294049a0b616569a41a49e, user_id=af9f49caadab4b9fb768056518420524, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.408394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7065cf4-5042-42fa-8ccf-154268f928fc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.510926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 824/1638] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:45 2022] PUT /identity/v3/projects/952f3ce772294049a0b616569a41a49e/users/af9f49caadab4b9fb768056518420524/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:45.514753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.544204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b407-ddd3-4cfd-b58b-f8db6a24b98f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.566986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e638a-2c7f-485c-af7d-f7780bd02366 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.567265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e638a-2c7f-485c-af7d-f7780bd02366 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.567535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e638a-2c7f-485c-af7d-f7780bd02366 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.569557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 825/1639] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:17:45.575887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.576168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.579673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.598549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:45.600641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:45.627118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.627875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.628784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.629061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.629708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.632063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.647643 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 815/1640] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:45.652035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.681369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72caf4-9911-4b92-afa5-3b862418fa31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.688873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.689991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.690473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.690977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] PATH_INFO: `/v3/projects/952f3ce772294049a0b616569a41a49e/users/af9f49caadab4b9fb768056518420524/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.693753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=952f3ce772294049a0b616569a41a49e, user_id=af9f49caadab4b9fb768056518420524, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.698723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.720822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 816/1641] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:45 2022] PUT /identity/v3/projects/952f3ce772294049a0b616569a41a49e/users/af9f49caadab4b9fb768056518420524/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:45.729445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 826/1642] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:45.754806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:45.756851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:45.861470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86d6c-6484-42bd-83a4-d77c12075fdd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:45.868352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:45.869240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:45.869666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:45.870170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:45.882595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:45.885121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d6ef-0c54-4571-a6c8-3fcd6deac4ad service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:45.897113 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 817/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:50.968304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:50.969897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:50.997222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fab3b9-6d1d-4281-a845-de434e6e7a0b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:51.159113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:51.160013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:51.161257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:51.162963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] PATH_INFO: `/v3/users/d84b156065f64bea8d49ed172496aa10` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:51.167046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84b156065f64bea8d49ed172496aa10)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:51.174076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:51.231345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:51.406942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84b156065f64bea8d49ed172496aa10'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:51.415214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84b156065f64bea8d49ed172496aa10'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:51.493263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84b156065f64bea8d49ed172496aa10'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:51.514539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84b156065f64bea8d49ed172496aa10'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:51.519190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84b156065f64bea8d49ed172496aa10'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:51.545811 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 827/1644] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:50 2022] DELETE /identity/v3/users/d84b156065f64bea8d49ed172496aa10 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:51.550526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:51.555151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:51.555532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:51.602230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:51.603494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:51.636037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:51.728916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 818/1645] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:17:51.734307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:51.742302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:51.804529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa548-5417-4d72-9e0d-743bf48c5a88 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:51.808932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:51.809739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:51.810495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:51.811059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:51.831450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:51.833037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:51.845566 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 828/1646] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:52.271618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:52.276037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:52.328523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa746f-a528-4807-abd9-b4f380c102fa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:52.354415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:52.355368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:52.355907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:52.356384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] PATH_INFO: `/v3/users/c872e1855266474bb330f986ef9bdaeb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:52.362929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c872e1855266474bb330f986ef9bdaeb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:52.365764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:52.678421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c872e1855266474bb330f986ef9bdaeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:52.680093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c872e1855266474bb330f986ef9bdaeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:52.767935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c872e1855266474bb330f986ef9bdaeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:52.810241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:52.814101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:52.821772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c872e1855266474bb330f986ef9bdaeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:52.822668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c23c62ec-2321-49ec-bdf1-b48c29bae250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c872e1855266474bb330f986ef9bdaeb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:52.843859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e844d-cea0-4c97-9d53-d09353d89137 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:52.855877 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 819/1647] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:52 2022] DELETE /identity/v3/users/c872e1855266474bb330f986ef9bdaeb => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:52.857884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:52.861003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:52.861433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:52.861920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:52.862060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:52.862492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:52.862997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] PATH_INFO: `/v3/projects/5d70666d05314990a04d8178e7ec929b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:52.866862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d70666d05314990a04d8178e7ec929b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:52.871457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:52.891816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:52.893777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:52.996267 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 820/1648] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:53.008827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:53.017001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.051461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d70666d05314990a04d8178e7ec929b', 'request_id': 'req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.102667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:53.142820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004234a-a87c-4e0c-9c48-0442bb70d1ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:53.162074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d70666d05314990a04d8178e7ec929b', 'request_id': 'req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.170897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d70666d05314990a04d8178e7ec929b', 'request_id': 'req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.192449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] The token cache is being invalidate because project 5d70666d05314990a04d8178e7ec929b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:53.192746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.201089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.209769 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 829/1649] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:52 2022] DELETE /identity/v3/projects/5d70666d05314990a04d8178e7ec929b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:17:53.209769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:53.211593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.271836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:53.272495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:53.272845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:53.273271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:53.275177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.287018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:53.335489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12491-44e9-4dc8-b5bc-cf571efa8bc2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:53.342076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:53.343301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:53.343301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:53.343687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] PATH_INFO: `/v3/users/1b12dc29f05a4a7886d1e5673a1bbbd6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:53.345130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b12dc29f05a4a7886d1e5673a1bbbd6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:53.347662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:53.421206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:53.422772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:53.434909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 821/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:17:53.436313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:53.437685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.462343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dedadd-f5bb-4418-b54e-0741ad16cdd0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:53.473102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:53.473749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:53.474024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:53.474307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] PATH_INFO: `/v3/users/5fccff465af041299cce6697d83bab88` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:53.476999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fccff465af041299cce6697d83bab88)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:53.479100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:53.525987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b12dc29f05a4a7886d1e5673a1bbbd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.527252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b12dc29f05a4a7886d1e5673a1bbbd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.619048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b12dc29f05a4a7886d1e5673a1bbbd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.634935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b12dc29f05a4a7886d1e5673a1bbbd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.635763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b12dc29f05a4a7886d1e5673a1bbbd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.651960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 830/1651] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:53 2022] DELETE /identity/v3/users/1b12dc29f05a4a7886d1e5673a1bbbd6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:53.651960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:53.651960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.743506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fccff465af041299cce6697d83bab88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.747184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fccff465af041299cce6697d83bab88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.780755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c29d6-bf03-4d06-b7ed-a2a3ebcbfcaf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:53.804272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:53.805670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:53.806701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:53.806980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:53.809194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.819018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fccff465af041299cce6697d83bab88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.861166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fccff465af041299cce6697d83bab88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.862995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e5c51-e77b-4941-be23-7f341fc452dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fccff465af041299cce6697d83bab88'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:53.885694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 822/1652] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:53 2022] DELETE /identity/v3/users/5fccff465af041299cce6697d83bab88 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:53.885694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:53.885694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:53.885694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:53.914765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:53.916061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:53.951001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:53.956264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:53.979789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 831/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:54.079516 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 823/1654] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:54.094249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:54.108303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:54.213777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:54.224933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14c23-4770-4448-b2ba-19f88c43c6c0 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:54.251621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:54.253211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:54.280073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:54.295781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52900dd-7904-4e25-81cd-3e2295330be3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:54.316311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:54.316889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:54.317175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:54.317452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] PATH_INFO: `/v3/projects/1460237b2f76428ab48d1c7b97304818` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:54.320542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1460237b2f76428ab48d1c7b97304818)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:54.325984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:54.481506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:54.483411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:54.484895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:54.485671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1460237b2f76428ab48d1c7b97304818', 'request_id': 'req-9e6e225b-7180-4591-85b8-d325b59db3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:54.486227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:54.504726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:54.507386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:54.520575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 832/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:54.556581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1460237b2f76428ab48d1c7b97304818', 'request_id': 'req-9e6e225b-7180-4591-85b8-d325b59db3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:54.569789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1460237b2f76428ab48d1c7b97304818', 'request_id': 'req-9e6e225b-7180-4591-85b8-d325b59db3dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:54.608144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] The token cache is being invalidate because project 1460237b2f76428ab48d1c7b97304818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:54.608848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:54.609591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:54.619523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:54.632752 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 824/1656] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:54 2022] DELETE /identity/v3/projects/1460237b2f76428ab48d1c7b97304818 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:54.638849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de456a-3a81-4fb0-ba3d-a7dbe39d7632 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:54.856122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:54.856122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:54.856122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:54.856122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] PATH_INFO: `/v3/users/8d56bdac410c4a829047abea07fdc619` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:54.859010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d56bdac410c4a829047abea07fdc619)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:54.861219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.114533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d56bdac410c4a829047abea07fdc619'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.115806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d56bdac410c4a829047abea07fdc619'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.125284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:55.132548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.161259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e225b-7180-4591-85b8-d325b59db3dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:55.167366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:55.168211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.169439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.169729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] PATH_INFO: `/v3/projects/c3ed8da6387c49109d583c76c6088f6d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.171401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ed8da6387c49109d583c76c6088f6d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:55.173490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.224484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d56bdac410c4a829047abea07fdc619'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.237166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d56bdac410c4a829047abea07fdc619'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.237831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d56bdac410c4a829047abea07fdc619'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.251106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 833/1657] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:54 2022] DELETE /identity/v3/users/8d56bdac410c4a829047abea07fdc619 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:55.254025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:55.254025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.303925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ed8da6387c49109d583c76c6088f6d', 'request_id': 'req-186fdb71-0615-4b66-adc8-4ab2ea1443e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.336900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd8d5-677a-4aed-ab90-dbc6f0ae3cfe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:55.406387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:55.407330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.407671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.408199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] PATH_INFO: `/v3/projects/00c0158bb115492eb04ab83a4cd824d6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.411125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c0158bb115492eb04ab83a4cd824d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:55.419595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.425536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ed8da6387c49109d583c76c6088f6d', 'request_id': 'req-186fdb71-0615-4b66-adc8-4ab2ea1443e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.426604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:55.433545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ed8da6387c49109d583c76c6088f6d', 'request_id': 'req-186fdb71-0615-4b66-adc8-4ab2ea1443e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.448200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] The token cache is being invalidate because project c3ed8da6387c49109d583c76c6088f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:55.448200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.448973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-186fdb71-0615-4b66-adc8-4ab2ea1443e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.454242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 825/1658] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:55 2022] DELETE /identity/v3/projects/c3ed8da6387c49109d583c76c6088f6d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:55.455892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4696-ecc5-4982-a798-65b023974638 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.456319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4696-ecc5-4982-a798-65b023974638 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.456683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4696-ecc5-4982-a798-65b023974638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.478021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5bba4696-ecc5-4982-a798-65b023974638 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:55.479391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bba4696-ecc5-4982-a798-65b023974638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.489220 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 826/1659] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:55.499410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.499888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.501161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.529081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:55.530315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.550452 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 827/1660] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:55.559618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:55.580956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d562-a4bf-411a-a4a3-2064060e1fe3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:55.587792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c0158bb115492eb04ab83a4cd824d6', 'request_id': 'req-925d094e-4e05-4ba9-815b-37d015874078'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.596333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:55.687838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c0158bb115492eb04ab83a4cd824d6', 'request_id': 'req-925d094e-4e05-4ba9-815b-37d015874078'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.698387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c0158bb115492eb04ab83a4cd824d6', 'request_id': 'req-925d094e-4e05-4ba9-815b-37d015874078'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.749898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] The token cache is being invalidate because project 00c0158bb115492eb04ab83a4cd824d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:55.751413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.752761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:55.778221 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 834/1661] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:55 2022] DELETE /identity/v3/projects/00c0158bb115492eb04ab83a4cd824d6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:55.784305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:55.785890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.787950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:55.792008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.792008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.792008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.792008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:55.792008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:55.799060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.830584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d094e-4e05-4ba9-815b-37d015874078 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:55.833499 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 828/1662] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:17:55.842328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:55.842904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:55.843562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.843842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.844116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] PATH_INFO: `/v3/users/d096bc2c0c8f47539540c526dbe438c8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.845194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:55.845325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d096bc2c0c8f47539540c526dbe438c8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:55.847900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.867617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cb63d-8a40-4c7e-adeb-b0fe8fae0814 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:55.876616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:55.877498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:55.877874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:55.878242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:55.879127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:55.881353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853626-44c8-4cec-bb58-9cf222658e55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:55.995829 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 829/1663] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:55 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:17:56.002939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.003220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.003507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.086997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd096bc2c0c8f47539540c526dbe438c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.087964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd096bc2c0c8f47539540c526dbe438c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.109433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] MFA Rules not processed for user `af9f49caadab4b9fb768056518420524`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:56.110736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.225073 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 830/1664] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:56.226069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.228655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.235593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd096bc2c0c8f47539540c526dbe438c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.254476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd096bc2c0c8f47539540c526dbe438c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.256500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8c07a176-25e7-40c3-948a-799c6d37ce7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd096bc2c0c8f47539540c526dbe438c8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.273325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 835/1665] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:55 2022] DELETE /identity/v3/users/d096bc2c0c8f47539540c526dbe438c8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:56.275622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.276721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.277146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.306185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] MFA Rules not processed for user `f39fdca40d9b4035a56b79e13b375b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:56.310165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.316934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889a1d4-a320-4657-9bed-d1b956431098 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.399983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 836/1666] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:56.401806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.403466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.419623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.419623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.419623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.419623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.423058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070cbe7-e3e3-4a3e-a891-ca412d20db45 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.424479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.427114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:56.428998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.429634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.429910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.430249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] PATH_INFO: `/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.432123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d4d6dac49d48f09e68e9a14f8eb1c5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.434008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:56.548636 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 831/1667] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:56 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:56.549493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.551435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.624376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d4d6dac49d48f09e68e9a14f8eb1c5', 'request_id': 'req-a504427d-0404-4e88-a903-f728d486d0c4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.699764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ecd9-ecb8-426e-a8cf-55d049f79823 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.727026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d4d6dac49d48f09e68e9a14f8eb1c5', 'request_id': 'req-a504427d-0404-4e88-a903-f728d486d0c4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.733695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d4d6dac49d48f09e68e9a14f8eb1c5', 'request_id': 'req-a504427d-0404-4e88-a903-f728d486d0c4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.759858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] The token cache is being invalidate because project 26d4d6dac49d48f09e68e9a14f8eb1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:56.760327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.761648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:56.763758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 837/1668] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:56 2022] DELETE /identity/v3/projects/26d4d6dac49d48f09e68e9a14f8eb1c5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:56.765060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.767308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.814913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.815774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.816266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.816831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.819728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.871234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504427d-0404-4e88-a903-f728d486d0c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.881390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.882970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.883269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.883546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.887372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.889250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:56.909507 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 838/1669] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:56.911317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.913565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.915636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.917688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f94f1b-ba7f-4718-bfeb-73055fd2d4b1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:56.926966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4b8d7-5a23-451c-9f59-943f40a7e0d5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.928825 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 832/1670] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:56.930024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.930309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.930582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.941864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.942741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.943159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.943525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] PATH_INFO: `/v3/projects/083202bc18da4766a8a01cd45c2bd538` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.945671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083202bc18da4766a8a01cd45c2bd538)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.948369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:56.951236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:56.952454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:56.968054 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 833/1671] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:56.968054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:56.973186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076c2f-ebb2-4e3f-abf0-70ad7bd89dd6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:56.982373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:56.983008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:56.983282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:56.983551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:56.984191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:56.986119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b36c-a7d6-47ee-ab7f-18ae7a53ad90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:57.010161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 834/1672] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:57.011541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.011830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.012885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.019212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:57.056130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:57.057868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.072467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083202bc18da4766a8a01cd45c2bd538', 'request_id': 'req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:57.143679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 835/1673] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:57.143679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.153766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbd38b-6418-4acf-af2c-c2f79f76ad00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:57.159160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:57.159997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.160279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.160551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] PATH_INFO: `/v3/projects/01b9e87539e040c0a7589c7aa497c7c2/users/c0b6ec1b35b041b8bed4e55b9312a63a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.160984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083202bc18da4766a8a01cd45c2bd538', 'request_id': 'req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:57.169610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083202bc18da4766a8a01cd45c2bd538', 'request_id': 'req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:57.188924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] The token cache is being invalidate because project 083202bc18da4766a8a01cd45c2bd538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:17:57.189226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:57.190609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:57.193408 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 839/1674] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:17:56 2022] DELETE /identity/v3/projects/083202bc18da4766a8a01cd45c2bd538 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:57.194203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.196473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.198752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b9e87539e040c0a7589c7aa497c7c2, user_id=c0b6ec1b35b041b8bed4e55b9312a63a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:57.201322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83369c1e-6ff5-47fd-a565-893fb6b2ca81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:57.220451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299804-d3d0-43cf-bb7d-e8e6e9d6ca56 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:57.226872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:57.227617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.228013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.228407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.229122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:57.229537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:57.231328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5920-96a8-4265-bdea-497e1b91b23f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:57.246666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 840/1675] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:57.247435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.247736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.248060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.295019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:57.295019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.310122 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 841/1676] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:57.310122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.322540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e67534-3546-4790-bf44-b7701515c641 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:57.325614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:57.326340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.326740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.327106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.327835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:57.329867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:57.687682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 836/1677] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:57 2022] PUT /identity/v3/projects/01b9e87539e040c0a7589c7aa497c7c2/users/c0b6ec1b35b041b8bed4e55b9312a63a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:57.689083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da8be-404a-418f-aa7a-362391deab14 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.689347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da8be-404a-418f-aa7a-362391deab14 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.689637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da8be-404a-418f-aa7a-362391deab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.710761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e8da8be-404a-418f-aa7a-362391deab14 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:57.714875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e8da8be-404a-418f-aa7a-362391deab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.778388 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 837/1678] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:57.778388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.778388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.778388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.805830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] MFA Rules not processed for user `c0b6ec1b35b041b8bed4e55b9312a63a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:57.807165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.825116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 842/1679] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/projects => generated 381 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:57.826084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.927534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 838/1680] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:57.930531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.934995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83160a4-e183-4a14-8d6c-aa1a9693fe8b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:57.940854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:57.941741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.942635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.943976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.945664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:17:57.946186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:57.948181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:57.962602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae4e8a-23b0-4a07-840a-cddb1f671a70 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:57.966707 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 843/1681] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:17:57.967891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:57.972630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:57.985722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:57.985722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:57.985722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:57.985722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:57.986075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:57.988855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.018240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86260-f6f2-452f-9529-d66595d9c35b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.038209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.039534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.039534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.039534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.040378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.042746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.105024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 839/1682] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:58.106066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.118922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf23-704a-49ed-92a5-c43db31bf18c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.131883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.131883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.131883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.131883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.132500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.133378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.188324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 844/1683] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:57 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:58.189368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.237480 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 840/1684] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:58 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:58.238364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.265539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f565d-1290-41fa-a781-929fd0808d51 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.305548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088973-2a0a-4c62-9d17-e18676d8841e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.313281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.313822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.314104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.314380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.315101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.317149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.330502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.332108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.332465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.332806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.333547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.335631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.349069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 845/1685] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:58.349069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.349903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:58.362642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a8d3-fe6b-4198-b9f1-0cf531f20b00 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.368222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.368938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.369281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.369622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] PATH_INFO: `/v3/users/a42ab28845dd4d78b8e7d7532b278bed` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.371117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42ab28845dd4d78b8e7d7532b278bed)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.373226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.416517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 841/1686] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:58 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:58.416517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.431157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762c9d-fd4d-4336-9ed0-19998e166122 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.440375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.445404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.445404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.445404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.445404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.445404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.545575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 842/1687] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:58 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:58.546490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.558243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e759fb-67a9-4843-9fdc-8665f4468702 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.563405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.564016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.564302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.565039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.565213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.566885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.578095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 843/1688] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:58.579034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.592717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b0c1-4c52-4a70-a7ef-5bab75e17b5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.600436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.600436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.600436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.600436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.600804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.601443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.611425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 844/1689] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:58.612265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.623374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2a40-7dbf-45be-909a-8370beb2070e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.629490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.630315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.630635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.630935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.631695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.633439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.634540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42ab28845dd4d78b8e7d7532b278bed'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:58.635483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42ab28845dd4d78b8e7d7532b278bed'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:58.643937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 845/1690] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:58.644837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.648688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:58.662316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f18a-e82c-4bcb-a96e-de5f36379617 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.667821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.668503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.668768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.669025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] PATH_INFO: `/v3/projects/59a8f35ff08f408385004a7723614d1f/users/f285f4d54c794b82a2f2577ff9e2583e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.693655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a8f35ff08f408385004a7723614d1f, user_id=f285f4d54c794b82a2f2577ff9e2583e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.696829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.715878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42ab28845dd4d78b8e7d7532b278bed'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:58.732610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42ab28845dd4d78b8e7d7532b278bed'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:58.734840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42ab28845dd4d78b8e7d7532b278bed'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:17:58.747580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 846/1691] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:17:58 2022] DELETE /identity/v3/users/a42ab28845dd4d78b8e7d7532b278bed => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:58.748590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.750153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:58.764429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 846/1692] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:58 2022] PUT /identity/v3/projects/59a8f35ff08f408385004a7723614d1f/users/f285f4d54c794b82a2f2577ff9e2583e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:58.768246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:58.768246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:58.782248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:58.839045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f85-6b05-4c4c-9c44-4a7622ebedac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.868717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e981b-1a77-48ef-b2a0-1c356e42f51e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:58.884950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.891251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.891593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.891871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.898246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.904944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eba850-aa8a-4cdb-b45f-15ad6246eb82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:58.918488 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 847/1693] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:58.922652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede101-cb8d-44fe-b60f-e9bc21cb6839 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.922652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede101-cb8d-44fe-b60f-e9bc21cb6839 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.922652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede101-cb8d-44fe-b60f-e9bc21cb6839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.948026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:58.949397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.950020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.950296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] PATH_INFO: `/v3/projects/9da35c8bd9e14f18b93d06b69177d878/users/791b629ac9d3439aaebfb3effb3d085d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.951863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8cede101-cb8d-44fe-b60f-e9bc21cb6839 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:58.953120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cede101-cb8d-44fe-b60f-e9bc21cb6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:58.972281 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 848/1694] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:58.973376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:58.973665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:58.973940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:58.984027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da35c8bd9e14f18b93d06b69177d878, user_id=791b629ac9d3439aaebfb3effb3d085d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:58.989095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.009686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] MFA Rules not processed for user `f285f4d54c794b82a2f2577ff9e2583e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:59.012571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:59.093698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 847/1695] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:58 2022] PUT /identity/v3/projects/9da35c8bd9e14f18b93d06b69177d878/users/791b629ac9d3439aaebfb3effb3d085d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:59.103702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.104675 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 849/1696] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:59.107215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.108881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:59.185207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35482-9442-4d15-9d46-0c667f82fc3b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.248275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b62ba-b4a8-4235-ac6c-d6d92ffdf8ac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.274175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.275531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.275977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.276307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] PATH_INFO: `/v3/projects/b93338bc1b894cffb5dc61482333de42/users/c17be56414f04978b610faf2ec13b425/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.285247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.287185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.287185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.287730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.294029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93338bc1b894cffb5dc61482333de42, user_id=c17be56414f04978b610faf2ec13b425, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.297522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.300277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.302196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.313933 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 850/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:17:59.318794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.326586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac1e5-59f3-470b-a929-ea2bce884461 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.333137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.334323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.334751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.334938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.335530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.337154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.365511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 851/1698] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:17:59.369981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.387497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b9b8-2732-416b-8ba0-472b9581ae42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.394556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.395988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.397212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.397665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.398912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.402378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f1c0f-f454-4e36-a5b0-8f8917de18d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.429797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 848/1699] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:59 2022] PUT /identity/v3/projects/b93338bc1b894cffb5dc61482333de42/users/c17be56414f04978b610faf2ec13b425/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:59.430276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.523170 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 852/1700] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:59 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:17:59.524830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a6a1-1970-4e02-ad7b-3000e9db606c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.525209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a6a1-1970-4e02-ad7b-3000e9db606c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.525537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a6a1-1970-4e02-ad7b-3000e9db606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.545713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fec06-4432-4673-9331-b72788826be5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.612648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1123a6a1-1970-4e02-ad7b-3000e9db606c None None] MFA Rules not processed for user `c17be56414f04978b610faf2ec13b425`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:59.613099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:59.615563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1123a6a1-1970-4e02-ad7b-3000e9db606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:59.703815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.703815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.704010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.704157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] PATH_INFO: `/v3/projects/9da35c8bd9e14f18b93d06b69177d878/users/791b629ac9d3439aaebfb3effb3d085d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.711241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da35c8bd9e14f18b93d06b69177d878, user_id=791b629ac9d3439aaebfb3effb3d085d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.715342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.754456 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 849/1701] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:17:59 2022] PUT /identity/v3/projects/9da35c8bd9e14f18b93d06b69177d878/users/791b629ac9d3439aaebfb3effb3d085d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:17:59.754456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.773305 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 853/1702] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:59.779576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.780108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.780744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.832299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] MFA Rules not processed for user `791b629ac9d3439aaebfb3effb3d085d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:17:59.833785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:17:59.841880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:17:59.880401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34dde-ce60-428c-8a0c-43405a386c73 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.897110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.897735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.898014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.898289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.898969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.910892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.942326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 854/1703] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:17:59.943507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:17:59.954203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dc9f9-2877-41f1-9e48-7f6a468f85ab None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:17:59.959221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:17:59.960059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:17:59.960433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:17:59.960775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:17:59.961475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:17:59.963573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:17:59.996384 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 850/1704] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:17:59 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:00.000764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.002556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.091587 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 855/1705] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:17:59 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:00.093264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.153630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ade1-b410-46a2-9296-f000178ddb1b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.221342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbccb3-3662-48a5-bad1-e2d721590be5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.230510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.231452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.232228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.232646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.233660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.235457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.248841 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 856/1706] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:00.249763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.261050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.262547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.262894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb285-f4c4-4917-8e3b-1185744e557b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.264575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.264912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.272277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.272277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.272277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.272277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.272847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.274809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.374691 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 857/1707] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:00 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:00.375563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.377700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.379849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.414954 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 851/1708] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:17:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:00.415947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.421811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09785fa-c32e-4a8c-9729-bcaca501a3da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.423983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.428992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.429907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.430172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.430596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] PATH_INFO: `/v3/projects/38fd5f82b9f444598545d6222de3eaf4/users/d6661863c969456883bf4c6d5f7c7a27/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.444043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1efce1-2e02-4eed-9f66-5d89d6d2d9f3 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.449568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.451189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.451424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.451701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] PATH_INFO: `/v3/projects/6aab05bad7ad4234976fe7f87403205f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.452928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aab05bad7ad4234976fe7f87403205f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.453363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fd5f82b9f444598545d6222de3eaf4, user_id=d6661863c969456883bf4c6d5f7c7a27, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.456837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.458208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.556883 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 858/1709] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:00 2022] PUT /identity/v3/projects/38fd5f82b9f444598545d6222de3eaf4/users/d6661863c969456883bf4c6d5f7c7a27/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:00.557778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.595548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aab05bad7ad4234976fe7f87403205f', 'request_id': 'req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:00.649212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc064-fed1-424e-805e-e7df22783e74 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.697632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aab05bad7ad4234976fe7f87403205f', 'request_id': 'req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:00.704285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aab05bad7ad4234976fe7f87403205f', 'request_id': 'req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:00.721014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] The token cache is being invalidate because project 6aab05bad7ad4234976fe7f87403205f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:00.721448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:00.722289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:00.726842 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 852/1710] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:00 2022] DELETE /identity/v3/projects/6aab05bad7ad4234976fe7f87403205f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:00.726842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.726842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.733501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.734291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.734500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.734817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.735578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.737269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.752515 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 859/1711] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:00.752515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.757134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.802877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff195b-e973-40fe-9749-2d15c4dd9f1c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.807808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.808425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.808699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.808970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.809618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.811676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.823569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 853/1712] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:00.824438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.826153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.839855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf40ff-982a-4591-ab29-ed45f3cbd724 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.840861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445c68d-8323-485b-ac91-0e0f33de2c2d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.845610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.845853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.846236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.846515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.846772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.846873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] PATH_INFO: `/v3/users/86ae84c5d5c34f39b4878cfad6a8e8f9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.847055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.847328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.848223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ae84c5d5c34f39b4878cfad6a8e8f9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.849166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.850252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.916077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.918039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:00.928182 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 860/1713] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:00.929670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:00.931217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:00.947637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1f55-95fc-4ddc-9556-82f926af8d58 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:00.962236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:00.963686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:00.963962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:00.964239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] PATH_INFO: `/v3/projects/ae71e886b7384277a6198a7f5e9683aa/users/1e83c48af60645e7bd9e227e75053496/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:00.970831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:00.984856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae71e886b7384277a6198a7f5e9683aa, user_id=1e83c48af60645e7bd9e227e75053496, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:00.991840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.023358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ae84c5d5c34f39b4878cfad6a8e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:01.024213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ae84c5d5c34f39b4878cfad6a8e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:01.064743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 861/1714] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:00 2022] PUT /identity/v3/projects/ae71e886b7384277a6198a7f5e9683aa/users/1e83c48af60645e7bd9e227e75053496/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:01.065558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.067630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.133056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ae84c5d5c34f39b4878cfad6a8e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:01.144298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a781b0a-f24f-4281-9c87-45f6f2a7804a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.145656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ae84c5d5c34f39b4878cfad6a8e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:01.146358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ae84c5d5c34f39b4878cfad6a8e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:01.149284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.149986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.150262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.150532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] PATH_INFO: `/v3/projects/38fd5f82b9f444598545d6222de3eaf4/users/d6661863c969456883bf4c6d5f7c7a27/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.152545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fd5f82b9f444598545d6222de3eaf4, user_id=d6661863c969456883bf4c6d5f7c7a27, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.155415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5b337-e35b-45c0-ac91-31c7e5b1ba45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.162353 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 854/1715] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:00 2022] DELETE /identity/v3/users/86ae84c5d5c34f39b4878cfad6a8e8f9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:01.162353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.162353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.170228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 862/1716] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:01 2022] PUT /identity/v3/projects/38fd5f82b9f444598545d6222de3eaf4/users/d6661863c969456883bf4c6d5f7c7a27/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:01.183754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.184312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.184771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.222100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] MFA Rules not processed for user `d6661863c969456883bf4c6d5f7c7a27`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:01.224075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.261254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f713-e799-43c2-b974-5e2748a95b59 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.321084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 863/1717] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:01.334814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.334814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.349866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.350646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.351054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.351393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.352116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.354495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.372991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 855/1718] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:01.379059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.394227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cc74b-eef4-40fe-a610-dc4fb909767f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.398676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.399430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.400043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.400327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] PATH_INFO: `/v3/projects/ae71e886b7384277a6198a7f5e9683aa/users/1e83c48af60645e7bd9e227e75053496/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.402381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae71e886b7384277a6198a7f5e9683aa, user_id=1e83c48af60645e7bd9e227e75053496, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.405416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ed0c-7865-4d99-b2cf-77001b532a40 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.414757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:01.462125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 856/1719] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:01 2022] PUT /identity/v3/projects/ae71e886b7384277a6198a7f5e9683aa/users/1e83c48af60645e7bd9e227e75053496/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:01.463906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.464194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.465028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.515822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68027-3558-4f2d-b807-f834101d4950 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.523833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] MFA Rules not processed for user `1e83c48af60645e7bd9e227e75053496`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:01.525130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.660755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.661380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.661657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.662473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.695628 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 857/1720] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:01.797352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.799751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:01.820400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.822170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.838379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 864/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:01.919131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:01.935026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d77b5-9488-4800-b673-ac5fde833195 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.941294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.942162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.942522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.942911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.952230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.953980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:01.969662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6650c-ceac-4e1b-82ec-cc41a688b98d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:01.976161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 865/1722] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:01.994165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:01.994856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:01.995138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:01.995461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] PATH_INFO: `/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:01.996632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d2a7ebf89e4ea0acbf0b9de3970fb8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:01.998655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:02.107601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:02.121951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840d6cb-01a7-4d43-a754-76e53fc5a793 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:02.130401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:02.139067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.139445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.139729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] PATH_INFO: `/v3/users/f285f4d54c794b82a2f2577ff9e2583e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.143277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f285f4d54c794b82a2f2577ff9e2583e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:02.147968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:02.194073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d2a7ebf89e4ea0acbf0b9de3970fb8', 'request_id': 'req-92d024c6-fd32-40df-8fad-3a1492e8cf3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.223664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:02.320469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d2a7ebf89e4ea0acbf0b9de3970fb8', 'request_id': 'req-92d024c6-fd32-40df-8fad-3a1492e8cf3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.329019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d2a7ebf89e4ea0acbf0b9de3970fb8', 'request_id': 'req-92d024c6-fd32-40df-8fad-3a1492e8cf3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.347381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] The token cache is being invalidate because project 85d2a7ebf89e4ea0acbf0b9de3970fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:02.347564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.348435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.354293 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 858/1723] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:01 2022] DELETE /identity/v3/projects/85d2a7ebf89e4ea0acbf0b9de3970fb8 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:02.354293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:02.354293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:02.446313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d024c6-fd32-40df-8fad-3a1492e8cf3f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:02.452383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:02.453426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.453588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.453894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] PATH_INFO: `/v3/users/c0b6ec1b35b041b8bed4e55b9312a63a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.455468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b6ec1b35b041b8bed4e55b9312a63a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:02.457522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:02.486916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f285f4d54c794b82a2f2577ff9e2583e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.487647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f285f4d54c794b82a2f2577ff9e2583e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.613443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f285f4d54c794b82a2f2577ff9e2583e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.630516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f285f4d54c794b82a2f2577ff9e2583e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.632337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8bea18d4-c110-43a0-9047-5b83f0a1017e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f285f4d54c794b82a2f2577ff9e2583e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.648529 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 866/1724] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:02 2022] DELETE /identity/v3/users/f285f4d54c794b82a2f2577ff9e2583e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:02.649550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bd6c-4e7e-4149-8b9b-7710292e012e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.649833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bd6c-4e7e-4149-8b9b-7710292e012e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.650342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bd6c-4e7e-4149-8b9b-7710292e012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.672465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9502bd6c-4e7e-4149-8b9b-7710292e012e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:02.674070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9502bd6c-4e7e-4149-8b9b-7710292e012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:02.743690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b6ec1b35b041b8bed4e55b9312a63a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.745520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b6ec1b35b041b8bed4e55b9312a63a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.782663 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 867/1725] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:02.792538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f712-17ff-4ab9-9a0c-1747415933fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.799014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f712-17ff-4ab9-9a0c-1747415933fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.799517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f712-17ff-4ab9-9a0c-1747415933fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.828914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b6ec1b35b041b8bed4e55b9312a63a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.842975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4570f712-17ff-4ab9-9a0c-1747415933fb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:02.844231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4570f712-17ff-4ab9-9a0c-1747415933fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:02.847032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b6ec1b35b041b8bed4e55b9312a63a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.849781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-54265767-d98f-4580-9173-9b90d32e1615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b6ec1b35b041b8bed4e55b9312a63a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:02.869533 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 868/1726] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:02.870679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 859/1727] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:02 2022] DELETE /identity/v3/users/c0b6ec1b35b041b8bed4e55b9312a63a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:02.871020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.871323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.871579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.876055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:02.877302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:02.878121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:02.907008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:02.907223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:02.908947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:02.914859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:03.001366 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 860/1728] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:03.002349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.003756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:03.019998 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 869/1729] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:03.024329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.034656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965880dc-f777-4f4d-b691-ee91e1687448 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.043884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.044495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.045445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.045445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.045879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:03.046185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.048659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.075069 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 870/1730] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:03.076031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.077746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:03.090015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fb9e1-ede9-4fb3-b41a-1659a246bde3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.094295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.095022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.095308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.095642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.097369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8754f-b20e-4537-82b6-680be95aba2d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.107288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.107943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.108180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.108456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.108722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.109399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.121326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.123089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.134659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 861/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:03.134857 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 871/1732] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:03.134937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.144785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1e27-6691-494b-a971-4452cbdbe5d5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.149704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.150307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.150651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.150910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.151509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.153426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.168906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:03.279298 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 862/1733] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:03 2022] POST /identity/v3/projects => generated 401 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:03.288521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.301743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540feb-0667-4b74-9f4e-66b1038c2150 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.337285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:03.375229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.375761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.376039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.376308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.376926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.378847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.472003 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 872/1734] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:03 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:03.472636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.486856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658aa21-024e-40ac-836f-0314b35f75a1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.493345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.494058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.494786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.495224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.495929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.498256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.519574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.530699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 863/1735] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:03.535127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbef3-a296-4893-a840-60780ac41444 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.541848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.543199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.543199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.543372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.548962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.548962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3da23d-8a4b-457e-877e-31c7eb44e990 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.572451 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 873/1736] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:03.581959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.608370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb5da-acb6-4b93-ad0d-1e325df49247 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:03.619370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:03.621426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.622890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.622890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] PATH_INFO: `/v3/projects/481e89631977477eaf4d88a28975affb/users/feaa899dfe30472ea304ae99abc68cd5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.666038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481e89631977477eaf4d88a28975affb, user_id=feaa899dfe30472ea304ae99abc68cd5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:03.666038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:03.803511 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 864/1737] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:03 2022] PUT /identity/v3/projects/481e89631977477eaf4d88a28975affb/users/feaa899dfe30472ea304ae99abc68cd5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:03.814765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:03.815215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:03.815514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:03.836254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:03.852433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.857930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:03.860090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] MFA Rules not processed for user `feaa899dfe30472ea304ae99abc68cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:03.866981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:03.972652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 874/1738] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:03.976041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:03.980408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.034379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eaf37-e73c-4976-b574-f91c40f81735 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.050437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.051112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.051391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.051659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] PATH_INFO: `/v3/projects/59a8f35ff08f408385004a7723614d1f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.053705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a8f35ff08f408385004a7723614d1f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.058314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.131642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60721b3b-6789-4183-9607-e8e304e86c10 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.137304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.143269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.143269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.143269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] PATH_INFO: `/v3/projects/01b9e87539e040c0a7589c7aa497c7c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.145964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b9e87539e040c0a7589c7aa497c7c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.149219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.165306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a8f35ff08f408385004a7723614d1f', 'request_id': 'req-de15b1a6-d358-4779-92a8-54300248cc53'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.303437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a8f35ff08f408385004a7723614d1f', 'request_id': 'req-de15b1a6-d358-4779-92a8-54300248cc53'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.309883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a8f35ff08f408385004a7723614d1f', 'request_id': 'req-de15b1a6-d358-4779-92a8-54300248cc53'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.321733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] The token cache is being invalidate because project 59a8f35ff08f408385004a7723614d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:04.322021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.322800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.324361 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 865/1739] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:03 2022] DELETE /identity/v3/projects/59a8f35ff08f408385004a7723614d1f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:04.325097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:04.326414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.354434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b9e87539e040c0a7589c7aa497c7c2', 'request_id': 'req-395b950d-1505-4be7-9cfd-760a04c02b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.394482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15b1a6-d358-4779-92a8-54300248cc53 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.454758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.455371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.455649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.455925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.456545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.458434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.468924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b9e87539e040c0a7589c7aa497c7c2', 'request_id': 'req-395b950d-1505-4be7-9cfd-760a04c02b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.483272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b9e87539e040c0a7589c7aa497c7c2', 'request_id': 'req-395b950d-1505-4be7-9cfd-760a04c02b00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.497352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] The token cache is being invalidate because project 01b9e87539e040c0a7589c7aa497c7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:04.502500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.502500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.502500 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 875/1740] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:03 2022] DELETE /identity/v3/projects/01b9e87539e040c0a7589c7aa497c7c2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:04.502500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:04.502969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.559580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 866/1741] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:04 2022] POST /identity/v3/projects => generated 401 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:04.563609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:04.565347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.611700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b950d-1505-4be7-9cfd-760a04c02b00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.635374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:04.641278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6184fc-3ca8-4241-bb3e-9491c803de97 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.647016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.647727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.648011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.648448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] PATH_INFO: `/v3/users/d6661863c969456883bf4c6d5f7c7a27` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.650023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6661863c969456883bf4c6d5f7c7a27)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.653200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.696592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.697211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.697491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.697765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.699749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.768050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.769781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.780457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 876/1742] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:04.781303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:04.782714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:04.797370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29dc61-ca3b-4bfb-84bd-6b90768fff7f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:04.802877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:04.803640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:04.803936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:04.804196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] PATH_INFO: `/v3/users/791b629ac9d3439aaebfb3effb3d085d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:04.805992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] RBAC: Authorizing `identity:delete_user(user_id=791b629ac9d3439aaebfb3effb3d085d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:04.808551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:04.825353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:04.886135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6661863c969456883bf4c6d5f7c7a27'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.886915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6661863c969456883bf4c6d5f7c7a27'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.939588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6661863c969456883bf4c6d5f7c7a27'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.954570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6661863c969456883bf4c6d5f7c7a27'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.955340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6661863c969456883bf4c6d5f7c7a27'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:04.970106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 867/1743] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:04 2022] DELETE /identity/v3/users/d6661863c969456883bf4c6d5f7c7a27 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:04.973183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:04.975991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:05.034523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791b629ac9d3439aaebfb3effb3d085d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.036262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791b629ac9d3439aaebfb3effb3d085d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.084445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5422-ba35-4ccb-b384-b9337cbe17a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.094224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.094224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.100706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.100706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.100706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.100706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.149314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791b629ac9d3439aaebfb3effb3d085d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.166667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791b629ac9d3439aaebfb3effb3d085d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.167652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791b629ac9d3439aaebfb3effb3d085d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.184315 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 877/1744] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:04 2022] DELETE /identity/v3/users/791b629ac9d3439aaebfb3effb3d085d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:05.212737 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 868/1745] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:04 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:05.222791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.224427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:05.304646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3022b05-7287-4e6b-b842-4e803b32058c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.311890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.312666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.313046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.313326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.314162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.316082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.327535 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 878/1746] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:05.332068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.343327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d673a-f6ee-4310-8525-70294212990b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.348416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.349154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.349461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.349734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] PATH_INFO: `/v3/projects/66a8fb2b14474fcdae10faea4edbc05b/users/456316346c54467390fcc52751632823/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.368811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a8fb2b14474fcdae10faea4edbc05b, user_id=456316346c54467390fcc52751632823, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.372244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.484607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 869/1747] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:05 2022] PUT /identity/v3/projects/66a8fb2b14474fcdae10faea4edbc05b/users/456316346c54467390fcc52751632823/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:05.485585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.502432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea39bd-037f-4969-a454-279f951409a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.650124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.652442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:05.665007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.666131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.668248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.668738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.670716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.672167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.679476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771e46-c71c-49dc-b27c-5802ccd6ba82 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.690801 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 879/1748] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:05.694967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.696057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.696946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.697059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.697712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] PATH_INFO: `/v3/projects/38fd5f82b9f444598545d6222de3eaf4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.698567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fd5f82b9f444598545d6222de3eaf4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.701319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.717827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee110f-2249-47a1-a4c7-b88696c10111 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:05.725026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:05.725886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.727192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.727192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] PATH_INFO: `/v3/projects/66a8fb2b14474fcdae10faea4edbc05b/users/456316346c54467390fcc52751632823/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.729462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a8fb2b14474fcdae10faea4edbc05b, user_id=456316346c54467390fcc52751632823, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:05.733720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2588-3620-408b-a9e3-ee3284829a0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:05.747594 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 880/1749] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:05 2022] PUT /identity/v3/projects/66a8fb2b14474fcdae10faea4edbc05b/users/456316346c54467390fcc52751632823/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:05.760068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.760358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.760640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.788417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] MFA Rules not processed for user `456316346c54467390fcc52751632823`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:05.789633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:05.848342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fd5f82b9f444598545d6222de3eaf4', 'request_id': 'req-f0b0c946-9043-4a80-a6fe-6f930cabda31'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.871740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 881/1750] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:05.904376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:05.905776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:05.925898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fd5f82b9f444598545d6222de3eaf4', 'request_id': 'req-f0b0c946-9043-4a80-a6fe-6f930cabda31'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.932566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fd5f82b9f444598545d6222de3eaf4', 'request_id': 'req-f0b0c946-9043-4a80-a6fe-6f930cabda31'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.943920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] The token cache is being invalidate because project 38fd5f82b9f444598545d6222de3eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:05.944213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.944878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f0b0c946-9043-4a80-a6fe-6f930cabda31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:05.946652 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 870/1751] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:05 2022] DELETE /identity/v3/projects/38fd5f82b9f444598545d6222de3eaf4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:05.951342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:05.951623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:05.951937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:05.988176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:05.989375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.007495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6749d-2765-4a49-b2df-1a7b3555146b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.060966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 871/1752] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:06.061779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.063299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.076762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0ba6-f0ab-49f5-b353-b2010e7f1eaf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.086012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.086012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.086012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.086012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] PATH_INFO: `/v3/projects/9da35c8bd9e14f18b93d06b69177d878` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.086360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da35c8bd9e14f18b93d06b69177d878)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.086360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.092327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.092907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.093181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.093452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.095270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.166141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.168191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab967b-ac55-4a3b-aca7-f928b8094cc0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.178984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 882/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:06.180144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.180517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.180959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.211668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:06.212957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.214404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da35c8bd9e14f18b93d06b69177d878', 'request_id': 'req-c4910133-c320-44c8-9e9d-ee184cb20b83'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:06.276087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:06.276599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 883/1754] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:06.278148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.287462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8899d0f-91db-43a8-b0e7-34fb53e19ee8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.292452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.293037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.293309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.293584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.294205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:06.294501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.296108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.304266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da35c8bd9e14f18b93d06b69177d878', 'request_id': 'req-c4910133-c320-44c8-9e9d-ee184cb20b83'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:06.308546 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 884/1755] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:06.312791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.315867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da35c8bd9e14f18b93d06b69177d878', 'request_id': 'req-c4910133-c320-44c8-9e9d-ee184cb20b83'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:06.323536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc973e-587b-464a-be07-ace93c057ca4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.328440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] The token cache is being invalidate because project 9da35c8bd9e14f18b93d06b69177d878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:06.328744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:06.329395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:06.330547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.330965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 872/1756] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:06 2022] DELETE /identity/v3/projects/9da35c8bd9e14f18b93d06b69177d878 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:06.331307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.331590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.331761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.332173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.332867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.333203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.335345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1989f-2d1b-4576-a384-4df0c9b49162 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.408770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 885/1757] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:06.410373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.410937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.411058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910133-c320-44c8-9e9d-ee184cb20b83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.411213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.433193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:06.435005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.479177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.479796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.480074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.480350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.482120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.494583 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 886/1758] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:06.499488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.500949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.513953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ab39b-04e7-4f10-a8e8-55282ffc3014 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.519599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.521711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.521711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.521711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.521996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.524371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.543295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:06.545532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.547223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aee3a-5ee1-4746-809b-4403d10732a1 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.559580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 873/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:06.561141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.561491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.561833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.584337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:06.585840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.594206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 874/1760] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:06.598341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.608500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da46eb-bcaa-4a19-af72-fdded36db43d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.613196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.613992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.614269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.614898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.615556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:06.615862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.617647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.620478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 887/1761] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:06.624466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.634655 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 875/1762] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:06.636942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609823c-7e2c-449a-87d5-6dd7f4112c23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.642914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.643621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.644220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.644498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.644770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.645462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.647696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.655179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a88e77-0605-4049-a5ec-ae1868700297 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.660122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.661162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 888/1763] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:06.662154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.662504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.673160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.673160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.673160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.678535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.690986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01199-28be-45e8-9a88-9c710ffc84b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.698136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.698823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.699093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.699773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.700430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.702056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.716755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 889/1764] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:06.719608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.747371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f29df2-09bb-4f62-a1f5-2223bb06827b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.752350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.753004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.753290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.753557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] PATH_INFO: `/v3/projects/8885cfcc6a134e1e93ff7214ba33e07f/users/11020c20eb5d4a499766c3842b75802a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.769959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8885cfcc6a134e1e93ff7214ba33e07f, user_id=11020c20eb5d4a499766c3842b75802a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.777120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9e18-ba62-410b-bfed-dc5a7df887bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.779768 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 876/1765] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:06.783602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:06.850288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296d528-92eb-4137-bbe3-fda21d81f3d9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:06.855308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:06.855987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.856271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.856545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.857456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:06.859464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:06.871101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 890/1766] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:06 2022] PUT /identity/v3/projects/8885cfcc6a134e1e93ff7214ba33e07f/users/11020c20eb5d4a499766c3842b75802a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:06.890438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:06.890849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:06.891130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:06.930580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] MFA Rules not processed for user `11020c20eb5d4a499766c3842b75802a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:06.938223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:06.991467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 877/1767] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:06.995442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.005187 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 891/1768] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:07.010234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.011721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d976d2-9593-451f-97fc-a14e37aed544 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.081796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8598bf-a06b-4e72-bb31-2985dd00c1af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.083655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.084207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:07.084505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.084792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.084988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.085773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.087461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.090832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.091777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.092170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.092991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.093304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.095628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.097824 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 878/1769] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:07.101816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.112645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887b28-883c-4ba4-bddc-4ab93c937209 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.119175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.120287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.120287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.120561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.121207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.122947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.135867 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 879/1770] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:07.143970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.163008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad195-4689-44a7-bc8e-62d21a6bae08 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.163008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.163008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.163008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.163305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] PATH_INFO: `/v3/projects/3c6d8cbbb54d41acb98ed88a0ecb329c/users/573e36291eed419693eb19b193abb2a4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.183449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6d8cbbb54d41acb98ed88a0ecb329c, user_id=573e36291eed419693eb19b193abb2a4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.186273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749ff42-9f16-4295-97b8-ff8d8dd36b3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.201509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 892/1771] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:07.202514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.270848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:07.276294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fec00-cf7e-4a1c-b291-55f07e104ce2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.279828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.280539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.280920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.281292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.282017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.284056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.290780 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 880/1772] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:07 2022] PUT /identity/v3/projects/3c6d8cbbb54d41acb98ed88a0ecb329c/users/573e36291eed419693eb19b193abb2a4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:07.296164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.296804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.297090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.321136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:07.324601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:07.382055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 893/1773] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:07 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:07.382255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 881/1774] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:07.383190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.390319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.391693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:07.393352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ceab9-e0a5-4fae-8f38-fdd3ebdbe312 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.398025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.398631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.398913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.399182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.399801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.401691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.405779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:07.420637 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 894/1775] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:07.424239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.435742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab55c7-3146-4d07-bf38-45a71742206f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.440531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.441191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.441521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.441743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] PATH_INFO: `/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86/users/6dea75acded746dda132b34774a15beb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.451277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe4c3-b6b8-43a4-87b2-35ef32ad4021 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.455075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.455674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.455948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.456888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.457291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dd5cfcabcd4e77a6c945a7cef50e86, user_id=6dea75acded746dda132b34774a15beb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.462403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.465601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.467062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.476987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 882/1776] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:07.554288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 895/1777] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:07 2022] PUT /identity/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86/users/6dea75acded746dda132b34774a15beb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:07.557262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.558191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:07.558710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.572365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368a775-cf04-43ec-9d88-b1a31df7ecf4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.633969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0931cf-7ee4-4a41-9c69-20af9deda845 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.638938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.639659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.640004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.640449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.641136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.642004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.644487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.644607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.646851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.646851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] PATH_INFO: `/v3/users/feaa899dfe30472ea304ae99abc68cd5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.646851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feaa899dfe30472ea304ae99abc68cd5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.648201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.655288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 896/1778] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:07.656239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.659149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:07.673778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bee7c-10ce-466a-a1f6-6d8a02c6f22c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:07.679491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:07.680123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:07.680406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:07.681271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] PATH_INFO: `/v3/users/c17be56414f04978b610faf2ec13b425` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:07.681838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17be56414f04978b610faf2ec13b425)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:07.683827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:07.885326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17be56414f04978b610faf2ec13b425'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.885760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feaa899dfe30472ea304ae99abc68cd5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.886242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17be56414f04978b610faf2ec13b425'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.886747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feaa899dfe30472ea304ae99abc68cd5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.960998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17be56414f04978b610faf2ec13b425'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.977774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17be56414f04978b610faf2ec13b425'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.978509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17be56414f04978b610faf2ec13b425'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:07.992563 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 897/1779] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:07 2022] DELETE /identity/v3/users/c17be56414f04978b610faf2ec13b425 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:07.993412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:07.994811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.012973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:08.041181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feaa899dfe30472ea304ae99abc68cd5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:08.054959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feaa899dfe30472ea304ae99abc68cd5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:08.055685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b6d860ae-bd4a-4928-86f8-e73cceea8da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feaa899dfe30472ea304ae99abc68cd5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:08.064084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a42a4-8816-4d4b-9c89-41e20ee4cd0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:08.069353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:08.070012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.070288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.070556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] PATH_INFO: `/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86/users/6dea75acded746dda132b34774a15beb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.071817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 883/1780] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:07 2022] DELETE /identity/v3/users/feaa899dfe30472ea304ae99abc68cd5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:08.072516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dd5cfcabcd4e77a6c945a7cef50e86, user_id=6dea75acded746dda132b34774a15beb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:08.073158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660324f-c1bb-45c6-acac-9d43be09af74 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.073497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660324f-c1bb-45c6-acac-9d43be09af74 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.073775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660324f-c1bb-45c6-acac-9d43be09af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.075204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd795bc2-44af-4661-beb0-3721bd8b08eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:08.086673 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 898/1781] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:07 2022] PUT /identity/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86/users/6dea75acded746dda132b34774a15beb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:08.087891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.088176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.088447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.094171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5660324f-c1bb-45c6-acac-9d43be09af74 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:08.095443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5660324f-c1bb-45c6-acac-9d43be09af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.109855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:08.111099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.194588 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 884/1782] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:08.194588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.194588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.194942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.246404 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 899/1783] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:08.247755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:08.250819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.262985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] MFA Rules not processed for user `6dea75acded746dda132b34774a15beb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:08.264309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.330517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0cc6-f07d-412b-b204-b6e7f5f5dcd4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:08.334535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:08.335281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.335685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.336057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.345881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:08.347583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f703-ee03-4d1e-aa53-d24d678a43b5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:08.358176 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 885/1784] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:08.359581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:08.368360 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 900/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:08.369733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.370021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.370288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.388044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:08.388266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e56b3-abf6-4f05-9356-cbacb5b84d48 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:08.397270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] MFA Rules not processed for user `11020c20eb5d4a499766c3842b75802a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:08.397710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:08.398490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.398962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.403342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.404144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.419249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:08.430826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:08.438187 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 886/1786] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:08.483887 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 901/1787] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:08.494907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:08.496415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.572121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd371e1-e77d-4a32-b698-7ca0953d634a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:08.577881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:08.578506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:08.578821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:08.579089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:08.580929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:08.592053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:08.593634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:08.603274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 887/1788] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:08.812960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:08.897413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:09.338604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:09.344641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:09.345331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:09.346046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:09.370834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf6d62-63ae-4c01-b662-7c839d15750a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:09.370834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:09.371068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29166-dcb3-44ca-a648-f525b56897df service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:09.371234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:09.371234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:09.371234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] PATH_INFO: `/v3/projects/481e89631977477eaf4d88a28975affb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:09.371234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481e89631977477eaf4d88a28975affb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:09.372023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:09.383547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:09.384252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:09.384536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:09.384870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] PATH_INFO: `/v3/projects/b93338bc1b894cffb5dc61482333de42` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:09.386213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93338bc1b894cffb5dc61482333de42)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:09.391062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:09.517530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:09.532689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481e89631977477eaf4d88a28975affb', 'request_id': 'req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.546330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93338bc1b894cffb5dc61482333de42', 'request_id': 'req-853b5368-d73e-4766-9918-aa5ebee4f97f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.646562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481e89631977477eaf4d88a28975affb', 'request_id': 'req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.655347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481e89631977477eaf4d88a28975affb', 'request_id': 'req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.672906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] The token cache is being invalidate because project 481e89631977477eaf4d88a28975affb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:09.673660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.674765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.676878 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 902/1789] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:09 2022] DELETE /identity/v3/projects/481e89631977477eaf4d88a28975affb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:09.681081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:09.683127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:09.750097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93338bc1b894cffb5dc61482333de42', 'request_id': 'req-853b5368-d73e-4766-9918-aa5ebee4f97f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.774290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93338bc1b894cffb5dc61482333de42', 'request_id': 'req-853b5368-d73e-4766-9918-aa5ebee4f97f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.787724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89397eb-f0d0-4d6e-88e1-8895e0b813f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:09.802978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] The token cache is being invalidate because project b93338bc1b894cffb5dc61482333de42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:09.803567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.804899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:09.807331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 888/1790] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:09 2022] DELETE /identity/v3/projects/b93338bc1b894cffb5dc61482333de42 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:09.811282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:09.815963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:09.855289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:09.855928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:09.856208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:09.856480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] PATH_INFO: `/v3/users/456316346c54467390fcc52751632823` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:09.857771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456316346c54467390fcc52751632823)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:09.859761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:09.888230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b5368-d73e-4766-9918-aa5ebee4f97f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:09.894011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:09.895357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:09.895650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:09.895909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] PATH_INFO: `/v3/users/1e83c48af60645e7bd9e227e75053496` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:09.898551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e83c48af60645e7bd9e227e75053496)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:09.903249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:10.077349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456316346c54467390fcc52751632823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.078547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456316346c54467390fcc52751632823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.124289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e83c48af60645e7bd9e227e75053496'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.125415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e83c48af60645e7bd9e227e75053496'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.184656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456316346c54467390fcc52751632823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.198347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456316346c54467390fcc52751632823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.199149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456316346c54467390fcc52751632823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.212180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 903/1791] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:09 2022] DELETE /identity/v3/users/456316346c54467390fcc52751632823 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:10.327733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e83c48af60645e7bd9e227e75053496'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.344470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e83c48af60645e7bd9e227e75053496'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.345217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e83c48af60645e7bd9e227e75053496'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:10.360895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 889/1792] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:09 2022] DELETE /identity/v3/users/1e83c48af60645e7bd9e227e75053496 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:11.083005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:11.084589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.101767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:11.225055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee61-61fc-47b9-ad48-0d26215b7892 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:11.304135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:11.305092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.305493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.305778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] PATH_INFO: `/v3/projects/66a8fb2b14474fcdae10faea4edbc05b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.307004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a8fb2b14474fcdae10faea4edbc05b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:11.309362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:11.372082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:11.373715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.390627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198525a-c3ec-4f3b-93b6-e61cbbeb42bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:11.398052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:11.399061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.399524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.399959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] PATH_INFO: `/v3/projects/ae71e886b7384277a6198a7f5e9683aa` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.401284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae71e886b7384277a6198a7f5e9683aa)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:11.405852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:11.449378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a8fb2b14474fcdae10faea4edbc05b', 'request_id': 'req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.556194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a8fb2b14474fcdae10faea4edbc05b', 'request_id': 'req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.566247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a8fb2b14474fcdae10faea4edbc05b', 'request_id': 'req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.612530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] The token cache is being invalidate because project 66a8fb2b14474fcdae10faea4edbc05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:11.614379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.615413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b42b15d-cbe6-4cfb-8218-89fdf3e9c844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.618462 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 904/1793] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:11 2022] DELETE /identity/v3/projects/66a8fb2b14474fcdae10faea4edbc05b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:11.626524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae71e886b7384277a6198a7f5e9683aa', 'request_id': 'req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.632123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590470f-4e3d-430a-b947-aaa1154c620d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.632868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590470f-4e3d-430a-b947-aaa1154c620d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.635126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590470f-4e3d-430a-b947-aaa1154c620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.691967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f590470f-4e3d-430a-b947-aaa1154c620d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:11.693209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f590470f-4e3d-430a-b947-aaa1154c620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.750736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae71e886b7384277a6198a7f5e9683aa', 'request_id': 'req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.771866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae71e886b7384277a6198a7f5e9683aa', 'request_id': 'req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.793624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] The token cache is being invalidate because project ae71e886b7384277a6198a7f5e9683aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:11.794216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.795099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-adb9c315-e54f-4b79-84ae-93dbfdbae4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:11.796839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 890/1794] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:11 2022] DELETE /identity/v3/projects/ae71e886b7384277a6198a7f5e9683aa => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:11.802709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732221-ec43-4d18-a227-39e2839ab380 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.803225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732221-ec43-4d18-a227-39e2839ab380 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.803699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732221-ec43-4d18-a227-39e2839ab380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.827626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bb732221-ec43-4d18-a227-39e2839ab380 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:11.828985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb732221-ec43-4d18-a227-39e2839ab380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.842195 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 891/1795] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:11.849834 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 905/1796] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:11.852083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.852083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.852476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.853668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.853962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.854238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.876376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:11.877661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.887978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 906/1797] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:11.893031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:11.903510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a2e58-2c5b-43b3-8e2b-657daefd2890 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:11.905580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:11.906843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:11.908887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:11.909654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.910112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.910468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.911345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:11.911754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:11.913800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:11.932921 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 907/1798] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:11.933859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:11.939813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 892/1799] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:11.944503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:11.959130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9465a26-2c6b-452e-930f-c1100cb5874c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:11.962602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:11.968887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:11.969330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.969588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f1ac1-e294-490a-8442-ddabb90091e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:11.970667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.970835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.971613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:11.971990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:11.974857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:11.986330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:11.986998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:11.987457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:11.987709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:11.988460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:11.990421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:11.995734 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 893/1800] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:12.001066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.029759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5a28d-1060-41f2-b64a-a78a15b0ad7b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.060823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.063571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.063860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.064139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.064803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.072302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.188268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 908/1801] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/projects => generated 395 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:12.191344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.313458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 894/1802] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:11 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:12.317612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.424923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a35d1-db82-498f-9c17-cf7071b54509 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.485462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f147-a002-4254-a1eb-5b86aed225b6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.510057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.510057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.510057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.510057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.510648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.515806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.581228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.581814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.582094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.582366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.583774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.585850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.678725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 895/1803] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:12 2022] POST /identity/v3/users => generated 288 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:12.682731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.711919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 909/1804] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:12 2022] POST /identity/v3/users => generated 298 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:12.721285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.736244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7682a7-7e0b-4631-b734-aa5acaa9b589 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.758821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.760035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.761059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.761643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.764685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.767749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.775216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1f5c-34d9-42ca-89a5-56a32236ee91 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.796540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.797510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.797623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 910/1805] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:12.800005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.800922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.801806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.804709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.814802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.819301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318ecea-0297-4fe0-b8c9-8063976c7a71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.829604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.830470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.830752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.833372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.833372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.834740 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 896/1806] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:12.837791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.838497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.853424 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 911/1807] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:12.854515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185c8d-85e7-4d4c-a9ce-034b32cd223b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.857799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.860544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.861632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.862034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.862701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.863419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.866453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.872223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc5b2-01f3-48ec-9055-ad3171b04e86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.879745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.895941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.896595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.897292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] PATH_INFO: `/v3/projects/1b980a8f51d24a1a89adac420e257a14/users/f7bc608b554e4c6b94ec547f4e6c1d20/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.909283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 897/1808] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:12.914691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:12.937716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621285-f46d-4c6d-af8b-73dc2c69da0c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:12.942579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b980a8f51d24a1a89adac420e257a14, user_id=f7bc608b554e4c6b94ec547f4e6c1d20, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.945506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c4d01-ba63-4489-8716-bbf8bfc6cde9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:12.971059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:12.972115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:12.973334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:12.974983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] PATH_INFO: `/v3/projects/8b07b624139243158ce66cd4c4f6e7af/users/4ec744e27c854fd6a9c484b46e771010/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:12.993043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b07b624139243158ce66cd4c4f6e7af, user_id=4ec744e27c854fd6a9c484b46e771010, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:12.995762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ce80-922e-499f-ad07-7c294903a40e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:13.055799 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 912/1809] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:12 2022] PUT /identity/v3/projects/1b980a8f51d24a1a89adac420e257a14/users/f7bc608b554e4c6b94ec547f4e6c1d20/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:13.066965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.067268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.067550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.094209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:13.095591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:13.117370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 898/1810] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:12 2022] PUT /identity/v3/projects/8b07b624139243158ce66cd4c4f6e7af/users/4ec744e27c854fd6a9c484b46e771010/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:13.130157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.130157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.130453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.170757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] MFA Rules not processed for user `4ec744e27c854fd6a9c484b46e771010`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:13.171974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:13.186659 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 913/1811] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:13.198219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:13.200653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:13.253679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 899/1812] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:13.254824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:13.309936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57250c-ca7d-4823-b25b-acec235bea23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:13.350106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:13.351099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ac5b-b369-453e-b61d-02e5411513ad None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:13.357104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:13.358505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.358896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.359244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.360381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:13.363096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:13.397333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:13.400720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.400720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.400720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.409958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:13.412209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:13.436001 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 914/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:13.493116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 900/1814] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:13 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:13.497555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:13.512875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287ef60-f878-48da-a308-857f6fc27b02 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:13.716020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:13.716927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.717383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.718133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.718977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:13.722091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:13.824560 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 915/1815] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:13 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:13.825660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:13.827358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:13.844395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c6cb-1315-4c13-adcf-306cdab86c71 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:13.856596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:13.858582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.858904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.859180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.859911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:13.861539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:13.888797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 901/1816] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:13.892833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:13.906946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7954-141c-4f59-9220-02f1b80eabbc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:13.915160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:13.915994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:13.917046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:13.917913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] PATH_INFO: `/v3/projects/849a0341f97a4b7fb48013d1f0d3678c/users/0bd53b112b3b469fa9fce9e5c5e12342/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:13.960980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849a0341f97a4b7fb48013d1f0d3678c, user_id=0bd53b112b3b469fa9fce9e5c5e12342, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:13.967693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:14.069153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 916/1817] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:13 2022] PUT /identity/v3/projects/849a0341f97a4b7fb48013d1f0d3678c/users/0bd53b112b3b469fa9fce9e5c5e12342/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:14.070415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:14.085102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c02f0-88ef-45f9-9696-571cc633c5d0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:14.250190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:14.250877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:14.251163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:14.251582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:14.252629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:14.256698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616bd00-389e-48b4-ab8c-62a7013ba5ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:14.278028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 902/1818] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:14.282575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:14.305491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b64bf-18ee-40a8-8278-0b76d49ed5c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:14.322183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:14.322834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:14.323117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:14.323395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] PATH_INFO: `/v3/projects/849a0341f97a4b7fb48013d1f0d3678c/users/0bd53b112b3b469fa9fce9e5c5e12342/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:14.327368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=849a0341f97a4b7fb48013d1f0d3678c, user_id=0bd53b112b3b469fa9fce9e5c5e12342, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:14.330203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:14.401686 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 917/1819] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:14 2022] PUT /identity/v3/projects/849a0341f97a4b7fb48013d1f0d3678c/users/0bd53b112b3b469fa9fce9e5c5e12342/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:14.403837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:14.404621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:14.404919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:14.461798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] MFA Rules not processed for user `0bd53b112b3b469fa9fce9e5c5e12342`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:14.463130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:14.593038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 903/1820] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:14.604793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:14.607285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:14.746886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22041a-7a28-4388-ad7d-1d6145a361ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:14.759142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:14.760410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:14.760754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:14.761081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:14.774425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:14.776877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:14.798843 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 918/1821] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:15.207918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:15.890101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:15.891682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:15.992435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:16.013359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b22b8-2f95-47c9-afa8-f4395f1bdd7c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:16.019022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:16.019943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.020432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.020912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] PATH_INFO: `/v3/users/966c0b1c2b3540c0b12c59fa3d5b8c78` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.023622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966c0b1c2b3540c0b12c59fa3d5b8c78)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:16.025833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:16.095508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec124-6d79-4cd8-a436-4026f0dc5005 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:16.111561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:16.112312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.112479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.112750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] PATH_INFO: `/v3/users/4ec744e27c854fd6a9c484b46e771010` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.115236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec744e27c854fd6a9c484b46e771010)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:16.117183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:16.295278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966c0b1c2b3540c0b12c59fa3d5b8c78'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.296085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966c0b1c2b3540c0b12c59fa3d5b8c78'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.384387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966c0b1c2b3540c0b12c59fa3d5b8c78'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.406391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966c0b1c2b3540c0b12c59fa3d5b8c78'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.409348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b666a1a-21ef-46c5-92bb-bb6e9cdc4ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966c0b1c2b3540c0b12c59fa3d5b8c78'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.413978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec744e27c854fd6a9c484b46e771010'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.414730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec744e27c854fd6a9c484b46e771010'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.433829 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 904/1822] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:15 2022] DELETE /identity/v3/users/966c0b1c2b3540c0b12c59fa3d5b8c78 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:16.438793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.439343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.441380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.478005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:16.479612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:16.539957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec744e27c854fd6a9c484b46e771010'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.560309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec744e27c854fd6a9c484b46e771010'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.561878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec2323c1-0372-4801-9b43-0b99e313891b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec744e27c854fd6a9c484b46e771010'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:16.597651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 919/1823] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:15 2022] DELETE /identity/v3/users/4ec744e27c854fd6a9c484b46e771010 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:16.601842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.607970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.607970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.636029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:16.653155 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 905/1824] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:16.653399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:16.654659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:16.680277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:16.681704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:16.812445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 920/1825] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:16.837994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:16.854206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16907-19bb-4a72-ad71-a5bca2f34927 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:16.928489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806822-9c2e-4969-b243-0cf292f8d3d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:16.934801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:16.935934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.936412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.936866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.944780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:16.947570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:16.947570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:16.947570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:16.951644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:16.953492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f53826-114c-4eae-944e-0ed11a7f8332 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:16.960387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:16.963059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:16.975864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 906/1826] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:16.980523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 921/1827] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:17.139549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:17.204191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:17.206046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:17.338190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422aa9e-9d40-42d5-9823-957ec2d4fe6f service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:17.344546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:17.345171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:17.345439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:17.345710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:17.348448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:17.529474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:17.532193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:17.570046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 907/1828] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:18.093555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:18.396372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:18.396813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:18.397306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:18.482014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] MFA Rules not processed for user `573e36291eed419693eb19b193abb2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:18.483767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:18.657148 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 922/1829] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:18.660508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:18.663205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:18.704955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3d03c-45ae-4ab2-ae7f-6b14b705b79e service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:18.720466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:18.721106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:18.721386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:18.721658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:18.722461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:18.724518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:18.871181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:18.881600 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 908/1830] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:18 2022] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:18.888193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4fece-1d10-4c1a-9ecc-6fdaaa878616 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:18.996784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:18.998744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:18.999188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:18.999601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.000325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.007930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.024909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:19.148990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.151142 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 923/1831] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:18 2022] POST /identity/v3/users => generated 309 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:19.164941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3ba4-dd7e-4b94-a3c0-85dddbdb80df admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.183214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.183951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.184300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.184644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.185365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.187143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.228652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.233748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:19.236138 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 909/1832] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:19.241407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.272121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a46a6-e081-4078-ae3d-545622493459 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.274975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebef06-bb4a-470b-af6f-866739b01eb4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.291221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.293541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.293655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.294267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.294551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.297479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] PATH_INFO: `/v3/projects/8b07b624139243158ce66cd4c4f6e7af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.297585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.297585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] PATH_INFO: `/v3/projects/d770dad834b14378abbbf027d3f05ae6/users/ab5b566f377c45039148836f1d58cd7f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.297910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b07b624139243158ce66cd4c4f6e7af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.300085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.345539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d770dad834b14378abbbf027d3f05ae6, user_id=ab5b566f377c45039148836f1d58cd7f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.348518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.437193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 910/1833] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:19 2022] PUT /identity/v3/projects/d770dad834b14378abbbf027d3f05ae6/users/ab5b566f377c45039148836f1d58cd7f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:19.438880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.440996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:19.547333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b07b624139243158ce66cd4c4f6e7af', 'request_id': 'req-69d9b683-7f20-497b-b3bc-e9ee2a53e408'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.574542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c442f6-8e70-4844-bf80-10d3b9ae7f6b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.602986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:19.634220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b07b624139243158ce66cd4c4f6e7af', 'request_id': 'req-69d9b683-7f20-497b-b3bc-e9ee2a53e408'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.644764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b07b624139243158ce66cd4c4f6e7af', 'request_id': 'req-69d9b683-7f20-497b-b3bc-e9ee2a53e408'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.667036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.668235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.669016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.669396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] PATH_INFO: `/v3/projects/f42cdb7fcf084add9a265b99dc412219` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.669815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] The token cache is being invalidate because project 8b07b624139243158ce66cd4c4f6e7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:19.670775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.671058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42cdb7fcf084add9a265b99dc412219)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.674604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.675468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.681898 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 924/1834] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:19 2022] DELETE /identity/v3/projects/8b07b624139243158ce66cd4c4f6e7af => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:19.685714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.691821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:19.738516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b683-7f20-497b-b3bc-e9ee2a53e408 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.760227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.760992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.761367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.761751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.762480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.764420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.777538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 925/1835] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:19.778520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:19.780439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:19.797064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c79bea-7e0c-4ff0-9b61-2d0847986ac6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:19.806255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:19.808113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:19.808489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:19.808860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] PATH_INFO: `/v3/users/0bd53b112b3b469fa9fce9e5c5e12342` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:19.810496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd53b112b3b469fa9fce9e5c5e12342)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:19.812426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:19.862550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42cdb7fcf084add9a265b99dc412219', 'request_id': 'req-849b1185-becc-4625-89c1-bc2bb93b282f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.959063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42cdb7fcf084add9a265b99dc412219', 'request_id': 'req-849b1185-becc-4625-89c1-bc2bb93b282f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.967235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42cdb7fcf084add9a265b99dc412219', 'request_id': 'req-849b1185-becc-4625-89c1-bc2bb93b282f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.992958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] The token cache is being invalidate because project f42cdb7fcf084add9a265b99dc412219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:19.993258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.995179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:19.998065 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 911/1836] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:19 2022] DELETE /identity/v3/projects/f42cdb7fcf084add9a265b99dc412219 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:19.999548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:20.002425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:20.098304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd53b112b3b469fa9fce9e5c5e12342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.102257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd53b112b3b469fa9fce9e5c5e12342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.158988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b1185-becc-4625-89c1-bc2bb93b282f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:20.174166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:20.174993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:20.175141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:20.175421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] PATH_INFO: `/v3/projects/d770dad834b14378abbbf027d3f05ae6/users/ab5b566f377c45039148836f1d58cd7f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:20.179357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d770dad834b14378abbbf027d3f05ae6, user_id=ab5b566f377c45039148836f1d58cd7f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:20.182211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:20.207685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 912/1837] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:19 2022] PUT /identity/v3/projects/d770dad834b14378abbbf027d3f05ae6/users/ab5b566f377c45039148836f1d58cd7f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:20.208720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:20.219432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd53b112b3b469fa9fce9e5c5e12342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.227100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:20.243198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd53b112b3b469fa9fce9e5c5e12342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.245919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd53b112b3b469fa9fce9e5c5e12342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.289334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 926/1838] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:19 2022] DELETE /identity/v3/users/0bd53b112b3b469fa9fce9e5c5e12342 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:20.290309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:20.294187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:20.440961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260648f1-3810-449b-839e-70397e5c5211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:20.447624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:20.448410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:20.448832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:20.449246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:20.450933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe536d-da14-4f4e-90c9-d5b85911267b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:20.451566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:20.470748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:20.472762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:20.487023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 927/1839] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:20.505189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:20.512354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:20.614158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:20.615274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:20.615616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:20.616030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] PATH_INFO: `/v3/users/b0babe6434484d79aa3ee7f728ed702e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:20.617387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0babe6434484d79aa3ee7f728ed702e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:20.619468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:20.654276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be546579-d803-44cf-b770-b93f5e54b973 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:20.660972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:20.662722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:20.663506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:20.664392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] PATH_INFO: `/v3/users/6aa4944077944f2793ceb2f911f054af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:20.665979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa4944077944f2793ceb2f911f054af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:20.671905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:20.890176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa4944077944f2793ceb2f911f054af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.891737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa4944077944f2793ceb2f911f054af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.891885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0babe6434484d79aa3ee7f728ed702e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.893229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0babe6434484d79aa3ee7f728ed702e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:20.996500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0babe6434484d79aa3ee7f728ed702e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.020794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0babe6434484d79aa3ee7f728ed702e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.023382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99106d5d-c95a-41ac-aff7-0eb30c6d758d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0babe6434484d79aa3ee7f728ed702e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.049702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 913/1840] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:20 2022] DELETE /identity/v3/users/b0babe6434484d79aa3ee7f728ed702e => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:21.110710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa4944077944f2793ceb2f911f054af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.141377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa4944077944f2793ceb2f911f054af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.142264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa4944077944f2793ceb2f911f054af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.180921 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 928/1841] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:20 2022] DELETE /identity/v3/users/6aa4944077944f2793ceb2f911f054af => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:21.185278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:21.185561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:21.186734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:21.219296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:21.222224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:21.310572 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 914/1842] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:21.324984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:21.324984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:21.386925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f0a2-399c-4d48-bce5-17b37ce8b416 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:21.391168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:21.391995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:21.392656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:21.392656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:21.414450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:21.416154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6d20-f25b-4c00-86d9-64537e81ccd8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:21.430415 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 929/1843] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:21.450352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:21.452226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:21.493499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bface-cd43-4187-8c1e-5fa39f1fd92a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:21.514292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:21.518481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:21.518798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:21.519080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] PATH_INFO: `/v3/projects/849a0341f97a4b7fb48013d1f0d3678c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:21.527034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] RBAC: Authorizing `identity:delete_project(project_id=849a0341f97a4b7fb48013d1f0d3678c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:21.533837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:21.719368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849a0341f97a4b7fb48013d1f0d3678c', 'request_id': 'req-9f82e69d-e20a-437e-8c20-ac0c8609133f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.785215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849a0341f97a4b7fb48013d1f0d3678c', 'request_id': 'req-9f82e69d-e20a-437e-8c20-ac0c8609133f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.795028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849a0341f97a4b7fb48013d1f0d3678c', 'request_id': 'req-9f82e69d-e20a-437e-8c20-ac0c8609133f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.824346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] The token cache is being invalidate because project 849a0341f97a4b7fb48013d1f0d3678c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:21.824923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.826012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f82e69d-e20a-437e-8c20-ac0c8609133f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:21.829474 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 915/1844] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:21 2022] DELETE /identity/v3/projects/849a0341f97a4b7fb48013d1f0d3678c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:21.834519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:21.835050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:21.835948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:21.868734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:21.870197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:21.967942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:21.973161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 930/1845] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:21.981054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427651-8f87-4d7f-a831-26845f7a8d6b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:21.981516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427651-8f87-4d7f-a831-26845f7a8d6b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:21.981895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427651-8f87-4d7f-a831-26845f7a8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.024359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fb427651-8f87-4d7f-a831-26845f7a8d6b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:22.025793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fb427651-8f87-4d7f-a831-26845f7a8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:22.050033 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 916/1846] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:22.054927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:22.066409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be71bc3-aea3-4ec7-b164-aac3e6f94987 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:22.081918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:22.082556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.086817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.087209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.088075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:22.088394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:22.090040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:22.124411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 931/1847] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:22.138237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6c08-7059-4df5-a95e-b28b72caf03b None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.140767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6c08-7059-4df5-a95e-b28b72caf03b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.140767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6c08-7059-4df5-a95e-b28b72caf03b None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.140767 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 917/1848] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:22.144422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:22.156646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.156928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.157263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.191436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1734c-c0ad-4fc5-8f80-ad5f7b8dff0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:22.210404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:22.215555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.215838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.216274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.224722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:22.225934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:22.227194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:22.231029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:22.447112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 932/1849] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:22 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:22.454221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:22.469083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:22.484483 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 918/1850] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 14:18:22.486910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:22.490855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:22.532931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e337-5756-4604-8025-5d2a5e568027 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:22.663215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:22.664037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.664466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.664841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] PATH_INFO: `/v3/projects/e164f541525243458e4be4496b3e45b4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.666212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e164f541525243458e4be4496b3e45b4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:22.670533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:22.675443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298f79e-776d-46e8-af5d-644285d6f7d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:22.684276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:22.687475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:22.687913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:22.688395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] PATH_INFO: `/v3/projects/1924118badf84a37a47eeb10ec30c081` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:22.689911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1924118badf84a37a47eeb10ec30c081)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:22.694371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:22.897598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e164f541525243458e4be4496b3e45b4', 'request_id': 'req-5d057bc2-e728-429e-8182-cf2b325ea60b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:22.904845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1924118badf84a37a47eeb10ec30c081', 'request_id': 'req-582e7174-97f0-4212-ab85-aa4b4cbf15d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.019069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e164f541525243458e4be4496b3e45b4', 'request_id': 'req-5d057bc2-e728-429e-8182-cf2b325ea60b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.030796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e164f541525243458e4be4496b3e45b4', 'request_id': 'req-5d057bc2-e728-429e-8182-cf2b325ea60b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.043642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] The token cache is being invalidate because project e164f541525243458e4be4496b3e45b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:23.043975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.044743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.050037 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 919/1851] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:22 2022] DELETE /identity/v3/projects/e164f541525243458e4be4496b3e45b4 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:23.051005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.054276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:23.056040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.076814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1924118badf84a37a47eeb10ec30c081', 'request_id': 'req-582e7174-97f0-4212-ab85-aa4b4cbf15d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.084836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1924118badf84a37a47eeb10ec30c081', 'request_id': 'req-582e7174-97f0-4212-ab85-aa4b4cbf15d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.107266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] The token cache is being invalidate because project 1924118badf84a37a47eeb10ec30c081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:23.107662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.108403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.110589 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 933/1852] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:22 2022] DELETE /identity/v3/projects/1924118badf84a37a47eeb10ec30c081 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:23.111565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.113237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.216127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d057bc2-e728-429e-8182-cf2b325ea60b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.258063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7174-97f0-4212-ab85-aa4b4cbf15d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.270200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.270887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.274737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.274737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.280257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.293673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:23.338166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.343557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.343557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.343557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.343557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.344496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cce95a-1923-4f6b-aba0-9d8b8d265f99 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.452639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 920/1853] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:23 2022] POST /identity/v3/users => generated 294 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:23.458341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e4ab-b0a9-4f64-813a-b6c40d7aec2b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.459959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e4ab-b0a9-4f64-813a-b6c40d7aec2b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.460238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e4ab-b0a9-4f64-813a-b6c40d7aec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.491442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.493553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.502868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e010e4ab-b0a9-4f64-813a-b6c40d7aec2b None None] MFA Rules not processed for user `1b95a2ca22b242de98e605dc3d3a6119`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:23.509963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e010e4ab-b0a9-4f64-813a-b6c40d7aec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.517755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 934/1854] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:23.519928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.525106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.543934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3eea-034d-4a4e-b21d-86273f800fa9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.549404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.550272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.550545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.551129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] PATH_INFO: `/v3/users/ee7484a36e464dda9d1455f1f2a345ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.552973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7484a36e464dda9d1455f1f2a345ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.555685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.638724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 921/1855] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:23.654004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.656371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.656762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.695625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:23.697185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.706526 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 922/1856] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:23.707554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.709082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.722358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e79a-fd34-4469-b3d2-e6eee00d1c60 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.728916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.729498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.730446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.730855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.731914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.734032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558bf8d-4162-49be-9a92-bb422c83876f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.750484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 923/1857] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:23.752140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668431-d0db-4de3-ba6d-54335f609225 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.752599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668431-d0db-4de3-ba6d-54335f609225 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.752976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668431-d0db-4de3-ba6d-54335f609225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.776249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ee668431-d0db-4de3-ba6d-54335f609225 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:23.777884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ee668431-d0db-4de3-ba6d-54335f609225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.787173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7484a36e464dda9d1455f1f2a345ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.787861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7484a36e464dda9d1455f1f2a345ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.808338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 924/1858] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:23.809784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.811934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.812333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.839829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:23.842040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.852682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 925/1859] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:23.853638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.855799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.870324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df589d-2d69-49bc-bf88-0b02fab71b68 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.875701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.876458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.876858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.877233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.878112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.879983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.904476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 926/1860] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:23.905567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.915020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7484a36e464dda9d1455f1f2a345ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.921956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00bc3a-984c-4b41-b171-71bdbbf34b93 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:23.929805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:23.930957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:23.931670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:23.932164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:23.933037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:23.933555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:23.933937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7484a36e464dda9d1455f1f2a345ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.934904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7484a36e464dda9d1455f1f2a345ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:23.936518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:23.953083 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 927/1861] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:23.954430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.956466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:23.962453 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 935/1862] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:23 2022] DELETE /identity/v3/users/ee7484a36e464dda9d1455f1f2a345ce => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:23.963761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:23.970660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0726a-7000-4199-9ea0-6734fe431f83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.076728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.079463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.079463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.079463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.084365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:24.104687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.106448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.132837 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 928/1863] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:24.134605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.243258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046556-0310-48a1-9ea0-ab201f092f39 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.264619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.265527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.265907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.266299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] PATH_INFO: `/v3/projects/8eb44d52b9b74ebda2c2f95ef1be449a/users/299d38bfefab470cad9bd13f6f3276c3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.314113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb44d52b9b74ebda2c2f95ef1be449a, user_id=299d38bfefab470cad9bd13f6f3276c3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.320527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be764b83-0ad7-44eb-be59-f68338299c9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.326524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769023-1f80-43b6-99bb-0e00e3b58a41 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.336048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.338811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.339120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.339442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.340259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.342838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.434346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 936/1864] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:23 2022] PUT /identity/v3/projects/8eb44d52b9b74ebda2c2f95ef1be449a/users/299d38bfefab470cad9bd13f6f3276c3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:24.436431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.436968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.437441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.461594 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 929/1865] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:24 2022] POST /identity/v3/projects => generated 411 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:24.463024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.546772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] MFA Rules not processed for user `299d38bfefab470cad9bd13f6f3276c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:24.548543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:24.663703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8bc0-72d1-4bc2-a23c-191485fc017d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.680898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.682760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.684689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.685062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.685801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.690487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.706270 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 937/1866] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:24.715072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.751741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c867d2-1c87-49b9-b319-e0c6390a0c02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.763048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.764060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.764661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.765152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.766356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.768863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.848579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 930/1867] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:24 2022] POST /identity/v3/users => generated 306 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:24.852616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.870557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015be0d-cb02-4051-a2e9-c181c2a19655 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.881547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 938/1868] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:24 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:24.882702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.884264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:24.884896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:24.885181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:24.885452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:24.886256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:24.888159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:24.903851 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:24.907687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:24.927627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4a3f-62c1-499b-9c30-8c6f58f07dac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:24.951221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:25.019454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.020508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.021331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.021991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.022973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.025057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.032555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504d902-fbbc-46db-9934-f0ff9c894a16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.037880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 932/1870] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:25.043000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.043171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.044060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.044358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.044737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.045266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.047267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0449-8b3c-477e-8d71-6cf16a365b2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.065222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98085-8ec5-4509-9df8-984c57a7722a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.072024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.073978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.074336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.074828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] PATH_INFO: `/v3/projects/f4b09b4ea38f4b26b54584bdfd90ff8b/users/c9f1d45102d544f2b12bda993ca86a6d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.097115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b09b4ea38f4b26b54584bdfd90ff8b, user_id=c9f1d45102d544f2b12bda993ca86a6d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.099943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00fc4-e0cc-4f6c-9a7f-994ad4261ba2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.254530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 939/1871] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:24 2022] POST /identity/v3/users => generated 299 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:25.256658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23bb4-9853-4388-b344-0749608f3495 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.256941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23bb4-9853-4388-b344-0749608f3495 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.257219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23bb4-9853-4388-b344-0749608f3495 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.264926 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 940/1872] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:25.265933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23bb4-9853-4388-b344-0749608f3495 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.295409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23bb4-9853-4388-b344-0749608f3495 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.312602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.313289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.313525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.313796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.314453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.322773 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 933/1873] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:25 2022] PUT /identity/v3/projects/f4b09b4ea38f4b26b54584bdfd90ff8b/users/c9f1d45102d544f2b12bda993ca86a6d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:25.322773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.322773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.323369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324741c-3aa4-4405-8387-1ae0a07d7b3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.323460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.347458 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 941/1874] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:25.359596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.359967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.360317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.382919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:25.384782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:25.455129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] MFA Rules not processed for user `c9f1d45102d544f2b12bda993ca86a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:25.456688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:25.521485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 934/1875] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:25.522464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.599912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 942/1876] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:25.600857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.620516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70da408-db61-450f-82cc-a43defadf4f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.633852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.635622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.636085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.637384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.650333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.652837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.668502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 943/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:25.669182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.701870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae29c0-d3bc-498d-a41c-a47d8f16fa80 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.732455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.733430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.734581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.735048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] PATH_INFO: `/v3/projects/f28bd8aaeef0484c938f3a38493ffe80/users/fb874f005454440fac5275a4b5169823/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.764192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:25.782821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28bd8aaeef0484c938f3a38493ffe80, user_id=fb874f005454440fac5275a4b5169823, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.789158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.823291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea142e5-d0ba-40f6-975c-85af01c0db97 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:25.844840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:25.846369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:25.847105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:25.847489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:25.849871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:25.856865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:25.919209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 935/1878] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:25 2022] PUT /identity/v3/projects/f28bd8aaeef0484c938f3a38493ffe80/users/fb874f005454440fac5275a4b5169823/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:25.920319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:25.925532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:25.981253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 944/1879] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:25 2022] POST /identity/v3/projects => generated 409 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:25.982452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:26.072508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d860f9-2394-4dbe-90d6-ec2de8f0a295 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:26.137009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187f849-11d1-412f-8eb1-d2c7efc55018 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:26.166501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:26.167291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.168811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.169795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.170583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:26.175320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:26.220827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 945/1880] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:26.223481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:26.291338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464b01-0f4f-476c-a214-31a35b128c20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:26.307202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:26.307968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.315843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.322708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.322708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:26.325514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:26.326109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:26.328686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.328979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.329255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] PATH_INFO: `/v3/projects/8f0e3746289646adad0928729ee2a102` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.332787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0e3746289646adad0928729ee2a102)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:26.337284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:26.488260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 946/1881] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:26 2022] POST /identity/v3/users => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:26.489082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:26.516312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f659485-46e8-40f3-b43f-4987ee507fdd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:26.531907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:26.532875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.533304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.533752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] PATH_INFO: `/v3/projects/f28bd8aaeef0484c938f3a38493ffe80/users/fb874f005454440fac5275a4b5169823/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.541685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28bd8aaeef0484c938f3a38493ffe80, user_id=fb874f005454440fac5275a4b5169823, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:26.549648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:26.595433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0e3746289646adad0928729ee2a102', 'request_id': 'req-0763c5d0-c334-497d-9a4e-a646dcb3fd24'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:26.607533 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 947/1882] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:26 2022] PUT /identity/v3/projects/f28bd8aaeef0484c938f3a38493ffe80/users/fb874f005454440fac5275a4b5169823/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:26.608403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:26.687820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0e3746289646adad0928729ee2a102', 'request_id': 'req-0763c5d0-c334-497d-9a4e-a646dcb3fd24'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:26.696445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0e3746289646adad0928729ee2a102', 'request_id': 'req-0763c5d0-c334-497d-9a4e-a646dcb3fd24'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:26.733006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] The token cache is being invalidate because project 8f0e3746289646adad0928729ee2a102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:26.733390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:26.734472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0763c5d0-c334-497d-9a4e-a646dcb3fd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:26.744361 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 936/1883] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:25 2022] DELETE /identity/v3/projects/8f0e3746289646adad0928729ee2a102 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:26.745875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09ff8-d35e-4aee-8432-c84b2597dc65 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.746160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09ff8-d35e-4aee-8432-c84b2597dc65 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.746432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09ff8-d35e-4aee-8432-c84b2597dc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.823958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21470ff5-ee49-4c4e-9d5c-7b26c125252c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:26.827328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-81b09ff8-d35e-4aee-8432-c84b2597dc65 None None] MFA Rules not processed for user `fb874f005454440fac5275a4b5169823`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:26.828592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-81b09ff8-d35e-4aee-8432-c84b2597dc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:26.842030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:26.842915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.849670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.849670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.849670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:26.849670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1271763-eb75-4589-b7df-0ab9bac6faa9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:26.869415 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 948/1884] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:26.874271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:26.877758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:26.880844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:26.923593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:26.925244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:26.964773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 949/1885] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:26.965701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:26.967076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:26.995621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d59bdb-d49d-40fe-a6c7-facaad40cb63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.008939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.009846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.010267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.010718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] PATH_INFO: `/v3/projects/d7b9a442aaf046efbb4c992cc917d17d/users/1645597c5ecc49e5ae4cc9c275d0d5a0/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.042128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 937/1886] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:27.044982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.045277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.048948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.049071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b9a442aaf046efbb4c992cc917d17d, user_id=1645597c5ecc49e5ae4cc9c275d0d5a0, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.049748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.072098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:27.079654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:27.097527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 938/1887] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:27.098553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.114103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca28b1-927a-42c2-9c95-37aa30cf1fde None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.122320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.122988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.123265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.132731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.132891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 950/1888] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:26 2022] PUT /identity/v3/projects/d7b9a442aaf046efbb4c992cc917d17d/users/1645597c5ecc49e5ae4cc9c275d0d5a0/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:27.132998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:27.132998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.132998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.134345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.144399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 939/1889] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:27.145936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.159693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfea13-9ec9-46e7-93d5-b1d055fd7e62 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.202452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:27.272456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb7378-55c6-4e16-8b1b-3a9b843b9795 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.291137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.291137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.291137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.291137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.291434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.291502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.291502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.291502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.291502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.291769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.291857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.291935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b36785-05e4-4c05-9c84-3a7bad951d32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.308554 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 951/1890] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:27.309868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.310153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.311104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.377820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] MFA Rules not processed for user `f7bc608b554e4c6b94ec547f4e6c1d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:27.379100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:27.444643 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 940/1891] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:27 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:27.446332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.526588 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 952/1892] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:27.530105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.547628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207eacf-d79a-4a6f-a28f-a7d8a447e894 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.620717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad65646-fdf0-4ee2-a57b-3ff8a7bd88ad admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.632335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.634081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.634081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.634081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] PATH_INFO: `/v3/projects/d7b9a442aaf046efbb4c992cc917d17d/users/1645597c5ecc49e5ae4cc9c275d0d5a0/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.637093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b9a442aaf046efbb4c992cc917d17d, user_id=1645597c5ecc49e5ae4cc9c275d0d5a0, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.640048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.672325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 941/1893] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:27 2022] PUT /identity/v3/projects/d7b9a442aaf046efbb4c992cc917d17d/users/1645597c5ecc49e5ae4cc9c275d0d5a0/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:27.672325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.679143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.679884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.680307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.680681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.681402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:27.681724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.685250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.694414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:27.792391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:27.801588 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 953/1894] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:27 2022] POST /identity/v3/users => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:27.802607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:27.808693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:27.854574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a551f-8699-40e7-97d6-8e9259045498 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:27.869562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:27.869562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:27.869562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:27.869562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:27.869949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:27.870716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:27.955196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdf0d3-4961-474b-b533-cfec3b2c0877 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.051390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.052675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.053002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.053969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebb656-e898-4814-ac2e-22d3b70c169b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 954/1895] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.520449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.521902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] MFA Rules not processed for user `1645597c5ecc49e5ae4cc9c275d0d5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:28.521902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:28.521902 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 955/1896] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:28.521902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.521902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685efca4-a06a-4f29-8fd1-66110b4337aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.523042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.523042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.523042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.523042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.524070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.524070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:28.524070 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 956/1897] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:28.541732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.554663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8deb5-a057-4619-be18-1aaf30aa7692 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.563943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.564987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.565425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.566437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.567314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.577455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:28.577605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 942/1898] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:27 2022] POST /identity/v3/projects => generated 397 bytes in 909 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:28.577605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.579031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:28.586428 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 957/1899] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:28.595588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.613307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42574b-fd73-4948-867e-36304a0d53b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.700513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.701204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.701483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.701753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.702399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.722316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:28.728328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86337b9a-b0e8-49fe-b54e-54e393582787 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.740251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.741719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.742216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.742601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.848289 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 958/1900] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:28 2022] POST /identity/v3/users => generated 305 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:28.848289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.876738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.879043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:28.881825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacbfd7-d341-4777-92d5-54f47f410c06 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.901537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:28.903854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:28.905582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:28.908113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] PATH_INFO: `/v3/projects/c8c04af669ce495bba395d1e0b4a92c4/users/0ad9e18717fb4252909b72999b258335/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:28.922901 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 943/1901] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:28.926416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:28.979970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d169-8a89-4caa-955f-18ce642754ba service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:28.982738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c04af669ce495bba395d1e0b4a92c4, user_id=0ad9e18717fb4252909b72999b258335, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:28.996340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935774bc-8bba-4080-bded-dfaf8ac1100d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.001610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.004333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.007544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.007544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.009268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.012846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.029296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 944/1902] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:29.031643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.043317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657770a-fde8-4864-b340-8b5980282524 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.049486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.050378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.055357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.055357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] PATH_INFO: `/v3/projects/55fd6b1466194635b1696e0935ae6709/users/fa59e5b84e75459cbccb8549e957fd6b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.072393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fd6b1466194635b1696e0935ae6709, user_id=fa59e5b84e75459cbccb8549e957fd6b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.078516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.128392 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 959/1903] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:28 2022] PUT /identity/v3/projects/c8c04af669ce495bba395d1e0b4a92c4/users/0ad9e18717fb4252909b72999b258335/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:29.141322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.141522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.141778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.209495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 945/1904] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:29 2022] PUT /identity/v3/projects/55fd6b1466194635b1696e0935ae6709/users/fa59e5b84e75459cbccb8549e957fd6b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:29.214098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.214937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] MFA Rules not processed for user `0ad9e18717fb4252909b72999b258335`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:29.216392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:29.348582 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 960/1905] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:29.353028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.358272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8da1f-261e-46f0-b79f-128a33f1f095 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.369515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.371292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.371292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.371292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.373608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.376059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.377392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f591e-be7c-48ef-9578-7c48ccd16a59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.393740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.396601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.396601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.396601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.396601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.398425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.399437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 946/1906] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:29.403847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.425611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5786e-f922-4839-b3b8-6689a66be752 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.435861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.437259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.437390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.438269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] PATH_INFO: `/v3/projects/55fd6b1466194635b1696e0935ae6709/users/fa59e5b84e75459cbccb8549e957fd6b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.442279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fd6b1466194635b1696e0935ae6709, user_id=fa59e5b84e75459cbccb8549e957fd6b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.445692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.477081 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 947/1907] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:29 2022] PUT /identity/v3/projects/55fd6b1466194635b1696e0935ae6709/users/fa59e5b84e75459cbccb8549e957fd6b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:29.527505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.554650 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 961/1908] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:29 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:29.554650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.759442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1637c5-9234-4b63-9089-e0b11cfe708c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.765099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.765869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.766439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.766874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.767800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.770085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.773683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9dd58-57d3-416c-a8ff-2d21ad88a39c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.918998 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 962/1909] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:29 2022] POST /identity/v3/users => generated 307 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:29.922806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:29.944595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50deae-7358-49e3-bf37-ba24d0d595c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:29.957656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.960242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.960242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.960242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.960242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:29.962436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:29.976855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:29.977537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:29.977816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:29.978088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:29.983702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:29.997323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 963/1910] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:30.001563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:30.024176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b3d7-b733-42ca-8bfa-ef423b1e63a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:30.043215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:30.044136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:30.044519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:30.044894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] PATH_INFO: `/v3/projects/1b4bf087b77d4966a3ad46ee3a449483/users/c0198d6eb20645fc85b577bd32ae3b35/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:30.084036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4bf087b77d4966a3ad46ee3a449483, user_id=c0198d6eb20645fc85b577bd32ae3b35, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:30.088885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:30.131810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:30.133956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:30.148718 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 948/1911] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:29 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:30.185708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 964/1912] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:30 2022] PUT /identity/v3/projects/1b4bf087b77d4966a3ad46ee3a449483/users/c0198d6eb20645fc85b577bd32ae3b35/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:30.189930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:30.214933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dfea-8277-46e5-bd6e-95223f4684b7 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:30.351258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:30.352198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:30.362306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:30.368747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:30.368747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:30.368747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafef5-4db6-4c89-ad1d-c49dc7ba4ca9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:30.396518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 949/1913] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:30.396730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:30.415928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cf089-dc11-4da8-a2ac-8c569dceaec8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:30.428123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:30.428830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:30.429109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:30.429390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] PATH_INFO: `/v3/projects/1b4bf087b77d4966a3ad46ee3a449483/users/c0198d6eb20645fc85b577bd32ae3b35/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:30.439819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4bf087b77d4966a3ad46ee3a449483, user_id=c0198d6eb20645fc85b577bd32ae3b35, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:30.443055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:30.489774 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 965/1914] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:30 2022] PUT /identity/v3/projects/1b4bf087b77d4966a3ad46ee3a449483/users/c0198d6eb20645fc85b577bd32ae3b35/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:30.503357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:30.506948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:30.507376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:30.588418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:30.602515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] MFA Rules not processed for user `c0198d6eb20645fc85b577bd32ae3b35`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:30.605259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:30.711207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:30.733008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e6cb-9917-41b6-9144-34d9c7fafaa7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:30.739519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:30.740311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:30.740691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:30.741065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] PATH_INFO: `/v3/users/c9f1d45102d544f2b12bda993ca86a6d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:30.742876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f1d45102d544f2b12bda993ca86a6d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:30.745147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:30.773795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:30.850401 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 950/1915] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:31.006866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f1d45102d544f2b12bda993ca86a6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:31.007681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f1d45102d544f2b12bda993ca86a6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:31.100318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f1d45102d544f2b12bda993ca86a6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:31.131947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f1d45102d544f2b12bda993ca86a6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:31.140710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02bb3bd3-2fa7-4a7c-a414-a6c7752c2d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f1d45102d544f2b12bda993ca86a6d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:31.180476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:31.210532 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 966/1916] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:30 2022] DELETE /identity/v3/users/c9f1d45102d544f2b12bda993ca86a6d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:31.211494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:31.211783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:31.212322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:31.240822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:31.242410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:31.347823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 967/1917] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:31.356823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:31.359360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:31.361200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a7af-d5f2-4cd1-a42d-6946f356079f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:31.470457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167f14-cf56-4f84-9e71-eeb707b132fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:31.474963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:31.475873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:31.476241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:31.476611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:31.478780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:31.478977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:31.479782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:31.482865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:31.483420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:31.534559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:31.535297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:31.550462 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 968/1918] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:31.596185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:31.598193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:31.612185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 951/1919] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:32.229620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:32.233025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:32.261826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3388b1-fe10-4b1f-8462-ae9ef83f2d1b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:32.287044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:32.287764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:32.290519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:32.290519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] PATH_INFO: `/v3/users/299d38bfefab470cad9bd13f6f3276c3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:32.290519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299d38bfefab470cad9bd13f6f3276c3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:32.291968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:32.337894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:32.377612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:32.379941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:32.408268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeae6f-5cb5-45cf-97ff-08fc731e9975 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:32.418880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:32.420257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:32.420691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:32.421118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] PATH_INFO: `/v3/projects/f4b09b4ea38f4b26b54584bdfd90ff8b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:32.423016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b09b4ea38f4b26b54584bdfd90ff8b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:32.425207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:32.589135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299d38bfefab470cad9bd13f6f3276c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.590142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299d38bfefab470cad9bd13f6f3276c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.663526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b09b4ea38f4b26b54584bdfd90ff8b', 'request_id': 'req-91e683c5-67c6-4451-992b-760840a98f54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.687608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299d38bfefab470cad9bd13f6f3276c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.721345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299d38bfefab470cad9bd13f6f3276c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.722466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c259c8e-ce56-43da-b345-645111c97db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299d38bfefab470cad9bd13f6f3276c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.767425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 969/1920] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:32 2022] DELETE /identity/v3/users/299d38bfefab470cad9bd13f6f3276c3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:32.771687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:32.771974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:32.772256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:32.796078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b09b4ea38f4b26b54584bdfd90ff8b', 'request_id': 'req-91e683c5-67c6-4451-992b-760840a98f54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.803576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b09b4ea38f4b26b54584bdfd90ff8b', 'request_id': 'req-91e683c5-67c6-4451-992b-760840a98f54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.843982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:32.845242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:32.852104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] The token cache is being invalidate because project f4b09b4ea38f4b26b54584bdfd90ff8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:32.852560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.854043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:32.860383 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 952/1921] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:32 2022] DELETE /identity/v3/projects/f4b09b4ea38f4b26b54584bdfd90ff8b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:32.865381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:32.868001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.008778 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 970/1922] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:33.009922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:33.022127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.056678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee688b5-366c-49f8-a9d8-a156cc9c0b77 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:33.082809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:33.083978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:33.084421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:33.084856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] PATH_INFO: `/v3/users/1645597c5ecc49e5ae4cc9c275d0d5a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:33.086515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1645597c5ecc49e5ae4cc9c275d0d5a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:33.088685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:33.102365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e683c5-67c6-4451-992b-760840a98f54 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:33.195248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:33.195872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:33.196145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:33.196409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:33.198642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.215060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:33.294242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:33.298578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:33.316528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 953/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:33.316528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:33.316528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.348417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1645597c5ecc49e5ae4cc9c275d0d5a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.349989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1645597c5ecc49e5ae4cc9c275d0d5a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.413457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe52605-1321-443c-9bcb-1be53f73f065 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:33.418482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:33.419865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:33.420146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:33.425551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:33.425551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.443525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:33.445407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:33.448508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1645597c5ecc49e5ae4cc9c275d0d5a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.464205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 954/1924] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:33.465273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:33.466886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.477496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1645597c5ecc49e5ae4cc9c275d0d5a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.478566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-069ae3e7-e5d4-4d88-9ef2-882ecd34dc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1645597c5ecc49e5ae4cc9c275d0d5a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.488060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02cdd3-b60d-451b-86df-c865f0fd65b7 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:33.495939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 971/1925] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:33 2022] DELETE /identity/v3/users/1645597c5ecc49e5ae4cc9c275d0d5a0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:33.509698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:33.511892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:33.513023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:33.513023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] PATH_INFO: `/v3/users/0ad9e18717fb4252909b72999b258335` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:33.516978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad9e18717fb4252909b72999b258335)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:33.522692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:33.716338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:33.810216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad9e18717fb4252909b72999b258335'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.815322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad9e18717fb4252909b72999b258335'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.875990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad9e18717fb4252909b72999b258335'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.906337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad9e18717fb4252909b72999b258335'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.909166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad9e18717fb4252909b72999b258335'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:33.939111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 955/1926] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:33 2022] DELETE /identity/v3/users/0ad9e18717fb4252909b72999b258335 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:33.944464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:33.945032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:33.945866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:33.951043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:33.960043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:33.988884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:33.991667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:34.074988 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 972/1927] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:34.087306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:34.089479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:34.139098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d14c-a446-4608-a6bf-5b5fc818339f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:34.153333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:34.153979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:34.154325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:34.154633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:34.160689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:34.189558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e1d94-19c6-43e3-932d-e83a328dc133 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:34.194291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:34.195972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:34.195972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:34.196191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:34.207724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:34.213564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef403a-5706-40bc-87a7-b495ce3e6969 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:34.223350 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 973/1928] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:34.282819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:34.284627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:34.306804 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 956/1929] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:34.556728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:34.830073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:34.830073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:34.830073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:34.892975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] MFA Rules not processed for user `ab5b566f377c45039148836f1d58cd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:34.894841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:35.108790 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 974/1930] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:35.202067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:35.203514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:35.230051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ea2c6-9c56-4702-9a3b-2845d27bcc1b service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:35.237437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:35.238144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:35.238359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:35.238722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] PATH_INFO: `/v3/projects/8eb44d52b9b74ebda2c2f95ef1be449a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:35.240885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb44d52b9b74ebda2c2f95ef1be449a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:35.245691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:35.276781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:35.391826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb44d52b9b74ebda2c2f95ef1be449a', 'request_id': 'req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.496121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb44d52b9b74ebda2c2f95ef1be449a', 'request_id': 'req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.505469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb44d52b9b74ebda2c2f95ef1be449a', 'request_id': 'req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.545799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] The token cache is being invalidate because project 8eb44d52b9b74ebda2c2f95ef1be449a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:35.546484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.553233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.558990 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 957/1931] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:35 2022] DELETE /identity/v3/projects/8eb44d52b9b74ebda2c2f95ef1be449a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:35.562855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:35.587539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00271a05-e4bc-4c5b-b22f-a09781759f17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:35.706870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:35.707755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:35.710151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:35.710528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] PATH_INFO: `/v3/users/fb874f005454440fac5275a4b5169823` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:35.712342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb874f005454440fac5275a4b5169823)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:35.714450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:35.842129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:35.857302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:35.859920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:35.886729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104fdd-41ec-4248-b1a5-89e2d5f61bfc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:35.893596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:35.896251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:35.896251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:35.896251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] PATH_INFO: `/v3/projects/c8c04af669ce495bba395d1e0b4a92c4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:35.897650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c04af669ce495bba395d1e0b4a92c4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:35.900754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:35.911997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb874f005454440fac5275a4b5169823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:35.912731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb874f005454440fac5275a4b5169823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.039233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb874f005454440fac5275a4b5169823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.060648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb874f005454440fac5275a4b5169823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.062172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb874f005454440fac5275a4b5169823'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.082027 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 975/1932] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:35 2022] DELETE /identity/v3/users/fb874f005454440fac5275a4b5169823 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:36.082999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:36.116873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:36.140769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:36.178515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c04af669ce495bba395d1e0b4a92c4', 'request_id': 'req-2b5114ce-bae0-48bd-88dc-dfc67700241d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.263339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b850f-1a16-4835-b29d-e9da8a1aa344 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:36.271119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c04af669ce495bba395d1e0b4a92c4', 'request_id': 'req-2b5114ce-bae0-48bd-88dc-dfc67700241d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.278555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c04af669ce495bba395d1e0b4a92c4', 'request_id': 'req-2b5114ce-bae0-48bd-88dc-dfc67700241d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.323667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] The token cache is being invalidate because project c8c04af669ce495bba395d1e0b4a92c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:36.326988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.326988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.327965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 958/1933] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:35 2022] DELETE /identity/v3/projects/c8c04af669ce495bba395d1e0b4a92c4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:36.333669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:36.337487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:36.431397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:36.432076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:36.432909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:36.433195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] PATH_INFO: `/v3/projects/d7b9a442aaf046efbb4c992cc917d17d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:36.437668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b9a442aaf046efbb4c992cc917d17d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:36.441331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:36.600300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b9a442aaf046efbb4c992cc917d17d', 'request_id': 'req-bd475c64-4ec8-4a19-939f-5c8449e1597c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.663526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5114ce-bae0-48bd-88dc-dfc67700241d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:36.699046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b9a442aaf046efbb4c992cc917d17d', 'request_id': 'req-bd475c64-4ec8-4a19-939f-5c8449e1597c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.706883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b9a442aaf046efbb4c992cc917d17d', 'request_id': 'req-bd475c64-4ec8-4a19-939f-5c8449e1597c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.729868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] The token cache is being invalidate because project d7b9a442aaf046efbb4c992cc917d17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:36.731854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.734150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd475c64-4ec8-4a19-939f-5c8449e1597c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:36.738401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 976/1934] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:36 2022] DELETE /identity/v3/projects/d7b9a442aaf046efbb4c992cc917d17d => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:36.744237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd269-8f78-488a-a06b-321a7b5aba1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:36.744731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd269-8f78-488a-a06b-321a7b5aba1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:36.745184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd269-8f78-488a-a06b-321a7b5aba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:36.789884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d64cd269-8f78-488a-a06b-321a7b5aba1c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:36.791201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d64cd269-8f78-488a-a06b-321a7b5aba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:36.838068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:36.838990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:36.839422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:36.840050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] PATH_INFO: `/v3/users/c0198d6eb20645fc85b577bd32ae3b35` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:36.842302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0198d6eb20645fc85b577bd32ae3b35)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:36.844587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:36.930468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 977/1935] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:36.944032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:36.944032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:36.944322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.002674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:37.003913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:37.029236 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 978/1936] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:37.030910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.050858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9366be2-e779-46b7-9afd-1e3e495d6282 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.057679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.058784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.059455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.059895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.060729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:37.061170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.063651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312906-61a3-43bc-b6ef-7c3ea3905e47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.082443 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 979/1937] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:37.084584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce8ea-4276-4540-a449-c8988265c1ad None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.085008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce8ea-4276-4540-a449-c8988265c1ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.085435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce8ea-4276-4540-a449-c8988265c1ad None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.087161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 980/1938] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:37.087995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fce8ea-4276-4540-a449-c8988265c1ad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.105572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fce8ea-4276-4540-a449-c8988265c1ad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.113349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:37.117789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.118731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.119193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.119686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.120789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.123014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cedc60-29cb-468f-a6bf-6f650dd76598 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.134050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0198d6eb20645fc85b577bd32ae3b35'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:37.134808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0198d6eb20645fc85b577bd32ae3b35'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:37.244598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0198d6eb20645fc85b577bd32ae3b35'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:37.255015 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 981/1939] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:37 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:37.260387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.264989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.265400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.293313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0198d6eb20645fc85b577bd32ae3b35'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:37.295501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0198d6eb20645fc85b577bd32ae3b35'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:37.316186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:37.318130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:37.338674 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 959/1940] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:36 2022] DELETE /identity/v3/users/c0198d6eb20645fc85b577bd32ae3b35 => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:37.338674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.344538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:37.475453 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 982/1941] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:37.484256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d7aec-6d64-4eae-8e22-e0a5eeb784bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.490461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.491251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.491538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.492289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.493199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.496459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.552491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.554106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:37.601645 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 960/1942] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:37 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:37.601645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.613177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f87-9165-4794-bee8-4f74536ee1f5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.618404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.619158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.619487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.619786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.620484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.622349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.641106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 961/1943] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:37.643704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.663328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1af8-e6e3-4294-85f0-a74868eb7e84 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.666584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2248-dc6c-4099-8d48-6153a9b78853 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.679534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.680212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.680461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.680765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.681425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.683532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.711390 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 962/1944] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:37.712513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:37.736280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997879-6f4e-4468-bfa8-50779f453c36 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:37.745138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.745683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.745956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.746222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] PATH_INFO: `/v3/projects/1eb2cbae755b4432a7a9abb0b8a717a3/users/fc3ec796aa5a43239808825b79a6f13e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.768094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:37.768717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.768992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.769260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.781358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb2cbae755b4432a7a9abb0b8a717a3, user_id=fc3ec796aa5a43239808825b79a6f13e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.785558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2573aec-e294-47cb-af09-8e6bf13c95c0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.858523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:37.869945 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 963/1945] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:37 2022] PUT /identity/v3/projects/1eb2cbae755b4432a7a9abb0b8a717a3/users/fc3ec796aa5a43239808825b79a6f13e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:37.872539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:37.872823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:37.873147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:37.889766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:37.890985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:37.904672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 983/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:37.929040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] MFA Rules not processed for user `fc3ec796aa5a43239808825b79a6f13e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:37.932864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:38.020313 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 964/1947] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:38.021505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.037612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cadb2f-b3a6-4ab8-9384-4d6b75b23713 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.055475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.057356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:38.125207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.127134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.127428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.128117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.128818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.132934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:38.196966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ebd6-bb4c-476b-beda-36ca368e2869 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.204285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.210994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.211489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.211785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] PATH_INFO: `/v3/projects/f28bd8aaeef0484c938f3a38493ffe80` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.214956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28bd8aaeef0484c938f3a38493ffe80)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.218806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:38.290181 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 984/1948] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:38 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:38.300626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.303506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:38.421819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28bd8aaeef0484c938f3a38493ffe80', 'request_id': 'req-b80f574c-a884-47eb-a9c4-0a2b6eca306e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:38.513318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87720b57-0f2a-4c48-be4e-172db521d694 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.522408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28bd8aaeef0484c938f3a38493ffe80', 'request_id': 'req-b80f574c-a884-47eb-a9c4-0a2b6eca306e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:38.542018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28bd8aaeef0484c938f3a38493ffe80', 'request_id': 'req-b80f574c-a884-47eb-a9c4-0a2b6eca306e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:38.584993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] The token cache is being invalidate because project f28bd8aaeef0484c938f3a38493ffe80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:38.585545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:38.588453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b80f574c-a884-47eb-a9c4-0a2b6eca306e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:38.593685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 965/1949] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:38 2022] DELETE /identity/v3/projects/f28bd8aaeef0484c938f3a38493ffe80 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:38.598142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d081-90ad-4a36-821e-efa52f717218 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.599186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d081-90ad-4a36-821e-efa52f717218 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.599633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d081-90ad-4a36-821e-efa52f717218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.615840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.616649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.619174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.620111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.621107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.627196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:38.641637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bc28d081-90ad-4a36-821e-efa52f717218 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:38.642982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc28d081-90ad-4a36-821e-efa52f717218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:38.660430 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 966/1950] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:38.663973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.664261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.664536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.724054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:38.726374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:38.764860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 985/1951] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:38 2022] POST /identity/v3/users => generated 299 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:38.767649 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 967/1952] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:38.769060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.772560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.777349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:38.811213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707a8e3-1cb1-4f3e-ba36-b371c4aa0460 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.823492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0087-c03c-4f5c-bf3a-664bd3286df5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.835303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.839311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.840179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.840468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.843268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:38.843591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.845920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.846980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.850160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.852508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.852931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.853388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:38.857786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:38.877492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 986/1953] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:38.882110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.886012 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 968/1954] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:38.890416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:38.913643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795768-dea9-484c-8c7f-f93216072623 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.921776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd6c0-0108-4a64-a4de-efe0fe54bdac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:38.927803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.929762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.930641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:38.931878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:38.932064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.949287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.950674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:38.951400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:38.951692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] PATH_INFO: `/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78/users/7b4f3b45d3e340d398d75c2edc58718e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:38.957300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.003422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d0cc8bfb0748f8977ad2e0e6005d78, user_id=7b4f3b45d3e340d398d75c2edc58718e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.008374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.133000 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 969/1955] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:38 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:39.134449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.136108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 987/1956] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:38 2022] PUT /identity/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78/users/7b4f3b45d3e340d398d75c2edc58718e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:39.141732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.277248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6500-f49c-4345-af4a-3de666696c62 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.283614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.284382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.284659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.284930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.285731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.287843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.338371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c3e3-4d0a-46ad-a20b-b84e67f4f069 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.353049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.354497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.355391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.356036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.359432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.365505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.397422 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 988/1957] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:39.401135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.424660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731793c-f45f-4b08-934f-e1a6df7c79c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.432187 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 970/1958] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:39 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:39.436407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.439902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.440685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.441006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.441379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] PATH_INFO: `/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78/users/7b4f3b45d3e340d398d75c2edc58718e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.448558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d0cc8bfb0748f8977ad2e0e6005d78, user_id=7b4f3b45d3e340d398d75c2edc58718e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.453870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e493-4ff0-4221-be3f-41154a520f62 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.456111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.467468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.468278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.468402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.468636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.469270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.471788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7781-c1ba-423c-a53c-2393291ca364 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.482307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 989/1959] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:39 2022] PUT /identity/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78/users/7b4f3b45d3e340d398d75c2edc58718e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:39.491326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 971/1960] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:39.496319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.512415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.512415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.512647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.590303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] MFA Rules not processed for user `7b4f3b45d3e340d398d75c2edc58718e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:39.592458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:39.655697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b67a3-ace6-4505-bbd3-055f897c84eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.669559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.671158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.671834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.672063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.673101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.674854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.723039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 990/1961] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:39.726403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.750595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e520-57d6-4842-ac85-177dc51a38af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.761224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.762504 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 972/1962] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:39.763292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.763632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.763961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] PATH_INFO: `/v3/projects/a585dfdf811047b598d01c005e4312e1/users/f262cf2fa2324b8bba9510abeb153cd1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.784220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a585dfdf811047b598d01c005e4312e1, user_id=f262cf2fa2324b8bba9510abeb153cd1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.788322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e11e-a124-4eed-8413-0db4aaeacbaf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.791946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:39.844573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:39.851508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:39.883740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8df4-eca9-4505-9885-cbc7c398f9ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:39.893563 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 991/1963] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:39 2022] PUT /identity/v3/projects/a585dfdf811047b598d01c005e4312e1/users/f262cf2fa2324b8bba9510abeb153cd1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:39.906456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.907430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.908260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.929008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:39.929961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:39.934181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:39.937672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] PATH_INFO: `/v3/projects/1b4bf087b77d4966a3ad46ee3a449483` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:39.942517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4bf087b77d4966a3ad46ee3a449483)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:39.950786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:39.978358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] MFA Rules not processed for user `f262cf2fa2324b8bba9510abeb153cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:39.979905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.140464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 992/1964] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:40.153912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:40.153912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.191278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4bf087b77d4966a3ad46ee3a449483', 'request_id': 'req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:40.293281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4bf087b77d4966a3ad46ee3a449483', 'request_id': 'req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:40.300747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4bf087b77d4966a3ad46ee3a449483', 'request_id': 'req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:40.303745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f6924-aebf-4380-a2a7-d2d19bf34efc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:40.326098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] The token cache is being invalidate because project 1b4bf087b77d4966a3ad46ee3a449483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:40.326098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:40.330326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:40.333465 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 973/1965] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:39 2022] DELETE /identity/v3/projects/1b4bf087b77d4966a3ad46ee3a449483 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:40.334603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:40.336640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.383671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:40.476507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:40.479081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.486788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.486788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.486788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.516555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb3ce-3664-4e6e-ab0a-bf5ba734e4d3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:40.531663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:40.532747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.535312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.536994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.537897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:40.543094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdb3df-28e2-4950-bd89-3aeeda450791 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:40.593297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:40.595600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fd12-9a4e-4ded-ab28-79c26fe06413 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:40.610270 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 993/1966] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:40.612131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.612402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.612967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.662258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:40.663803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.674009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 994/1967] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:40.679499 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 974/1968] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:40 2022] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:40.686999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:40.691032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.691454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.691825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.732426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17b87-ae2c-44a3-8fe7-b1682aaa6c25 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:40.752081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:40.753427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:40.860180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:40.862470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.863661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.864624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.865665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:40.872117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:40.884375 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 975/1969] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:40.887822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:40.904488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d189e3-0992-4602-87bf-3ff8ec5e152e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:40.912790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:40.913551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.913943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.914262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.915274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:40.915651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:40.921366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:40.938513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 976/1970] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:40.942773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:40.956730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979169ed-a45d-4014-ab8d-4d4ccedac27d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:40.967498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:40.968173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:40.968456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:40.969194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:40.972872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:40.972872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.012241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 995/1971] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:40 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:41.013130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.049059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49a08f-d12c-4dcb-a36b-ad13ea2fe397 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.062155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.063059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.063405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.063755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.064343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.066015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.091822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 996/1972] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:41.096066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.114692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e6dc-09e3-480b-9279-ad69a6122ae3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.130964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.131617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.133591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.133591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] PATH_INFO: `/v3/projects/aebb5c62916f49798e8fdfbb1588b17b/users/29454893ea674a59b6637fcb92d2a62c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.135778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 977/1973] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:40 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:41.141991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.167282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:41.179568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb5c62916f49798e8fdfbb1588b17b, user_id=29454893ea674a59b6637fcb92d2a62c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.182241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.255336 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 997/1974] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:41 2022] PUT /identity/v3/projects/aebb5c62916f49798e8fdfbb1588b17b/users/29454893ea674a59b6637fcb92d2a62c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:41.260275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.271294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697d98-5f9b-4547-aa29-5507c39c8e47 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.390484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.390868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.391250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.391526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.393230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.411802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.492862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 978/1975] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:41 2022] POST /identity/v3/users => generated 286 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:41.493193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190147b9-36f7-4524-b0b1-32749baecdb9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.496774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.508858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.509494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.509773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.510046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.510725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.512407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.524572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b751-bcff-4af0-aca1-8b61a71bbfc0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.540060 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 998/1976] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:41.541121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.542121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.543049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.543327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.543595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.544247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.547972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.573319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edf9f-e2dd-428d-ac09-6f0801702cb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.579642 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 979/1977] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:41.581210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.581749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.582978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.583269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.583541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] PATH_INFO: `/v3/projects/aebb5c62916f49798e8fdfbb1588b17b/users/29454893ea674a59b6637fcb92d2a62c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.589454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb5c62916f49798e8fdfbb1588b17b, user_id=29454893ea674a59b6637fcb92d2a62c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.592198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dc181-9c81-4dc2-9ee4-abf98179566b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.606468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574248d-4751-4bc6-87b0-260ea0755549 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.624449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 999/1978] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:41 2022] PUT /identity/v3/projects/aebb5c62916f49798e8fdfbb1588b17b/users/29454893ea674a59b6637fcb92d2a62c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:41.629986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ae29-a1d9-4e5c-a75b-26ca2f2ac84e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.630290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ae29-a1d9-4e5c-a75b-26ca2f2ac84e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.630555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4ae29-a1d9-4e5c-a75b-26ca2f2ac84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.698050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dfb4ae29-a1d9-4e5c-a75b-26ca2f2ac84e None None] MFA Rules not processed for user `29454893ea674a59b6637fcb92d2a62c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:41.699448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfb4ae29-a1d9-4e5c-a75b-26ca2f2ac84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:41.748334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.748949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.749224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.749494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.750136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.754414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.767315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 980/1979] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:41.773656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:41.788676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d1225-6222-42ae-a134-867c8594544d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:41.816637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:41.817988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.818488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.819452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] PATH_INFO: `/v3/projects/918954b7343f40b8a1b42b21e4783678/users/e21521b8d7994354a3c30988a375e431/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:41.834154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:41.848788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918954b7343f40b8a1b42b21e4783678, user_id=e21521b8d7994354a3c30988a375e431, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:41.853407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:41.925249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1000/1980] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:41.946132 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 981/1981] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:41 2022] PUT /identity/v3/projects/918954b7343f40b8a1b42b21e4783678/users/e21521b8d7994354a3c30988a375e431/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:41.961549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:41.961839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:41.962110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:42.047504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] MFA Rules not processed for user `e21521b8d7994354a3c30988a375e431`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:42.049324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:42.192316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:42.258411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1001/1982] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:42.790685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:42.793602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:42.884055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:42.892859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:43.042824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ddb6-2db6-421a-9a8d-ad07dd5a2818 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:43.061059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b53bd-894e-4208-becf-3b695482ba2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:43.066225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:43.067625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.068265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.068543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] PATH_INFO: `/v3/users/fc3ec796aa5a43239808825b79a6f13e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.069922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3ec796aa5a43239808825b79a6f13e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:43.072039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:43.072784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:43.073431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.073707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.073982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.090052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:43.091998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:43.118920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 982/1983] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:43.123126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:43.297935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f96ee-6da6-4495-b2fb-acabe856937c service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:43.305980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:43.306646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.306934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.307179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.307838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:43.308136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:43.310813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:43.349524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 983/1984] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:43.350507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:43.360139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:43.382870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6dc91-c50c-4ba8-b8e2-d8848750f213 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:43.409168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:43.409168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.409168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.409825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.409825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:43.411122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:43.432785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3ec796aa5a43239808825b79a6f13e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:43.433662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3ec796aa5a43239808825b79a6f13e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:43.561280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3ec796aa5a43239808825b79a6f13e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:43.574630 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 984/1985] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:43 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:43.575592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:43.581394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:43.587397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3ec796aa5a43239808825b79a6f13e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:43.588379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f31e41d-7ce6-488a-a0a5-39e0f2a4e2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3ec796aa5a43239808825b79a6f13e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:43.627370 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1002/1986] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:42 2022] DELETE /identity/v3/users/fc3ec796aa5a43239808825b79a6f13e => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:43.633913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.634526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.635023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.713459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:43.714871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:43.764748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e079d5-d377-4b7e-98c6-507520398f21 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:43.885450 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1003/1987] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:43.906403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:43.916702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:43.920675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:43.921149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:43.923489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:43.923951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:43.925951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:43.949460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:43.950108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 985/1988] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:43.950255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:44.054592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a805994-00e2-41bb-aa63-d568a5e53cc6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:44.058761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:44.059921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:44.061490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:44.062091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:44.077727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:44.079591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4867807-ec60-4390-bd92-5e30801f5701 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:44.096490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1004/1989] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:18:44.209081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:44.379017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:44.381345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:44.524740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea4ea-e500-4c08-a167-a5f48e992453 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:44.535916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:44.535916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:44.535916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:44.537016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:44.556628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:44.558646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:44.608362 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 986/1990] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:44.646445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a32b-3562-47c8-abfa-9f4d82de95a9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:44.646986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a32b-3562-47c8-abfa-9f4d82de95a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:44.648939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a32b-3562-47c8-abfa-9f4d82de95a9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:44.648939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1005/1991] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:44.659658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:44.684466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:44.698923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae06a5-edc1-496c-85bf-749330efdc82 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:44.710703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:44.710703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:44.710703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:44.711100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:44.711100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cc1965f6bdf4fd2862f7aaf5ac8e722)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:44.716530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:44.725851 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 987/1992] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:44 2022] GET /identity/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722 => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:45.012077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.012675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.013146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.015068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1006/1993] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:45.020596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:45.047698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.068515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b129982-7c15-44b1-b5fc-a541ddf1a5e8 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.091043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.091043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.091043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.091276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.091276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cc1965f6bdf4fd2862f7aaf5ac8e722)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.091417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.091417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:45.109156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.118819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 988/1994] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:45 2022] GET /identity/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:45.124227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80325104-3a59-426c-8a49-71daa3173ea3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.130001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.130911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.131357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.131776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] PATH_INFO: `/v3/projects/1eb2cbae755b4432a7a9abb0b8a717a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.133170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb2cbae755b4432a7a9abb0b8a717a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.135785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.242328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.253555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fae45-0e77-4194-8527-630293c48025 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.271338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.272010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.272292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.272562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.273217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:45.273580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.284469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.324089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb2cbae755b4432a7a9abb0b8a717a3', 'request_id': 'req-330364a1-ffdf-4334-b9d5-b001206ff3e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.334068 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 989/1995] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:45.336504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:45.339597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.362807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb57f8-8b95-4ed4-83e9-c91afaa63523 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.448592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb2cbae755b4432a7a9abb0b8a717a3', 'request_id': 'req-330364a1-ffdf-4334-b9d5-b001206ff3e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.460215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb2cbae755b4432a7a9abb0b8a717a3', 'request_id': 'req-330364a1-ffdf-4334-b9d5-b001206ff3e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.481503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] The token cache is being invalidate because project 1eb2cbae755b4432a7a9abb0b8a717a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:45.481965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.482950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.490241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1007/1996] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:45 2022] DELETE /identity/v3/projects/1eb2cbae755b4432a7a9abb0b8a717a3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:45.493138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.495056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:45.520342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.522007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.522404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.522863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.523771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.526181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.620396 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 990/1997] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:45 2022] POST /identity/v3/users => generated 381 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:45.624158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:45.626912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:45.633174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330364a1-ffdf-4334-b9d5-b001206ff3e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.644073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.645660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.646491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.647742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] PATH_INFO: `/v3/users/7b4f3b45d3e340d398d75c2edc58718e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.653754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddfa10-38a6-4a87-b97c-7944468b57be tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:45.657415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4f3b45d3e340d398d75c2edc58718e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.660428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.664467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:45.666536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.667737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.669247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.671874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:45.672381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:45.674267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20eab6-5984-4fa2-9272-3e71baf5b9ec tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:45.710182 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 991/1998] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:45.756178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:45.883556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4f3b45d3e340d398d75c2edc58718e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.886270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4f3b45d3e340d398d75c2edc58718e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:45.917815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:45.918100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:45.918370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:45.919781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 992/1999] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:18:45.939636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:45.939636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:46.024141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4f3b45d3e340d398d75c2edc58718e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:46.043631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4f3b45d3e340d398d75c2edc58718e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:46.044391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3994cbe7-b521-485e-b5a8-0777c7d82dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4f3b45d3e340d398d75c2edc58718e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:46.103494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1008/2000] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:45 2022] DELETE /identity/v3/users/7b4f3b45d3e340d398d75c2edc58718e => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:46.104406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:46.107044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:46.139357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b667f-c068-47c4-9769-69248a7765bc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:46.239268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:46.240668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.241193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.241193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.242598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cc1965f6bdf4fd2862f7aaf5ac8e722)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:46.245363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102574b-c276-41d9-bb05-09aaf9be97a6 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:46.259821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 993/2001] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:45 2022] GET /identity/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722 => generated 371 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:46.404187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.409073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.409073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.439451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] MFA Rules not processed for user `f39fdca40d9b4035a56b79e13b375b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:46.441903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:46.547830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.548320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.553195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.553195 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 994/2002] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:46.555559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:46.557923 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1009/2003] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:46.647312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:46.658574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055703f3-b25c-4dcc-a54f-0c49002219aa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:46.669188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:46.670005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.670290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.670571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.671802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cc1965f6bdf4fd2862f7aaf5ac8e722)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:46.674096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:46.678715 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 995/2004] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:46 2022] GET /identity/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:46.714572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:46.730924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:46.734072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:46.736680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:46.746443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d94-c13a-456e-b0cc-59ea88a14245 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:46.773115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:46.773764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.774440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.774440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/users/5932d005374942c7a05f7eaa6e407572` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.829192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5932d005374942c7a05f7eaa6e407572)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:46.831960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:46.866809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ce30-4c4b-4fdd-9a5f-67c148b78d90 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:46.871541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:46.872168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:46.872750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:46.872937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] PATH_INFO: `/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:46.874158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d0cc8bfb0748f8977ad2e0e6005d78)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:46.876121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:46.967143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5932d005374942c7a05f7eaa6e407572'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:46.967796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5932d005374942c7a05f7eaa6e407572'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.001731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d0cc8bfb0748f8977ad2e0e6005d78', 'request_id': 'req-34733bbd-abbd-45ca-a08a-28e2bde35697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.028069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:47.053410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5932d005374942c7a05f7eaa6e407572'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.086227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5932d005374942c7a05f7eaa6e407572'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.087573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47227966-7236-45d3-97c9-c450929c078f tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5932d005374942c7a05f7eaa6e407572'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.110992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d0cc8bfb0748f8977ad2e0e6005d78', 'request_id': 'req-34733bbd-abbd-45ca-a08a-28e2bde35697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.120256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d0cc8bfb0748f8977ad2e0e6005d78', 'request_id': 'req-34733bbd-abbd-45ca-a08a-28e2bde35697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.144047 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1010/2005] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:46 2022] DELETE /identity/v3/users/5932d005374942c7a05f7eaa6e407572 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:47.151272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643873-eaba-4746-b808-fb6e6f77be5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:47.151553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643873-eaba-4746-b808-fb6e6f77be5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:47.152593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643873-eaba-4746-b808-fb6e6f77be5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:47.162457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] The token cache is being invalidate because project 23d0cc8bfb0748f8977ad2e0e6005d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:47.165056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.165056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.173845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 996/2006] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:46 2022] DELETE /identity/v3/projects/23d0cc8bfb0748f8977ad2e0e6005d78 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:47.175021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:47.180807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.232437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26643873-eaba-4746-b808-fb6e6f77be5f None None] MFA Rules not processed for user `fa59e5b84e75459cbccb8549e957fd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:47.233654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26643873-eaba-4746-b808-fb6e6f77be5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.337154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34733bbd-abbd-45ca-a08a-28e2bde35697 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:47.405743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1011/2007] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:47.411299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471314cb-bc94-4af0-ad5c-4fda9f3705d2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:47.411299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471314cb-bc94-4af0-ad5c-4fda9f3705d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:47.411299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471314cb-bc94-4af0-ad5c-4fda9f3705d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:47.456001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-471314cb-bc94-4af0-ad5c-4fda9f3705d2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:47.458298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-471314cb-bc94-4af0-ad5c-4fda9f3705d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.498507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29454893ea674a59b6637fcb92d2a62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aebb5c62916f49798e8fdfbb1588b17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:47.498780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:47.498999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:47.499269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] PATH_INFO: `/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:47.502906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8cc1965f6bdf4fd2862f7aaf5ac8e722)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:47.505705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:47.567899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:47.637747 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1012/2008] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:47.640315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426602-0835-4f72-a8dc-d7d635a6ed85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:47.640573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426602-0835-4f72-a8dc-d7d635a6ed85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:47.640849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426602-0835-4f72-a8dc-d7d635a6ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:47.688112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8426602-0835-4f72-a8dc-d7d635a6ed85 None None] MFA Rules not processed for user `f7bc608b554e4c6b94ec547f4e6c1d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:47.696158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8426602-0835-4f72-a8dc-d7d635a6ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.702362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:47.724427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc1965f6bdf4fd2862f7aaf5ac8e722', 'request_id': 'req-1131cdb0-fc67-452f-9f6e-a84be5ca7744'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.818520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc1965f6bdf4fd2862f7aaf5ac8e722', 'request_id': 'req-1131cdb0-fc67-452f-9f6e-a84be5ca7744'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.827598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1013/2009] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:47.828811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:47.828995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:47.829266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:47.830451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc1965f6bdf4fd2862f7aaf5ac8e722', 'request_id': 'req-1131cdb0-fc67-452f-9f6e-a84be5ca7744'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.852444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] The token cache is being invalidate because project 8cc1965f6bdf4fd2862f7aaf5ac8e722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:47.854752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.856209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:47.858913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 997/2010] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:47 2022] DELETE /identity/v3/projects/8cc1965f6bdf4fd2862f7aaf5ac8e722 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:47.863023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:47.863023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.891486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:47.892740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:47.950298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:48.016426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131cdb0-fc67-452f-9f6e-a84be5ca7744 tempest-QuotasAdminTestV236-32417890 tempest-QuotasAdminTestV236-32417890-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.033226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.036886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.036886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.036886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] PATH_INFO: `/v3/users/e21521b8d7994354a3c30988a375e431` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.043838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21521b8d7994354a3c30988a375e431)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:48.050444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:48.071422 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1014/2011] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:48.072594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.078078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.243252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7311b-cdbf-4777-9039-7ce732a196a7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.257092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.259235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.259529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.260947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.263083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21521b8d7994354a3c30988a375e431'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.264129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21521b8d7994354a3c30988a375e431'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.266635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.308109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:48.309722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:48.330193 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1015/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:48.331259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.333618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.353567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0baf0-6bd5-4882-8133-4020e94e2514 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.361099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.362833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.363455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.363738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] PATH_INFO: `/v3/users/f262cf2fa2324b8bba9510abeb153cd1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.364957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f262cf2fa2324b8bba9510abeb153cd1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:48.368040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:48.372575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21521b8d7994354a3c30988a375e431'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.398121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21521b8d7994354a3c30988a375e431'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.398995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21521b8d7994354a3c30988a375e431'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.426222 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 998/2013] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:47 2022] DELETE /identity/v3/users/e21521b8d7994354a3c30988a375e431 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:48.427946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.430243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.483996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:48.540335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da89e21-4b7b-483c-80a8-9ceee7884381 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.546062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.547712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.547712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.548515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.549190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:48.549501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:48.552578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25f25-dc55-479c-a913-6e10422a4fe5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:48.566214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 999/2014] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:48.568180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47aea-c814-409b-bb11-90ff1d43de3e None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.568764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47aea-c814-409b-bb11-90ff1d43de3e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.568764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47aea-c814-409b-bb11-90ff1d43de3e None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.570333 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1000/2015] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:48.571573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.571986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.572335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.600884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:48.602343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.615834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1001/2016] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:48.616076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.635816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b135cea-b4f8-47d9-8061-e0455ca9fe50 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.644058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.644805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.645153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.645430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.646379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:48.648476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5f40-07bf-456d-86bb-3b871ab9a53a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:48.672415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f262cf2fa2324b8bba9510abeb153cd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.674354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f262cf2fa2324b8bba9510abeb153cd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.731353 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1002/2017] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:48 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:48.732108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.732468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.732808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.750216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f262cf2fa2324b8bba9510abeb153cd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.756469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=6,keystone:SELECT=89,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:48.767911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f262cf2fa2324b8bba9510abeb153cd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.768855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f262cf2fa2324b8bba9510abeb153cd1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:48.773681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:48.776849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.827792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1016/2018] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:48 2022] DELETE /identity/v3/users/f262cf2fa2324b8bba9510abeb153cd1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:48.829637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.831799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.882299 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1003/2019] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:48.883141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:48.884549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:48.919321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2574-984b-427f-933d-ee4a71565d3d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:48.923822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:48.924384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:48.924659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:48.924931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:48.927383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.008827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70805d38-7e66-4bf3-b324-f4a8cf7dd816 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.018194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.018696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.019051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.019930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.020912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.022476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.023332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.023735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2681b-c185-474c-a344-3f96dfbad867 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.044768 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1017/2020] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:49.046270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.046608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.047086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.088528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:49.092390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.142308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1004/2021] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:48 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:49.143472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.147950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1018/2022] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:49.148121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.150176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.187334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248a323-f7a6-49cc-8a53-37c62a1139bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.200622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.202690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.202690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.202690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.203523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.205397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.231446 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1019/2023] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:49.233084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.240520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.267311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731709-3ec0-496e-91c6-ffd32ab06a90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.282450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.283125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.283390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.283665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.299002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.300687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.315025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce72e-6d1b-4934-9fbb-0961e584c386 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.317460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1020/2024] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:49.318514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.328979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.329622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280258b4-3a41-4ed9-b393-c67558a2964d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.330198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.330815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.331523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.336166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.337035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.337386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.337731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.338472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.340410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed5ee-df8a-40c4-86bc-c25e6785385b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.344973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.347089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.365274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1005/2025] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:49.371322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1021/2026] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:49.375391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.391952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accab8-1541-4907-944b-bb8830ea289e service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.399463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.400693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.405503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.405503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23/users/194d0d1687684ad1b5a438c83d80a312/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.432755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4090441323fd43e0b063b0753c28aa23, user_id=194d0d1687684ad1b5a438c83d80a312, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.434574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.564302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.564592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.564858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.565855 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1006/2027] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:49 2022] PUT /identity/v3/projects/4090441323fd43e0b063b0753c28aa23/users/194d0d1687684ad1b5a438c83d80a312/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:49.627942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] MFA Rules not processed for user `194d0d1687684ad1b5a438c83d80a312`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:49.627942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.696147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.703464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:49.738816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1022/2028] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:49.742373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:49.897298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3703f0-cba5-434c-9fcd-da5524be782c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.904161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.904799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.905074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.905344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.905984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.908572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:49.933703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1aabf-cc5f-4069-9ef0-02595a570164 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:49.943331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:49.944260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:49.944559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:49.944852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] PATH_INFO: `/v3/projects/918954b7343f40b8a1b42b21e4783678` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:49.946116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=918954b7343f40b8a1b42b21e4783678)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:49.948411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.019821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1023/2029] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:49 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:50.042845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.101378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918954b7343f40b8a1b42b21e4783678', 'request_id': 'req-8cf533b2-62af-4d3e-945b-b14de65b5bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:50.169269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d2-646d-425d-893b-0fcf97f3826b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.187090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918954b7343f40b8a1b42b21e4783678', 'request_id': 'req-8cf533b2-62af-4d3e-945b-b14de65b5bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:50.204280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918954b7343f40b8a1b42b21e4783678', 'request_id': 'req-8cf533b2-62af-4d3e-945b-b14de65b5bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:50.225138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] The token cache is being invalidate because project 918954b7343f40b8a1b42b21e4783678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:50.225692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:50.226540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8cf533b2-62af-4d3e-945b-b14de65b5bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:50.228460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1007/2030] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:49 2022] DELETE /identity/v3/projects/918954b7343f40b8a1b42b21e4783678 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:50.234080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758e58f-51ef-4a1e-a176-dc9957548e9d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.234742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758e58f-51ef-4a1e-a176-dc9957548e9d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.235175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758e58f-51ef-4a1e-a176-dc9957548e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.270782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c758e58f-51ef-4a1e-a176-dc9957548e9d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:50.272297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c758e58f-51ef-4a1e-a176-dc9957548e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:50.275183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.276173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.276780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.277280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.278234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.281752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.283673 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1008/2031] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:50.295732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.296294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.299410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.322697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:50.323930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:50.337062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1009/2032] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:50.341473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.351853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7b214-5a07-405c-9dd6-1e5025e63433 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.356879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.357505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.357780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.358049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.358769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:50.359075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.360901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.379117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1010/2033] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:50.380225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.396083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980218-41cc-43e8-8550-5beba25c5d48 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.404917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.405724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.406095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.406503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.407280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.409325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.430986 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1024/2034] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:50 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:50.432865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.435304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:50.475408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb685e-de5b-4338-aa85-4ebd557e788c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.509815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.510446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.511016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.515653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.515653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.516891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.564723 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1025/2035] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:50.565627 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1011/2036] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:50 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:50.571634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.572608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.608619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003c95-440c-4737-ab1a-79e8e52e011e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.697847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b576-022d-4e2c-8b45-ff978f7f00b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.709621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.710247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.710525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.710841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.711479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.713427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.732986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:50.735127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:50.735403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:50.735703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] PATH_INFO: `/v3/projects/48ae1d8e581647f8b36338ef62d3bb26/users/e1da3b67fe254de8806d8f07c6ce125c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:50.755213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1d8e581647f8b36338ef62d3bb26, user_id=e1da3b67fe254de8806d8f07c6ce125c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:50.757939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:50.869083 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1012/2037] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:50 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:50.869903 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1026/2038] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:50 2022] PUT /identity/v3/projects/48ae1d8e581647f8b36338ef62d3bb26/users/e1da3b67fe254de8806d8f07c6ce125c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:50.873286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.874394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:50.902805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c1d0f-7684-4fac-a1f7-efb5c0e62901 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:50.949724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:51.031774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc37a7-3d32-4d94-aef1-825d16dd5654 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.039810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.040613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.040881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.041152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.041791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.043716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.061711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.062848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.067798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.067956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1027/2039] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:51.068995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.069584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.070483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.074505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.095135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd37b-701e-455a-aae9-bd3401ce9ed3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.100017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.101069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.101623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.103139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] PATH_INFO: `/v3/projects/48ae1d8e581647f8b36338ef62d3bb26/users/e1da3b67fe254de8806d8f07c6ce125c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.105416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1d8e581647f8b36338ef62d3bb26, user_id=e1da3b67fe254de8806d8f07c6ce125c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.108598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffe507-3337-43ce-8d97-845381f884f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.115700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1013/2040] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:51.117153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.134448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11409967-1a24-45ce-a25d-60a960a63541 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.135609 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1028/2041] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:51 2022] PUT /identity/v3/projects/48ae1d8e581647f8b36338ef62d3bb26/users/e1da3b67fe254de8806d8f07c6ce125c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:51.153485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.153761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.154037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.222822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:51.227719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] MFA Rules not processed for user `e1da3b67fe254de8806d8f07c6ce125c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:51.229139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:51.242205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.243277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.244475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.245209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.246247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.261901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.277068 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1014/2042] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:51.279265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.281450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:51.301258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6415f-eb26-4677-9d20-7f74ff2ab45f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.307743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.310114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.311146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.311865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] PATH_INFO: `/v3/projects/a585dfdf811047b598d01c005e4312e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.313809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a585dfdf811047b598d01c005e4312e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.317163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.378436 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1029/2043] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:51.380343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.407128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514cbad-7474-462f-92d6-6acb896b9cab None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.423695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.424557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.424921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.425948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] PATH_INFO: `/v3/projects/897009e4cdd341bbb94b0bf51e465596/users/60c728a868414470a203137723630d9a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.460139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897009e4cdd341bbb94b0bf51e465596, user_id=60c728a868414470a203137723630d9a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.462835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.555707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1030/2044] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:51 2022] PUT /identity/v3/projects/897009e4cdd341bbb94b0bf51e465596/users/60c728a868414470a203137723630d9a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:51.556787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.577443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a585dfdf811047b598d01c005e4312e1', 'request_id': 'req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:51.647797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db82d-0f67-41c3-aa3e-5e40805543c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.654938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a585dfdf811047b598d01c005e4312e1', 'request_id': 'req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:51.668826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a585dfdf811047b598d01c005e4312e1', 'request_id': 'req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:51.677588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.681229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.681622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.681977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.682759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:51.683630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.687725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.701486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] The token cache is being invalidate because project a585dfdf811047b598d01c005e4312e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:51.702518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:51.705358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93fd6c5e-9567-4177-a6df-c1a7e5dd5c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:51.707841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1015/2045] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:51 2022] DELETE /identity/v3/projects/a585dfdf811047b598d01c005e4312e1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:51.710049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.710716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.711075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.725280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1031/2046] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:51.727073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.731352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:51.765700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:51.767203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:51.917833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ec10c-4588-40a1-850e-9a2b0d9efda0 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:51.933298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:51.934227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:51.935429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:51.935861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] PATH_INFO: `/v3/users/29454893ea674a59b6637fcb92d2a62c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:51.939823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29454893ea674a59b6637fcb92d2a62c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:51.942583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:51.951702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1016/2047] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:51.952826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:51.958867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:51.987001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a763f-c5c9-449b-b6cf-93b6fa3f7cde None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:52.004839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:52.010138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.010491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.010906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.013552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:52.024454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:52.139041 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1017/2048] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:51 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:52.147230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:52.149027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:52.217335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c48a1e-6413-4ce3-a687-aa07cb508c0f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:52.225580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29454893ea674a59b6637fcb92d2a62c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:52.228450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:52.229078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29454893ea674a59b6637fcb92d2a62c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:52.229196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.229411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.234496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.234496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:52.340595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:52.342987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:52.361403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1018/2049] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:52.362698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:52.364333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:52.400422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29454893ea674a59b6637fcb92d2a62c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:52.423981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29454893ea674a59b6637fcb92d2a62c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:52.426398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29454893ea674a59b6637fcb92d2a62c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:52.452550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1032/2050] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:51 2022] DELETE /identity/v3/users/29454893ea674a59b6637fcb92d2a62c => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:52.479717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f909-29e7-444a-92dc-de86e9b0e649 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:52.553495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:52.554450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.560031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.560031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.560031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:52.560031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:52.560031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455e18-2bdd-4166-98f2-c8b1d9009b50 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:52.575837 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1019/2051] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:52.587050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:52.588609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:52.630608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:52.755360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8ea-2ef1-4fe0-9a91-9964f9c55879 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:52.762757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:52.763198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.763955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.763955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.772653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:52.775019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:52.796326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1033/2052] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:52.803516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00952c6-11f1-4247-aa57-3f7f248c4111 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.804023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00952c6-11f1-4247-aa57-3f7f248c4111 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.804107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00952c6-11f1-4247-aa57-3f7f248c4111 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.805831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1020/2053] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:52.820768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:52.834569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:52.845625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8508cf-abc3-45c8-a68e-914fd89f931b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:52.851159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:52.851785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.852524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.852524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/1ee56e50479946da8a5bb8eed61ca05b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.853934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ee56e50479946da8a5bb8eed61ca05b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:52.856633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:52.859155 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1034/2054] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:52 2022] GET /identity/v3/projects/1ee56e50479946da8a5bb8eed61ca05b => generated 371 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:52.932098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f60c-6d93-43ef-af74-274c0ee7c366 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:52.932450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f60c-6d93-43ef-af74-274c0ee7c366 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:52.932817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f60c-6d93-43ef-af74-274c0ee7c366 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:52.934264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1021/2055] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:52.940882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:52.970561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:53.000785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd94c37-e9b6-4f4c-af81-1d5ee8ceeb5c tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:53.036054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:53.038482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:53.038969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:53.039739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/1ee56e50479946da8a5bb8eed61ca05b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:53.044221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ee56e50479946da8a5bb8eed61ca05b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:53.046930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:53.049024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1035/2056] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:52 2022] GET /identity/v3/projects/1ee56e50479946da8a5bb8eed61ca05b => generated 371 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:53.441052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:53.502564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44be1b-2365-43c2-a4c0-43ac2fa581c8 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:53.503158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44be1b-2365-43c2-a4c0-43ac2fa581c8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:53.503632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44be1b-2365-43c2-a4c0-43ac2fa581c8 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:53.505423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1022/2057] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:53.512412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:53.534053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:53.553176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3020-4e85-4518-be43-4abe3da0ac7b tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:53.564559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:53.577540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:53.577540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:53.577540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/1ee56e50479946da8a5bb8eed61ca05b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:53.577540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ee56e50479946da8a5bb8eed61ca05b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:53.578031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:53.592447 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1036/2058] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:53 2022] GET /identity/v3/projects/1ee56e50479946da8a5bb8eed61ca05b => generated 371 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:53.621022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44be1b-2365-43c2-a4c0-43ac2fa581c8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:53.656624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44be1b-2365-43c2-a4c0-43ac2fa581c8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:53.666602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:53.667719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:53.668002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:53.668272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/1ee56e50479946da8a5bb8eed61ca05b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:53.670076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:53.671868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:53.673813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ee56e50479946da8a5bb8eed61ca05b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:53.676057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:53.776714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601ca13-a86b-407f-8042-b28640b6e72d tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:53.782251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:53.782943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:53.783213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:53.783783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] PATH_INFO: `/v3/projects/aebb5c62916f49798e8fdfbb1588b17b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:53.797288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebb5c62916f49798e8fdfbb1588b17b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:53.802965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:53.869242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee56e50479946da8a5bb8eed61ca05b', 'request_id': 'req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.952594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee56e50479946da8a5bb8eed61ca05b', 'request_id': 'req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.965751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee56e50479946da8a5bb8eed61ca05b', 'request_id': 'req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.986935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] The token cache is being invalidate because project 1ee56e50479946da8a5bb8eed61ca05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:53.988350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.988853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebb5c62916f49798e8fdfbb1588b17b', 'request_id': 'req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.989349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-beac3b24-44c7-4b5f-8c83-d8874c57d0b4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:53.999647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1023/2059] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:53 2022] DELETE /identity/v3/projects/1ee56e50479946da8a5bb8eed61ca05b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:54.021681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.021880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.022134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.024140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1024/2060] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:54.045376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:54.049225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.103488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebb5c62916f49798e8fdfbb1588b17b', 'request_id': 'req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:54.121722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebb5c62916f49798e8fdfbb1588b17b', 'request_id': 'req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:54.161890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] The token cache is being invalidate because project aebb5c62916f49798e8fdfbb1588b17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:54.162193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:54.166112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bcabe19-cb84-4682-a6d6-0ee89cb3ec0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:54.174746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1037/2061] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:53 2022] DELETE /identity/v3/projects/aebb5c62916f49798e8fdfbb1588b17b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:54.179407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e20-fbcc-4c87-9bc8-6cd2522f294f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.182727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e20-fbcc-4c87-9bc8-6cd2522f294f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.183281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21e20-fbcc-4c87-9bc8-6cd2522f294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.205692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:54.224915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52d21e20-fbcc-4c87-9bc8-6cd2522f294f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:54.226571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d21e20-fbcc-4c87-9bc8-6cd2522f294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.277535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.279131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.376090 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1038/2062] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:54.384964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.385881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.386708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.397260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453fd9-b5f0-401c-8336-e39ff884e743 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.412463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.413730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.413730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.414082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.415422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=4090441323fd43e0b063b0753c28aa23)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.418237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.424615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:54.427104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.433679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1025/2063] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:54 2022] GET /identity/v3/projects/4090441323fd43e0b063b0753c28aa23 => generated 373 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:54.447669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.450842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.459225 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1039/2064] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:54.463575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.476613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258238e0-6b80-46b2-8970-3e43366ef8e4 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.481717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8c90c-ad45-4c92-983d-e7f797b0582a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.488571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.489591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.490103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.490755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.491756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:54.492259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.494433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.496371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.497122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.497409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.497671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.498330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:54.498664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.500266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.514390 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1026/2065] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:54.520060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.521638 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1040/2066] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:54.526060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.533038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752f986-fd75-482b-a9ec-f21b7da8a57f tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.539628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2100d9a-4c81-4f01-ba7f-fc9c7f8111a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.543049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.543049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.543049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.543450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.543450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.546147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.546964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.547338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.547723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.548501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.548621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.552456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.663001 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1041/2067] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:54 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:18:54.663001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.678639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1027/2068] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:54 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:54.683597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:54.851869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99961aaf-90d4-4f3e-be8d-6e1fac9e4d83 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.857457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.858199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.858529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.858939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.859120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b3b67-daf2-4ec8-b124-2d50b5a8dec0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:54.860106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:54.860700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.863617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21e31d-a3d2-425f-bbb9-a0eef7b102dd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:54.882392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1028/2069] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:54.902001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.902346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.902543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.904028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1029/2070] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:18:54.925178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:54.932788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:54.975140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:54.976073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:54.976535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:54.979199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:54.980100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:54.985810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.028591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:55.086160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.107158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c6e3c-a969-4f71-a8e2-49a3bc99f2f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.115711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.116394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.116763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.117043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/6820c8f4a75b48c8bbcb030734c51102` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.118737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=6820c8f4a75b48c8bbcb030734c51102)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.121785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.124421 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1030/2071] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:54 2022] GET /identity/v3/projects/6820c8f4a75b48c8bbcb030734c51102 => generated 369 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:55.135728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.135821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1042/2072] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:54 2022] POST /identity/v3/users => generated 286 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:55.156187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4faf-652f-47a8-9385-c0fe415fb5f6 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.174709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.175358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.175622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.175889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.177056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.178267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.219374 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1031/2073] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:55.220711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.234377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f5a-d402-4e89-89eb-480099dacd49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.241356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.242422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.242733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.243288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.249953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.249953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca6fd-d0dc-41bc-9531-f7372cefc6de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.257097 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1043/2074] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:55.261872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.274654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0a9e2-1174-4879-9590-e67220ca4d49 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.279762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.280699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.281551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.281908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] PATH_INFO: `/v3/projects/55905ef7e068434085a83e69cd909731/users/69fa0f99ec4b4689b5bdfd961053d123/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.304893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55905ef7e068434085a83e69cd909731, user_id=69fa0f99ec4b4689b5bdfd961053d123, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.308093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed7cb6-760a-423b-bd9f-444a85fe3b1a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.406250 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1032/2075] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:55 2022] PUT /identity/v3/projects/55905ef7e068434085a83e69cd909731/users/69fa0f99ec4b4689b5bdfd961053d123/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:55.413206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.414327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.414875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.501846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.502281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.502634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.504937 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1033/2076] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:18:55.509251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] MFA Rules not processed for user `69fa0f99ec4b4689b5bdfd961053d123`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:55.510920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:55.514011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:55.645444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.679246 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1044/2077] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:55.680165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.746045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f448e8-cb47-4d43-9b7a-ad1f60c5ac56 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.752455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.753089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.756004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.756004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/6820c8f4a75b48c8bbcb030734c51102` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.756004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=6820c8f4a75b48c8bbcb030734c51102)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.757879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.760051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1034/2078] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:55 2022] GET /identity/v3/projects/6820c8f4a75b48c8bbcb030734c51102 => generated 369 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:55.777433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746cced-ec1d-4bd6-945b-7c746b163b1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.785016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.785016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.785016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.785016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.785511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.787164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.849899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.861187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4707cb1-2c63-410b-ad39-31e05f0d2346 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:55.867288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:55.868477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:55.868720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:55.871992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:55.871992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:55.871992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:55.871992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:55.893988 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1035/2079] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:55.907255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.907387 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1045/2080] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:55.908973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:55.913658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c602-103c-4406-9578-dc629a9a2236 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.003078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7309-7b15-4a24-a8b8-b926b9595e3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.008065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.008537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.008813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.009082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.009259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.009834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.009946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.010383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.010383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.011054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.012122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.013049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.070097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:56.130808 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1046/2081] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:55 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:56.131843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.149036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bf2c-c254-4de9-bbb5-f7188494dcb0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.153939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:56.158127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1036/2082] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:18:55 2022] POST /identity/v3/users => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:18:56.163884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.175410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.178348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc155cf-f852-41c3-9f10-6844b5336f36 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.179074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.179368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.180420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.180933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.182656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.195855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1047/2083] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:18:56.198401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.199456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.199864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.200151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.200390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.200817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:18:56.201157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.204267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d22bad-33f4-4a6a-9577-3e86c1a28810 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.212452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee6415-2afb-4e5b-9218-1080f30d15e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.217803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.218805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.219316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.219791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] PATH_INFO: `/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6/users/0c7eada510174bbca46acc495297ee06/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.224605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1037/2084] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:56.239976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcda767d31a47358c3d5fced2ccb0f6, user_id=0c7eada510174bbca46acc495297ee06, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.243979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.244439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.244808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.246511 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1038/2085] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:56.247546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.251092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:56.253684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:56.380126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1048/2086] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:56 2022] PUT /identity/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6/users/0c7eada510174bbca46acc495297ee06/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:18:56.383913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.395465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.427657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e123f26-683a-40d8-8be6-4f91d8c6b1bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.549647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138387a3-6ce2-43bd-a1bb-68878fd3f80f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.564704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.566922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.567876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.568776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.570097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.574385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e39f73-999e-4e00-8151-ade1425acacc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.575560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.576694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.576694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.576694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/6820c8f4a75b48c8bbcb030734c51102` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.581121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=6820c8f4a75b48c8bbcb030734c51102)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.588567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.590432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1039/2087] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:56 2022] GET /identity/v3/projects/6820c8f4a75b48c8bbcb030734c51102 => generated 369 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:18:56.598475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1049/2088] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:18:56.603059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:56.622062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b435-bc63-496a-a98c-111ea62262c7 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:56.643204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:56.644194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.644626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.645317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] PATH_INFO: `/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6/users/0c7eada510174bbca46acc495297ee06/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.650424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcda767d31a47358c3d5fced2ccb0f6, user_id=0c7eada510174bbca46acc495297ee06, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:56.654070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a297220-4bab-40ad-8e59-48e661a15f65 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:56.679381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1040/2089] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:18:56 2022] PUT /identity/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6/users/0c7eada510174bbca46acc495297ee06/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:56.692701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:56.693050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:56.693325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:56.752793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] MFA Rules not processed for user `0c7eada510174bbca46acc495297ee06`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:56.756942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:56.899516 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1050/2090] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:18:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:18:57.570325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:57.650384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb685-4a25-4084-8af0-dbee0aa62f7f None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:57.651303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb685-4a25-4084-8af0-dbee0aa62f7f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:57.651730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb685-4a25-4084-8af0-dbee0aa62f7f None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:57.653696 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1041/2091] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:57.679170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:57.840301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:57.846562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:57.931194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292711-318f-4ba4-bd27-3c9f5815322a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:57.937566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:57.949419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:57.949419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:57.949419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/6820c8f4a75b48c8bbcb030734c51102` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:57.950738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=6820c8f4a75b48c8bbcb030734c51102)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:57.954023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:57.972671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1051/2092] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:57 2022] GET /identity/v3/projects/6820c8f4a75b48c8bbcb030734c51102 => generated 369 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:57.999995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdb685-4a25-4084-8af0-dbee0aa62f7f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:58.028143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdb685-4a25-4084-8af0-dbee0aa62f7f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:58.037766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:58.038681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:58.039173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:58.039781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/users/35cbdf29990645f2abb15e13578ebafc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:58.062359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:delete_user(user_id=35cbdf29990645f2abb15e13578ebafc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:58.067776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:58.196223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cbdf29990645f2abb15e13578ebafc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.197208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cbdf29990645f2abb15e13578ebafc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.263393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cbdf29990645f2abb15e13578ebafc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.292447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cbdf29990645f2abb15e13578ebafc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.293194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3a8cb1b5-9432-42fa-9695-f1cfe4abf614 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cbdf29990645f2abb15e13578ebafc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.311083 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1042/2093] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:57 2022] DELETE /identity/v3/users/35cbdf29990645f2abb15e13578ebafc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:58.312500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:58.314290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:58.335771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875d075-345c-4939-9130-1e0e5bc087fd tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:58.434781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:58.435551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:58.435668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:58.435893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/6820c8f4a75b48c8bbcb030734c51102` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:58.437786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6820c8f4a75b48c8bbcb030734c51102)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:58.441745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:58.735102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6820c8f4a75b48c8bbcb030734c51102', 'request_id': 'req-9eb1bd1a-2079-4643-9f68-ddb8edce1474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.864670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:58.865680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6820c8f4a75b48c8bbcb030734c51102', 'request_id': 'req-9eb1bd1a-2079-4643-9f68-ddb8edce1474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.873155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6820c8f4a75b48c8bbcb030734c51102', 'request_id': 'req-9eb1bd1a-2079-4643-9f68-ddb8edce1474'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.898246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] The token cache is being invalidate because project 6820c8f4a75b48c8bbcb030734c51102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:18:58.898692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.903228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9eb1bd1a-2079-4643-9f68-ddb8edce1474 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:18:58.905765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1052/2094] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:18:58 2022] DELETE /identity/v3/projects/6820c8f4a75b48c8bbcb030734c51102 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:18:59.616544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.616544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.616544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.616544 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1043/2095] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2085983-90dc-473c-a1ae-abfe2b1d0669 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2085983-90dc-473c-a1ae-abfe2b1d0669 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2085983-90dc-473c-a1ae-abfe2b1d0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f2085983-90dc-473c-a1ae-abfe2b1d0669 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2085983-90dc-473c-a1ae-abfe2b1d0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.620853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1053/2096] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:18:59.623464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:59.623464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.623464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9da0da-f955-487d-affc-d171c573eff5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:59.624405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:59.624405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.624405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.624405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.625661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:59.625661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:59.625661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1044/2097] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:18:59.626653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.626653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.626653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.626653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1054/2098] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:59.627269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:59.627269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.627269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:59.627269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.728944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35d7f0-24a8-49cf-ad6b-29ffb9a6da16 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:59.741851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:59.742857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.744092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.744550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.746575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=4090441323fd43e0b063b0753c28aa23)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:59.761213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f88c-8029-42cf-87bf-5950d632d676 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:59.763193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1045/2099] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:59 2022] GET /identity/v3/projects/4090441323fd43e0b063b0753c28aa23 => generated 373 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:59.767733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:59.769488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.814836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.814836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.816835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.819559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1046/2100] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:18:59.823219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:18:59.828176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:18:59.830538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:18:59.853755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:18:59.872767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc95ec2-aa93-412f-bc8c-b78b01da3b0d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:59.872767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:59.873299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.873607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.873906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.875142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=4090441323fd43e0b063b0753c28aa23)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:59.878104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:18:59.886864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1047/2101] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:18:59 2022] GET /identity/v3/projects/4090441323fd43e0b063b0753c28aa23 => generated 373 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:18:59.900457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5198-d1f7-45d4-aad2-5839d6990eb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:18:59.906837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:18:59.907709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:18:59.908250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:18:59.908711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] PATH_INFO: `/v3/users/573e36291eed419693eb19b193abb2a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:18:59.911917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573e36291eed419693eb19b193abb2a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:18:59.914173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:00.193664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573e36291eed419693eb19b193abb2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.194362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573e36291eed419693eb19b193abb2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.257398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573e36291eed419693eb19b193abb2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.271206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573e36291eed419693eb19b193abb2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.272095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573e36291eed419693eb19b193abb2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.284927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1055/2102] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:18:59 2022] DELETE /identity/v3/users/573e36291eed419693eb19b193abb2a4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:00.580029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:00.582406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:00.597813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cccda-b559-4fbb-9441-6572ef9bfe03 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:00.707623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:00.707623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:00.707623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:00.707623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] PATH_INFO: `/v3/projects/3c6d8cbbb54d41acb98ed88a0ecb329c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:00.709434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6d8cbbb54d41acb98ed88a0ecb329c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:00.713769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:00.869293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6d8cbbb54d41acb98ed88a0ecb329c', 'request_id': 'req-c9450d2e-46f9-4247-ade3-63862324f813'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.936365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6d8cbbb54d41acb98ed88a0ecb329c', 'request_id': 'req-c9450d2e-46f9-4247-ade3-63862324f813'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.945231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6d8cbbb54d41acb98ed88a0ecb329c', 'request_id': 'req-c9450d2e-46f9-4247-ade3-63862324f813'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.961321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] The token cache is being invalidate because project 3c6d8cbbb54d41acb98ed88a0ecb329c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:00.962794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.963317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9450d2e-46f9-4247-ade3-63862324f813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:00.969074 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1048/2103] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:00 2022] DELETE /identity/v3/projects/3c6d8cbbb54d41acb98ed88a0ecb329c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:00.971088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:00.986055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c32532-46b3-43d1-a87a-add0a1c20017 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:01.095925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:01.097927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:01.098312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:01.098716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] PATH_INFO: `/v3/users/ab5b566f377c45039148836f1d58cd7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:01.100166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5b566f377c45039148836f1d58cd7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:01.103775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:01.349058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5b566f377c45039148836f1d58cd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:01.350125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5b566f377c45039148836f1d58cd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:01.422954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5b566f377c45039148836f1d58cd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:01.438945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5b566f377c45039148836f1d58cd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:01.442712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5b566f377c45039148836f1d58cd7f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:01.455301 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1056/2104] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:00 2022] DELETE /identity/v3/users/ab5b566f377c45039148836f1d58cd7f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:01.547223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:01.547709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:01.548129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:01.550443 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1049/2105] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:19:01.556971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:19:01.569122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:01.660227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:01.661725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:01.671374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:01.752647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03135-2559-42a1-8bb1-cd90b2b92c46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:01.752647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da3b67fe254de8806d8f07c6ce125c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1d8e581647f8b36338ef62d3bb26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:01.752647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:01.753108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:01.753108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:01.753437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorizing `identity:get_project(project_id=4090441323fd43e0b063b0753c28aa23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:01.755528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebbae-31f3-4ca9-b7ab-3e4fa0c2f670 tempest-QuotasAdminTestJSON-715013802 tempest-QuotasAdminTestJSON-715013802-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:01.757547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1057/2106] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:19:01 2022] GET /identity/v3/projects/4090441323fd43e0b063b0753c28aa23 => generated 373 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:01.935123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:01.936628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:02.053102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f8d7-1733-4cda-b66c-22caef939cbd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.057959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:02.058792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.059162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.059667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] PATH_INFO: `/v3/projects/d770dad834b14378abbbf027d3f05ae6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.061768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d770dad834b14378abbbf027d3f05ae6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:02.067320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:02.230307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd770dad834b14378abbbf027d3f05ae6', 'request_id': 'req-b191faed-6392-41b2-832a-16b8875ae7a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:02.285881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd770dad834b14378abbbf027d3f05ae6', 'request_id': 'req-b191faed-6392-41b2-832a-16b8875ae7a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:02.293729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd770dad834b14378abbbf027d3f05ae6', 'request_id': 'req-b191faed-6392-41b2-832a-16b8875ae7a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:02.346694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] The token cache is being invalidate because project d770dad834b14378abbbf027d3f05ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:02.347857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:02.348464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:02.349753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b191faed-6392-41b2-832a-16b8875ae7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:02.351561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1050/2107] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:01 2022] DELETE /identity/v3/projects/d770dad834b14378abbbf027d3f05ae6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:02.356338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.356742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.356910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.392251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:02.394299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:02.477862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1058/2108] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:02.485085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.485446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.485818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.508980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:02.510372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:02.519118 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1051/2109] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:02.523880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:02.537542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fa7b5-c8bf-4d4f-b6f5-2bcba1ef4daa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.544367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:02.547525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.547525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.547525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.547525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:02.548022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:02.550290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:02.570476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1059/2110] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:02.573318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:02.582835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11e763-1cb8-4250-9a11-7cc5fc8bb35a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.587944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:02.588964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.589489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.589951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.591004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:02.593285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:02.693014 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1052/2111] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:02 2022] POST /identity/v3/projects => generated 407 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:02.693600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:02.704716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106ce9-282f-481d-8352-ecc65eb6c91f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.799078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:02.800594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.805761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.805761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.805761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:02.807284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:02.913755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1060/2112] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:02 2022] POST /identity/v3/users => generated 304 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:02.918439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:02.931329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79667-5c14-4284-85df-dcf61142c77f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.936268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:02.936931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:02.937472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:02.937947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:02.938826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:02.940806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:02.969055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:02.985046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1053/2113] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:02.985163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808666a-293b-4936-a7df-c0235e363167 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:02.997621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.002412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.002412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.002412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.002412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.002412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0c1d-da39-450e-9ff7-33ed45b57821 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.043624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.061566 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1061/2114] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:03.065690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc23fa-578d-46df-8a16-bf84803adf13 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.075673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.076359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.076639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.076912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] PATH_INFO: `/v3/projects/edf8511b4dc94a5e9fe612395d0c0527/users/dd810d5a79564c14a0f9123a8b59d087/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.101273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf8511b4dc94a5e9fe612395d0c0527, user_id=dd810d5a79564c14a0f9123a8b59d087, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.106881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.217480 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1054/2115] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:03 2022] PUT /identity/v3/projects/edf8511b4dc94a5e9fe612395d0c0527/users/dd810d5a79564c14a0f9123a8b59d087/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:03.229101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.229719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.229868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.235616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:03.264153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] MFA Rules not processed for user `dd810d5a79564c14a0f9123a8b59d087`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:03.265576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:03.354972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1062/2116] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:03.359818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.423116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbf4c8-20fb-4c99-9407-5fef906f3b10 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.427807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.428406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.428684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.428961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.429602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.431574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.548448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1055/2117] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:03 2022] POST /identity/v3/projects => generated 407 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:03.552337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.584915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4635cb-6793-45eb-a10a-1c0b6f7ef292 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.695684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.697019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.697019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.697222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.697878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.700056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.824671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1063/2118] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:03 2022] POST /identity/v3/users => generated 310 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:03.829137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.847210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ede8d-054c-49b1-9dcd-adec2267dcc6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.877435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.878848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.879221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.879598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.880614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.882785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.892879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.895415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:03.905815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1056/2119] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:03.910707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:03.923476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211e17-d3f6-4d9f-98c2-02a148d6371f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.937990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.941643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4caa4-afd3-4105-a5eb-52f5f75b74be admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:03.942894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.942894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.942894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] PATH_INFO: `/v3/users/194d0d1687684ad1b5a438c83d80a312` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.945342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=194d0d1687684ad1b5a438c83d80a312)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:03.947440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:03.953729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:03.954423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:03.954879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:03.954995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] PATH_INFO: `/v3/projects/6616663731b343fc94371b4108a63b30/users/3bbdac33a41f40efa917cd98947382e2/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:03.991443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6616663731b343fc94371b4108a63b30, user_id=3bbdac33a41f40efa917cd98947382e2, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.008237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.126511 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1057/2120] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:03 2022] PUT /identity/v3/projects/6616663731b343fc94371b4108a63b30/users/3bbdac33a41f40efa917cd98947382e2/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:04.127468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.129846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.233147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194d0d1687684ad1b5a438c83d80a312'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:04.234110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194d0d1687684ad1b5a438c83d80a312'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:04.235794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817f583-4eb0-4882-912a-7cdb24008ec5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.244385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.245320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.245671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.245955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.246798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:04.247224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.249538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364837f-fca6-4d0f-90d4-5ba02484aa82 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.263210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1058/2121] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:04.264792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.265231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.265692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.300226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] MFA Rules not processed for user `60c728a868414470a203137723630d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:04.301461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.308323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194d0d1687684ad1b5a438c83d80a312'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:04.325746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194d0d1687684ad1b5a438c83d80a312'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:04.326640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194d0d1687684ad1b5a438c83d80a312'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:04.339799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:04.355490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1064/2122] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:03 2022] DELETE /identity/v3/users/194d0d1687684ad1b5a438c83d80a312 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:04.356417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.357875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.366653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:04.386261 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1059/2123] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:04.387545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.391289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.408287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625666-1063-4d86-b7ed-b4439bd439c1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.475155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df1c-8956-4767-a9f6-1648afb630fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.481627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.482488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.482974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.483494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.484485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.487522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.488264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.488456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19230499-2d2a-419d-9e93-f6dbbc63e262 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.488784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.489112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.489871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.494008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.508886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1065/2124] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:04.510513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.510838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.511200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.537133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:04.538439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.548252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1066/2125] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:04.550307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.551382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.591487 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1060/2126] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:04 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:04.591487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.636586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518f4c0-fb0b-4b1c-8adb-794a8eb7c63e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.681064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dca0-979a-4de7-af17-59be41167868 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.689473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.691073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.691736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.692343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] PATH_INFO: `/v3/projects/6616663731b343fc94371b4108a63b30/users/3bbdac33a41f40efa917cd98947382e2/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.695222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6616663731b343fc94371b4108a63b30, user_id=3bbdac33a41f40efa917cd98947382e2, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.699146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.719162 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1061/2127] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:04 2022] PUT /identity/v3/projects/6616663731b343fc94371b4108a63b30/users/3bbdac33a41f40efa917cd98947382e2/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:04.738006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.740079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:04.776931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.777559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.777841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.778112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.852869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983834e3-d7f3-46a4-a237-a9b9c46defd5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:04.857435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:04.858291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.859905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.860207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:04.920033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.922683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.933941 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1067/2128] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:04.936848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:04.946764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:04.949315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aa8fd-1481-4fbb-b270-39ec96aec68e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:04.962661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1062/2129] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:04.964031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:04.964321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:04.964599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.003898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] MFA Rules not processed for user `3bbdac33a41f40efa917cd98947382e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:05.005521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.023521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802f439-9d53-407e-bcad-693d18ef65d5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.129834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.132004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.132004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.132004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.132004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:05.132339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.133899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:05.149420 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1068/2130] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:05.175581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1063/2131] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:05.183300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:05.198312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa03b-ebaa-42bb-9cb5-bfba418ac842 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.204037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.205096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.205583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.206952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] PATH_INFO: `/v3/users/dd810d5a79564c14a0f9123a8b59d087` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.208180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd810d5a79564c14a0f9123a8b59d087)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.209690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:05.375161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:05.376862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.391488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd810d5a79564c14a0f9123a8b59d087'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:05.392990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd810d5a79564c14a0f9123a8b59d087'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:05.465611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21ea76-3ca1-423b-b033-68ec7e855701 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.468737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:05.478771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd810d5a79564c14a0f9123a8b59d087'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:05.478944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.479678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.480170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.480506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.483288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.495669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd810d5a79564c14a0f9123a8b59d087'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:05.496725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb4dc11c-8634-44c7-adef-07814b64d60a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd810d5a79564c14a0f9123a8b59d087'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:05.513939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.515585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f3d38-b251-439e-9a9c-bebcd2c24bbf service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:05.516523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1069/2132] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:05 2022] DELETE /identity/v3/users/dd810d5a79564c14a0f9123a8b59d087 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:05.521823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.521823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.521823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.538024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1064/2133] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:19:05.543612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:05.545186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.557531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.557862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.558229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.560693 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1065/2134] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:19:05.569219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:19:05.578226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:05.578910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.624371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1070/2135] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:05.638820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:05.640348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.725615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:05.757789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff4612-76bf-4a74-bf19-1afe1cfd5ac3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.762641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.763355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.767836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.767836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.775446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.777229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:05.802467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1071/2136] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:05.807164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:05.808756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8106f-768c-41ae-bee1-edc92ac85b22 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.810536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:05.814636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.815920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.816201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.816528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects/ac06cc5e79aa4c24a363074f10dd9744` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.817682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac06cc5e79aa4c24a363074f10dd9744)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.820095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:05.822164 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1066/2137] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:19:05 2022] GET /identity/v3/projects/ac06cc5e79aa4c24a363074f10dd9744 => generated 369 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:05.844617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5c1fc-c38d-4b4f-ad7a-ed46ee9cf19c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:05.856508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:05.856508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:05.856508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:05.856508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] PATH_INFO: `/v3/projects/4090441323fd43e0b063b0753c28aa23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:05.857493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4090441323fd43e0b063b0753c28aa23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:05.861459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:06.024010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4090441323fd43e0b063b0753c28aa23', 'request_id': 'req-e32c960b-76c3-4603-a3cd-606267f0d5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.102938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4090441323fd43e0b063b0753c28aa23', 'request_id': 'req-e32c960b-76c3-4603-a3cd-606267f0d5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.114364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4090441323fd43e0b063b0753c28aa23', 'request_id': 'req-e32c960b-76c3-4603-a3cd-606267f0d5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.127887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] The token cache is being invalidate because project 4090441323fd43e0b063b0753c28aa23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:06.128175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.128855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e32c960b-76c3-4603-a3cd-606267f0d5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.133965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1072/2138] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:05 2022] DELETE /identity/v3/projects/4090441323fd43e0b063b0753c28aa23 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:06.135912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:06.137847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:06.153310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d78-982e-457e-85f3-1d09a8fe2573 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:06.227696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:06.227696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:06.227696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:06.227696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] PATH_INFO: `/v3/users/e1da3b67fe254de8806d8f07c6ce125c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:06.228283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1da3b67fe254de8806d8f07c6ce125c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:06.229420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:06.497637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1da3b67fe254de8806d8f07c6ce125c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.497819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1da3b67fe254de8806d8f07c6ce125c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.548634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1da3b67fe254de8806d8f07c6ce125c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.565978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1da3b67fe254de8806d8f07c6ce125c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.566762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1da3b67fe254de8806d8f07c6ce125c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.598743 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1067/2139] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:06 2022] DELETE /identity/v3/users/e1da3b67fe254de8806d8f07c6ce125c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:06.605690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:06.606004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:06.606283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:06.608164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1073/2140] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:19:06.613816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:19:06.615605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:06.640832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:06.642684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:06.758831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:06.783974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4f7e-adf8-48fe-8d55-553495408a8e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:06.793241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:06.794428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:06.794913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:06.797267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] PATH_INFO: `/v3/projects/edf8511b4dc94a5e9fe612395d0c0527` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:06.801552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf8511b4dc94a5e9fe612395d0c0527)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:06.808071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:06.855924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:06.857477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:06.977716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf8511b4dc94a5e9fe612395d0c0527', 'request_id': 'req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:06.995235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1e1-7b65-4dc1-bf6f-d5b59ddd6b6a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.069608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf8511b4dc94a5e9fe612395d0c0527', 'request_id': 'req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.077320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf8511b4dc94a5e9fe612395d0c0527', 'request_id': 'req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.108163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] The token cache is being invalidate because project edf8511b4dc94a5e9fe612395d0c0527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:07.108163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.108163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.109435 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1074/2141] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:06 2022] DELETE /identity/v3/projects/edf8511b4dc94a5e9fe612395d0c0527 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:07.113994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:07.118278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:07.126227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.126975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.127255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.129469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects/ac06cc5e79aa4c24a363074f10dd9744` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.134203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac06cc5e79aa4c24a363074f10dd9744)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.140761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.146255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1068/2142] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:19:06 2022] GET /identity/v3/projects/ac06cc5e79aa4c24a363074f10dd9744 => generated 369 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:07.162894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:07.242681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:07.245012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:07.267057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f428-2964-4f20-bd39-6d926f163237 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.279900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.280517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.280819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.281473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.287544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:07.287868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.293153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.307582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde8a4-bf54-4d6b-9c7b-59a1a43a9ebc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.322721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.323389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.323665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.323934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] PATH_INFO: `/v3/users/3bbdac33a41f40efa917cd98947382e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.324495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1069/2143] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:07.325580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:07.326767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbdac33a41f40efa917cd98947382e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.328727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.354921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136328-4c44-4e0e-8f5c-5bd4e87a8e77 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.374209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.374861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.375138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.375427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.376064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.387695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.574656 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1070/2144] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:07 2022] POST /identity/v3/users => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:07.578876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:07.616656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea3aa7-0787-4301-9cfa-1f4bce449365 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.624058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbdac33a41f40efa917cd98947382e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.625112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbdac33a41f40efa917cd98947382e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.630611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.631257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.631577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.632015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.632800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:07.633099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.634847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.652493 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1071/2145] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:07.777270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbdac33a41f40efa917cd98947382e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.822222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbdac33a41f40efa917cd98947382e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.825935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d94ec328-b178-4bd2-aaf3-6337e80135c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbdac33a41f40efa917cd98947382e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:07.827569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:07.831258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:07.857804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e861c0-1e24-4e16-a27f-fe40d7b4cbaa tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:07.872943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:07.876449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:07.876449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:07.878125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:07.879195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] PATH_INFO: `/v3/projects/48ae1d8e581647f8b36338ef62d3bb26` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:07.882440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ae1d8e581647f8b36338ef62d3bb26)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:07.889127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:07.891056 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1075/2146] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:07 2022] DELETE /identity/v3/users/3bbdac33a41f40efa917cd98947382e2 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:08.058069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ae1d8e581647f8b36338ef62d3bb26', 'request_id': 'req-47e57c9a-7936-4c22-bffa-8761934639bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:08.126766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ae1d8e581647f8b36338ef62d3bb26', 'request_id': 'req-47e57c9a-7936-4c22-bffa-8761934639bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:08.137910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ae1d8e581647f8b36338ef62d3bb26', 'request_id': 'req-47e57c9a-7936-4c22-bffa-8761934639bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:08.165348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] The token cache is being invalidate because project 48ae1d8e581647f8b36338ef62d3bb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:08.165348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:08.166381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:08.167085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777f0d-db8a-4396-811a-3d084ce4baf2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.167743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777f0d-db8a-4396-811a-3d084ce4baf2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.168094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777f0d-db8a-4396-811a-3d084ce4baf2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.174862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1076/2148] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:19:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:19:08.175278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1072/2148] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:07 2022] DELETE /identity/v3/projects/48ae1d8e581647f8b36338ef62d3bb26 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:08.176577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b14c-76bf-47d6-a08c-6cdf6c04b044 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.176881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b14c-76bf-47d6-a08c-6cdf6c04b044 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.177155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b14c-76bf-47d6-a08c-6cdf6c04b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.179515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:19:08.181890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:08.213399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1789b14c-76bf-47d6-a08c-6cdf6c04b044 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:08.214649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1789b14c-76bf-47d6-a08c-6cdf6c04b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:08.286837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.288551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:08.310839 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1077/2149] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:08.319558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.319870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.320110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.373236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:08.374987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:08.382581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57c9a-7936-4c22-bffa-8761934639bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.388810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.396927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.396927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.396927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects/ac06cc5e79aa4c24a363074f10dd9744` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.396927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac06cc5e79aa4c24a363074f10dd9744)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.397340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.397340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1073/2150] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:19:08 2022] GET /identity/v3/projects/ac06cc5e79aa4c24a363074f10dd9744 => generated 369 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:08.402652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1078/2151] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:08.404269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.419919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb36a-2172-48f1-a4df-06d3aed0938b tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.424439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.425985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.426349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.426775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.428055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:08.428055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.430209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.451085 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1074/2152] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:08.451531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.471208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbed1e5-9246-4268-8d7c-d01ec68a57ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.477706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.478326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.478662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.479470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.479779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.482060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0fd66-d57a-4a83-b1ca-2a421965a1ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.598896 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1079/2153] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:08 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:08.603909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.616085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b23cc-801a-4ec8-9a77-b5bba0150294 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.666189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.666512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.667037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.668604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1080/2154] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:19:08.669846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:08.673429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:19:08.715035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.716702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.717527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.718041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.719201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.721446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.788232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.857738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a6bf-847e-4836-ad0c-35dc658603db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.860173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1075/2155] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:08 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:08.863434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.864541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.864667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.864865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.865099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects/ac06cc5e79aa4c24a363074f10dd9744` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.866235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac06cc5e79aa4c24a363074f10dd9744)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.866513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:08.868433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.870676 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1081/2156] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:19:08 2022] GET /identity/v3/projects/ac06cc5e79aa4c24a363074f10dd9744 => generated 369 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:19:08.871811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.880256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4ebcf-29bb-48bf-86cf-efb130070c1b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.886675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.887315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.887594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.887861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] PATH_INFO: `/v3/projects/6616663731b343fc94371b4108a63b30` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.889150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6616663731b343fc94371b4108a63b30)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.891433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.895571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174cbf6-d2d8-41cf-a611-cafa1f27cff6 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.904842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.904960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.905859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.907003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.909804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.911704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:08.928895 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1082/2157] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:08.929852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:08.941606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e43-5445-4f4b-a3f7-bb479b193093 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:08.946327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:08.946996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:08.947421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:08.947701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/users/d4804b2cd061495a86d0c9043831c984` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:08.962872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d4804b2cd061495a86d0c9043831c984)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:08.964864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:09.052579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6616663731b343fc94371b4108a63b30', 'request_id': 'req-b9601345-2093-4d63-b273-b006e577cfa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.103972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6616663731b343fc94371b4108a63b30', 'request_id': 'req-b9601345-2093-4d63-b273-b006e577cfa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.114370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6616663731b343fc94371b4108a63b30', 'request_id': 'req-b9601345-2093-4d63-b273-b006e577cfa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.117021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4804b2cd061495a86d0c9043831c984'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.117704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4804b2cd061495a86d0c9043831c984'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.135167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] The token cache is being invalidate because project 6616663731b343fc94371b4108a63b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:09.142396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.147539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.150724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1076/2158] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:08 2022] DELETE /identity/v3/projects/6616663731b343fc94371b4108a63b30 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:09.152293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:09.159841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.183467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4804b2cd061495a86d0c9043831c984'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.204882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4804b2cd061495a86d0c9043831c984'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.207317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98aed185-64b1-4871-9522-7027680d88b7 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4804b2cd061495a86d0c9043831c984'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.236636 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1083/2159] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:08 2022] DELETE /identity/v3/users/d4804b2cd061495a86d0c9043831c984 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:09.241575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.241575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.241575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.266183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:09.272317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.355199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:09.355443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601345-2093-4d63-b273-b006e577cfa1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:09.408190 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1084/2160] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:09.408190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:09.408190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.501606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:09.502344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.502638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.502909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.503607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:09.505245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adaa8c-9923-4a1a-8d39-589996708665 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:09.520120 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1077/2161] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:09.528561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.530048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.530309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:09.530896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.536970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b00c02-35cb-46c5-a889-37e7b77dfc93 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:09.547696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7eada510174bbca46acc495297ee06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bcda767d31a47358c3d5fced2ccb0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:09.547696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.547696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.548385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] PATH_INFO: `/v3/projects/ac06cc5e79aa4c24a363074f10dd9744` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.548385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac06cc5e79aa4c24a363074f10dd9744)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:09.551254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:09.552957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:09.554161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.569615 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1078/2162] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:09.571442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:09.583523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d19eec-a730-4986-948f-2627c7358a40 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:09.588881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:09.589745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.590018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.592875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] PATH_INFO: `/v3/projects/1c9420f5b37941d0b48556a6604fa7f8/users/3d05af2414d145289877d75c87cd74e8/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.609539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9420f5b37941d0b48556a6604fa7f8, user_id=3d05af2414d145289877d75c87cd74e8, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:09.612517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:09.693913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1079/2163] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:09 2022] PUT /identity/v3/projects/1c9420f5b37941d0b48556a6604fa7f8/users/3d05af2414d145289877d75c87cd74e8/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:09.695256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:09.724322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac06cc5e79aa4c24a363074f10dd9744', 'request_id': 'req-01915729-31bb-4a57-8abf-60f1bcb6afa9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.787106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa106e-e9ef-43e3-be21-98a5381155f9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:09.809613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac06cc5e79aa4c24a363074f10dd9744', 'request_id': 'req-01915729-31bb-4a57-8abf-60f1bcb6afa9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.816313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac06cc5e79aa4c24a363074f10dd9744', 'request_id': 'req-01915729-31bb-4a57-8abf-60f1bcb6afa9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.839716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] The token cache is being invalidate because project ac06cc5e79aa4c24a363074f10dd9744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:09.840018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.841208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01915729-31bb-4a57-8abf-60f1bcb6afa9 tempest-QuotasAdminTestV257-1887936809 tempest-QuotasAdminTestV257-1887936809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:09.845181 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1085/2164] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:09 2022] DELETE /identity/v3/projects/ac06cc5e79aa4c24a363074f10dd9744 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:09.847236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.847520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.850247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.892620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:09.894068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.895512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.896434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] MFA Rules not processed for user `3d05af2414d145289877d75c87cd74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:09.896755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.897494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:09.898924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.899216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:09.900922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:09.922792 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1080/2165] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:09.924206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:09.932578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:09.952236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39b7c-f83c-44e0-b69c-c1b8238cf7d0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:09.960912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:09.961558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:09.961835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:09.962252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] PATH_INFO: `/v3/users/69fa0f99ec4b4689b5bdfd961053d123` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:09.963456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fa0f99ec4b4689b5bdfd961053d123)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:09.966979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.003659 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1086/2166] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:10.004906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.006464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.023848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2aa3d-6b56-46e6-a13e-44c4846e46e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.030292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.030950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.031227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.031499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.032211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.034450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.204670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1087/2167] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:10.204670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.204670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.277891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f0c3d-844b-4b9a-be99-5e6fca42fb86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.284359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.290321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.296014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.296014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.296014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.296014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.296406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fa0f99ec4b4689b5bdfd961053d123'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:10.296406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fa0f99ec4b4689b5bdfd961053d123'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:10.389377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fa0f99ec4b4689b5bdfd961053d123'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:10.398764 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1088/2168] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:10.399837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.403409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.407065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fa0f99ec4b4689b5bdfd961053d123'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:10.407777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fa0f99ec4b4689b5bdfd961053d123'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:10.424795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1081/2169] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:09 2022] DELETE /identity/v3/users/69fa0f99ec4b4689b5bdfd961053d123 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:10.428376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.428376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.528886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634e235-6588-47f6-b6fd-7be42a906b2d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.536828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.537468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.537742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.538478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.538668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.543297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75ed3-740b-49c0-b76b-258f128a41b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.566505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca74d23-7a08-4785-b529-0eb28bc9d91c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.572492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.573261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.573556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.573826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.574649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.580630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.636724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1082/2170] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/users => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:10.636724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.636724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.636724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.655762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:10.657203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.663653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1089/2171] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:10.666559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.669653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1083/2172] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:10.670505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.678767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7146ee-109c-4959-8b3f-213e797f41fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.680516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6537da2-719b-4df1-beb4-1b890065fd66 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.684079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.684802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.685090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.686338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.686447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.686447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.686601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.686801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.686801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.687381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.688429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.688965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.700922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1084/2173] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:10.701425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1090/2174] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:10.702111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.704773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.710687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:10.711374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:10.723708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f1db-ad79-4086-a76d-8bed1c09dde7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.728608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.729219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.729548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.729766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.730407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.732101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.754290 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1091/2175] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:19:10.755486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.767136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fa1e7-53b8-486e-a919-35324ec8e6b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.773498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.774146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.774421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.774734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] PATH_INFO: `/v3/projects/69e271556d954583bb2ff61953a76a55/users/511b4b792da04994a147e34c1898f4f3/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.792581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e271556d954583bb2ff61953a76a55, user_id=511b4b792da04994a147e34c1898f4f3, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.795865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.797272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0d6c-d593-4c41-bbbb-8adf30279386 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.799564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:10.801233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.801865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.802144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.802413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.812864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.814788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.825659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1085/2176] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:10.826531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.836806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bcf46-7d4a-4f55-b825-c75295a5ef3b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.842449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.843276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.843419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.843813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] PATH_INFO: `/v3/projects/3d4d8e8c1f2941b29d19efbeacc7b54b/users/da4c9e238a06434bb7fbca37a487a337/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.862496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4d8e8c1f2941b29d19efbeacc7b54b, user_id=da4c9e238a06434bb7fbca37a487a337, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.865716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a13e6-8d99-41d2-80dd-3c9383a45c27 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.868416 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1092/2177] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:10 2022] PUT /identity/v3/projects/69e271556d954583bb2ff61953a76a55/users/511b4b792da04994a147e34c1898f4f3/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:10.875793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.945569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0510df9-87aa-43dc-85e6-28d9cffa693c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.950307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:10.950980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.951245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.951517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:10.952154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:10.953763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:10.966687 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1093/2178] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:19:10.969324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:10.973622 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1086/2179] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:10 2022] PUT /identity/v3/projects/3d4d8e8c1f2941b29d19efbeacc7b54b/users/da4c9e238a06434bb7fbca37a487a337/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:10.980209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d45d6-7f0e-47f0-baa5-99c4bbdd7587 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:10.983752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:10.984045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:10.984331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.027494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] MFA Rules not processed for user `da4c9e238a06434bb7fbca37a487a337`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:11.029216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.063802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.064567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.065067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.065184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] PATH_INFO: `/v3/projects/69e271556d954583bb2ff61953a76a55/users/511b4b792da04994a147e34c1898f4f3/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.067335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e271556d954583bb2ff61953a76a55, user_id=511b4b792da04994a147e34c1898f4f3, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.070115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77556149-e345-4044-b27c-90f6d05b8144 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.089084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1094/2180] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:10 2022] PUT /identity/v3/projects/69e271556d954583bb2ff61953a76a55/users/511b4b792da04994a147e34c1898f4f3/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:11.101324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ce23-8d5a-4c84-b142-626cf19b98fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.101742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ce23-8d5a-4c84-b142-626cf19b98fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.102065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0ce23-8d5a-4c84-b142-626cf19b98fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.139380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bef0ce23-8d5a-4c84-b142-626cf19b98fe None None] MFA Rules not processed for user `511b4b792da04994a147e34c1898f4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:11.140724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bef0ce23-8d5a-4c84-b142-626cf19b98fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.141685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1087/2181] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:11.147126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.159253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779ac4-86cc-45cf-b4bf-5215e75e5469 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.230868 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1095/2182] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:11.234931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.235255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.235664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.237280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.237614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.237914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.238312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.239090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.241546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.256115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] MFA Rules not processed for user `3d05af2414d145289877d75c87cd74e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:11.257318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.321901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1096/2183] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:11.336262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:11.338479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1088/2184] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:11.342534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.353676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1311926-9e73-46f7-bd26-bbab76d93416 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.413705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.414353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.414639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.417989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.417989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.417989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.514140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1097/2185] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:11.518207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.529112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb75f27-c3ec-4e62-acbe-2f52921c6910 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.534084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.534714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.534988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.535259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.535919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.537578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.552332 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1089/2186] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:19:11.552496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.553585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.555260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.568687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e3d8-efa5-41a8-8711-6cc6f6986140 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.578435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.578435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.578435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.579091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] PATH_INFO: `/v3/projects/a6673a3ad1934083a7dafdffcf953197/users/dca612cc2d5546649f1e10c3ea926cce/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.594200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6673a3ad1934083a7dafdffcf953197, user_id=dca612cc2d5546649f1e10c3ea926cce, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.596932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.638826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107649-e427-4eba-a88b-daad4c431f7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.645756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.646358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.646705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.646940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.648765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.655658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1090/2187] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:11 2022] PUT /identity/v3/projects/a6673a3ad1934083a7dafdffcf953197/users/dca612cc2d5546649f1e10c3ea926cce/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:11.657186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.660580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.722495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.724455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.734575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1098/2188] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:11.735791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.746772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba539f0b-3b2e-4b83-947f-8682ad24e48a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.753134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.753754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.756585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.756585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.756585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.757027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:11.758794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b207c-5fc4-4c74-8432-98c67466a122 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.759765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.764922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.765491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.765766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.766033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] PATH_INFO: `/v3/projects/55905ef7e068434085a83e69cd909731` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.767189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55905ef7e068434085a83e69cd909731)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.769122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.771859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1099/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:11.775984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:11.786364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03163ad-3279-4f8b-b98a-cc5c7f632426 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:11.792614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:11.793366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.793771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.794138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] PATH_INFO: `/v3/projects/a6673a3ad1934083a7dafdffcf953197/users/dca612cc2d5546649f1e10c3ea926cce/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.797228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6673a3ad1934083a7dafdffcf953197, user_id=dca612cc2d5546649f1e10c3ea926cce, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:11.800296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52ba4e-3985-4232-a1ec-7ca42d30c9dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:11.811525 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1100/2190] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:11 2022] PUT /identity/v3/projects/a6673a3ad1934083a7dafdffcf953197/users/dca612cc2d5546649f1e10c3ea926cce/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:11.828545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e0a4-8f3b-4817-a516-8fdaa8769ba3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.829022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e0a4-8f3b-4817-a516-8fdaa8769ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.829309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e0a4-8f3b-4817-a516-8fdaa8769ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.859759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8712e0a4-8f3b-4817-a516-8fdaa8769ba3 None None] MFA Rules not processed for user `dca612cc2d5546649f1e10c3ea926cce`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:11.861952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8712e0a4-8f3b-4817-a516-8fdaa8769ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:11.892857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55905ef7e068434085a83e69cd909731', 'request_id': 'req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:11.944785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1101/2191] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:11.956750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc630-4522-4815-a731-49def9282a9b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:11.957039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc630-4522-4815-a731-49def9282a9b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:11.957296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc630-4522-4815-a731-49def9282a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:11.976804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f07bc630-4522-4815-a731-49def9282a9b None None] MFA Rules not processed for user `da4c9e238a06434bb7fbca37a487a337`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:11.978012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f07bc630-4522-4815-a731-49def9282a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:12.014809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55905ef7e068434085a83e69cd909731', 'request_id': 'req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.026582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55905ef7e068434085a83e69cd909731', 'request_id': 'req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.043315 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1102/2192] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:12.068876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] The token cache is being invalidate because project 55905ef7e068434085a83e69cd909731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:12.069247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.069997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.074668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1091/2193] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:11 2022] DELETE /identity/v3/projects/55905ef7e068434085a83e69cd909731 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:12.076921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc630-4522-4815-a731-49def9282a9b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:12.085503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:12.151578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc630-4522-4815-a731-49def9282a9b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:12.157538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:12.158534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:12.159425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:12.159425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] PATH_INFO: `/v3/users/0c7eada510174bbca46acc495297ee06` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:12.160670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7eada510174bbca46acc495297ee06)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:12.162825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:12.176966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:12.378443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7eada510174bbca46acc495297ee06'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.379217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7eada510174bbca46acc495297ee06'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.392373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:12.393821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:12.479795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93aa4-7a6f-456f-8d12-5a02e5044ef3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:12.485960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7eada510174bbca46acc495297ee06'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.501499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:12.504576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:12.505020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:12.506087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:12.509186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7eada510174bbca46acc495297ee06'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.510077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:12.512022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7eada510174bbca46acc495297ee06'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:12.526962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:12.529671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f4c2f-82e0-4cc7-a317-403a331a7f71 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:12.531616 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1103/2194] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:12 2022] DELETE /identity/v3/users/0c7eada510174bbca46acc495297ee06 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:12.549945 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1092/2195] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:19:13.225804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:13.236503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:13.303461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e033-4cae-49f1-9200-35ef9558d76f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:13.312247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:13.313126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:13.313393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:13.313797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] PATH_INFO: `/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:13.315339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcda767d31a47358c3d5fced2ccb0f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:13.317412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:13.484874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcda767d31a47358c3d5fced2ccb0f6', 'request_id': 'req-bf351276-a285-4618-b940-69c866ff6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:13.593917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcda767d31a47358c3d5fced2ccb0f6', 'request_id': 'req-bf351276-a285-4618-b940-69c866ff6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:13.603080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcda767d31a47358c3d5fced2ccb0f6', 'request_id': 'req-bf351276-a285-4618-b940-69c866ff6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:13.628844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] The token cache is being invalidate because project 0bcda767d31a47358c3d5fced2ccb0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:13.629237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:13.630916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf351276-a285-4618-b940-69c866ff6897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:13.636556 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1104/2196] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:13 2022] DELETE /identity/v3/projects/0bcda767d31a47358c3d5fced2ccb0f6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:13.640998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:13.641452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:13.642198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:13.662450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:13.663682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:13.764553 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1093/2197] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:13.773159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:13.773474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:13.773752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:13.801021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:13.802299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:13.821221 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1105/2198] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:13.825950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:13.836306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97d53d-1dd4-4b1b-bae8-df501330d875 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:13.843209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:13.843933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:13.844332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:13.844704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:13.845428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:13.846532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:13.848592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:13.876801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:13.882119 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1094/2199] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:13.911858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5eeac-fd8d-4437-9f2a-4b22c64c8544 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:13.917730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:13.918421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:13.918743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:13.919012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:13.919673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:13.922149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.063213 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1106/2200] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:13 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:14.065944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.082901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1ed1c-f565-46cc-89c6-3d06891c16b7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.120588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:14.214192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.214845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.215122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.215420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.216028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.218821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.223560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:14.364320 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1095/2201] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:14 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:14.373490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.397479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169a4e-5df2-4321-98bf-5159a42d3491 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.406740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.407320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.407622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.407893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.409086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.410846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.423658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1107/2202] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:14.428770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.439443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81309b-4f9e-471a-ac5f-b2abc765fabc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.444078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.444916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.444916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.445198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.445862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.447555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.462310 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1096/2203] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:14.466272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.477399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1540b9-d9f3-4df7-9f68-4c2969b3adf7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.483405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.484421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.484862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.492296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] PATH_INFO: `/v3/projects/389204737241492380d24e9f45caff43/users/9cc148a1570448d29d5c6d720b4d7baa/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.504519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389204737241492380d24e9f45caff43, user_id=9cc148a1570448d29d5c6d720b4d7baa, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.508476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c0f8f-5d93-427a-a923-f05e27dbf505 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.600805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.602751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:14.611673 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1108/2204] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:14 2022] PUT /identity/v3/projects/389204737241492380d24e9f45caff43/users/9cc148a1570448d29d5c6d720b4d7baa/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:14.629667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.630231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.630505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.674449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] MFA Rules not processed for user `9cc148a1570448d29d5c6d720b4d7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:14.678425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:14.744860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9caec-56be-432c-aeae-403cd1b6ea99 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.793007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1109/2205] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:14.797806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:14.844812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.846252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.846603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.846986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.849146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:14.914398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9e6f3-c470-43c3-9884-499c745a8d60 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:14.919757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:14.920369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:14.920646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:14.920914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:14.921596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.924891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.932887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:14.953161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:14.955661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:14.988173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1097/2206] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:15.021372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1110/2207] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:15.027990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:15.044455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f7773-8467-4f1d-9f36-0a7dfd1ab708 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:15.110688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:15.111329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.111602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.112005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.112651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:15.114661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:15.236682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1098/2208] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:15 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:15.240860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:15.258657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c174f77-da1e-493f-a384-734f89ed4f99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:15.272459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:15.273078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.273351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.273616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.274255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:15.275883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:15.293090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:15.294076 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1111/2209] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:15.308729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718123-d71b-4f4c-baa2-ef06fb3a1f6e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:15.314881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:15.315726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.316082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.316431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] PATH_INFO: `/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2/users/024f363df3ba483c8bb19eb7549e9976/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.333349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe3e163c6f049f29e0a23d7a546d7e2, user_id=024f363df3ba483c8bb19eb7549e9976, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:15.336304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:15.423283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1099/2210] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:15 2022] PUT /identity/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2/users/024f363df3ba483c8bb19eb7549e9976/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:15.427580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:15.438541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741d10-cbdb-45a7-b0f2-7b0928e7bad8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:15.543580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:15.544232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.545100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.545472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.546162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:15.547998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f3eaf-97a8-4038-933e-b7d1fabaa000 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:15.559626 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1112/2211] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:15.571778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:15.587781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfda0a-b909-48b1-9f99-e76a26a1860d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:15.595257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:15.596791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.597322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.597938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] PATH_INFO: `/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2/users/024f363df3ba483c8bb19eb7549e9976/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.601180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe3e163c6f049f29e0a23d7a546d7e2, user_id=024f363df3ba483c8bb19eb7549e9976, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:15.604856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6377d-1f3a-4faa-b5ea-696adc29ce03 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:15.626331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1100/2212] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:15 2022] PUT /identity/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2/users/024f363df3ba483c8bb19eb7549e9976/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:15.627990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.628298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.628758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.666222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] MFA Rules not processed for user `024f363df3ba483c8bb19eb7549e9976`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:15.667787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:15.828165 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1113/2213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:15.841709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e755d3-0aae-443b-83c9-28efbd502947 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:15.841709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e755d3-0aae-443b-83c9-28efbd502947 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:15.841709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e755d3-0aae-443b-83c9-28efbd502947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:15.864752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-01e755d3-0aae-443b-83c9-28efbd502947 None None] MFA Rules not processed for user `9cc148a1570448d29d5c6d720b4d7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:15.866041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01e755d3-0aae-443b-83c9-28efbd502947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:15.880584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:15.935940 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1101/2214] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:15.978880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:16.054349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:16.059483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eac43-b2b7-4978-b0d3-35be84258a3d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:16.065378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:16.065981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:16.066258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:16.066528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:16.074897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:16.076495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed909993-39e4-4d2b-910d-627f7119a933 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:16.087641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1114/2215] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:16.687926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc55-c82a-44ec-b188-c4a2b006aec3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:16.688385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc55-c82a-44ec-b188-c4a2b006aec3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:16.688802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc55-c82a-44ec-b188-c4a2b006aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:16.734821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b452dc55-c82a-44ec-b188-c4a2b006aec3 None None] MFA Rules not processed for user `9cc148a1570448d29d5c6d720b4d7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:16.738555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b452dc55-c82a-44ec-b188-c4a2b006aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:16.759778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1102/2216] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:17.035097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:17.400027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:19.151270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:19.278665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:19.394535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:19.397190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:19.397190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:19.397398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1115/2217] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:19:19.407568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b29c-84ba-4ffc-9779-6de5e285b2a5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:19.407685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b29c-84ba-4ffc-9779-6de5e285b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:19.408525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b29c-84ba-4ffc-9779-6de5e285b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:19.430158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2052b29c-84ba-4ffc-9779-6de5e285b2a5 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:19.431409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2052b29c-84ba-4ffc-9779-6de5e285b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:19.443141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1103/2218] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:19.454107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:19.456566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:19.549080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623746d6-4a98-49d2-887b-d112609fbce6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:19.553579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:19.555821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:19.555979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:19.556261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:19.573292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:19.574778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:19.593688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1116/2219] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:19.617458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:19.617458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:19.617458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:19.652582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:19.653862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:19.661019 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1104/2220] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:19.697034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:19.709699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900adc06-dbad-44b5-949a-b15d9d138156 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:19.724505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:19.725230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:19.729317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:19.729317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:19.736883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:19.738436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:19.748334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1117/2221] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:20.653573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:20.655147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:20.734565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a40191-f313-4ef0-bcbd-bd2fb9412d49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:20.739189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:20.739820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:20.740100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:20.740439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] PATH_INFO: `/v3/users/60c728a868414470a203137723630d9a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:20.741671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c728a868414470a203137723630d9a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:20.743682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:21.011329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c728a868414470a203137723630d9a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.012953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c728a868414470a203137723630d9a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.113856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c728a868414470a203137723630d9a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.133493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c728a868414470a203137723630d9a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.136849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c728a868414470a203137723630d9a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.171065 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1105/2222] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:20 2022] DELETE /identity/v3/users/60c728a868414470a203137723630d9a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:21.306860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:21.395173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:21.531424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:21.549287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c813f-683d-4d08-a494-b373e87d3226 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:21.641565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:21.643339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:21.643863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:21.644292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] PATH_INFO: `/v3/projects/897009e4cdd341bbb94b0bf51e465596` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:21.645743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=897009e4cdd341bbb94b0bf51e465596)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:21.647864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:21.796792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897009e4cdd341bbb94b0bf51e465596', 'request_id': 'req-23fd03a0-32f4-4438-b733-b629b43ef86e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.829494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:21.830969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:21.884742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897009e4cdd341bbb94b0bf51e465596', 'request_id': 'req-23fd03a0-32f4-4438-b733-b629b43ef86e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.897478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897009e4cdd341bbb94b0bf51e465596', 'request_id': 'req-23fd03a0-32f4-4438-b733-b629b43ef86e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.915830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] The token cache is being invalidate because project 897009e4cdd341bbb94b0bf51e465596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:21.918534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.918696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-23fd03a0-32f4-4438-b733-b629b43ef86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:21.925431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1118/2223] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:21 2022] DELETE /identity/v3/projects/897009e4cdd341bbb94b0bf51e465596 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:21.927054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f02fc-2f23-4ef4-8578-d677862fed48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:21.927348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f02fc-2f23-4ef4-8578-d677862fed48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:21.927619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f02fc-2f23-4ef4-8578-d677862fed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:21.952270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe1f02fc-2f23-4ef4-8578-d677862fed48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:21.953034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe1f02fc-2f23-4ef4-8578-d677862fed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:21.997642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ffdeb-0adc-42bf-a86b-8b3c6adf1559 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.040746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1119/2224] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:22.049808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.050074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.050483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.075393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:22.076670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:22.080512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.081213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.081491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.081815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.083590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:22.093174 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1120/2225] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:22.094745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.119245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45853f67-5177-4464-8a46-56a00d1e55ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.127391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.133061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.150138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1121/2226] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:19:22.154652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.169057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f1ad-2a6c-47de-aa19-22645661f18e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.175442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.176549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.177119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.178005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.178005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.178005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.178823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.180944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.193106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1106/2227] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:22.305688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1122/2228] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:22 2022] POST /identity/v3/projects => generated 395 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:22.307287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.321963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c3d-246a-4d90-9b8e-56650b8cca4d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.401761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.403337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.403934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.404358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.406597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.410362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.529691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1107/2229] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:22 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:19:22.531291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.543008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd7a2-6753-485e-a77d-3e4d05a67492 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.549120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.549806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.550159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.550644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.551347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.553153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.563620 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1123/2230] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:22.571527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.591023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c510d-0672-4a39-bc78-37f381e5020b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.596707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.597353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.597678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.597963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.600174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.600349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc924a-20c3-4223-9776-93423142b3fc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.619028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1108/2231] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:22.620203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:22.633431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f994c-4dbd-4480-9210-9764155af4a8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:22.639752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:22.640572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.640915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.641263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] PATH_INFO: `/v3/projects/dbceaccb5cd8450db3ea32e7795e20dd/users/e01812deb052414ab560e31f98b82a26/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.686277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbceaccb5cd8450db3ea32e7795e20dd, user_id=e01812deb052414ab560e31f98b82a26, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:22.691224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f986bca-80e8-4bc9-9a55-401b2f615199 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:22.722519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.722827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.723580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.757308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] MFA Rules not processed for user `11020c20eb5d4a499766c3842b75802a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:22.759445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:22.800265 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1124/2232] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:22 2022] PUT /identity/v3/projects/dbceaccb5cd8450db3ea32e7795e20dd/users/e01812deb052414ab560e31f98b82a26/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:22.810720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:22.810900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:22.811197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:22.856637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] MFA Rules not processed for user `e01812deb052414ab560e31f98b82a26`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:22.859376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:22.898479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:22.925638 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1109/2233] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:22.993397 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1125/2234] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:23.227171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:23.228913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:23.319566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb287f-2f10-41b7-ba4c-e81082310ae7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:23.405948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:23.409440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:23.410214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:23.410499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:23.428259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:23.430219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad12ed-c69a-4647-b6ab-77f8c79da56c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:23.459623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1110/2235] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:23 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:19:23.587980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:24.508943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:24.590353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38e74-3e47-49a7-8cd7-291ab3f8e3ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:24.599541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:24.600230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:24.600520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:24.600836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] PATH_INFO: `/v3/users/e01812deb052414ab560e31f98b82a26` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:24.602150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01812deb052414ab560e31f98b82a26)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:24.604282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:24.727534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:24.842533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01812deb052414ab560e31f98b82a26'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:24.843370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01812deb052414ab560e31f98b82a26'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:24.918873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01812deb052414ab560e31f98b82a26'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:24.932520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01812deb052414ab560e31f98b82a26'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:24.933317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01812deb052414ab560e31f98b82a26'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:24.947696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1126/2236] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:19:24 2022] DELETE /identity/v3/users/e01812deb052414ab560e31f98b82a26 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:24.952510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:24.953016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:24.953149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:24.974224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:24.975687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:25.062608 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1111/2237] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:25.072571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:25.074017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:25.134249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e6b3-49dc-4993-ac14-ac7eb2449731 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:25.137983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:25.138692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:25.138973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:25.139271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:25.157072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:25.157072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa70a-7f81-4e6d-9057-11b9ea37e441 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:25.166135 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1127/2238] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:25.565520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:26.113319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:26.156448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.158566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:26.175925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a04d9e-e170-41a5-91df-d87350544175 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.181680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.182324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.182606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.183182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] PATH_INFO: `/v3/projects/dbceaccb5cd8450db3ea32e7795e20dd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.184357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbceaccb5cd8450db3ea32e7795e20dd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:26.186972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:26.291021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbceaccb5cd8450db3ea32e7795e20dd', 'request_id': 'req-6dd8c886-0f3f-425a-ae1f-7174387515fc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:26.380114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbceaccb5cd8450db3ea32e7795e20dd', 'request_id': 'req-6dd8c886-0f3f-425a-ae1f-7174387515fc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:26.386727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbceaccb5cd8450db3ea32e7795e20dd', 'request_id': 'req-6dd8c886-0f3f-425a-ae1f-7174387515fc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:26.410478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] The token cache is being invalidate because project dbceaccb5cd8450db3ea32e7795e20dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:19:26.410807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:26.411556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6dd8c886-0f3f-425a-ae1f-7174387515fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:19:26.413653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1112/2239] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:19:26 2022] DELETE /identity/v3/projects/dbceaccb5cd8450db3ea32e7795e20dd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:19:26.418906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.421344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.421344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.441028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:26.442231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:26.507631 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1128/2240] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:26.515688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.516186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.516478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.543001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:26.544697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:26.553997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1113/2241] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:26.558637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.568590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a15ce6-6a5b-433c-8942-72b956c0d08e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.574340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.574971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.579657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.579657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.579657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:19:26.579657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:26.579657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:26.592858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1129/2242] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:19:26.598202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.608010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af097182-a83d-4c39-b5c4-52dfc29554c2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.612918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.613704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.614002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.614262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.614943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:26.616860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:26.725348 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1114/2243] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:19:26 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:26.729896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.741943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd80e21-b4b8-4e7b-9a24-6a81c585d23a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.804261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.805225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.806654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.806654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.806654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:26.808301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:26.931196 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1130/2244] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:19:26 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:19:26.935643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.945155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:26.949135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5099ed5-c345-4835-9c1f-385662e7baff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.956030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.956639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.956919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.957298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.957952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:26.959613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:26.971249 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1115/2245] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:26.975258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:26.988329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984be2e-2951-4f0f-93f3-82719bf1cf3a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:26.993254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:26.993886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:26.994422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:26.994927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:26.996267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:27.000369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb6880-978c-445d-8e95-e6adfe86a5f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:27.018590 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1131/2246] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:19:27.019793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:27.030039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334a506-3825-4368-b79f-4cb470775d9d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:27.043777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:27.044394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:27.044670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:27.044942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] PATH_INFO: `/v3/projects/454de031725941dcbf7700d7763b91b1/users/19fed41ad3ec4ceb8ae160a8840a9d6d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:27.071143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454de031725941dcbf7700d7763b91b1, user_id=19fed41ad3ec4ceb8ae160a8840a9d6d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:27.074137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:27.236146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1116/2247] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:19:27 2022] PUT /identity/v3/projects/454de031725941dcbf7700d7763b91b1/users/19fed41ad3ec4ceb8ae160a8840a9d6d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:19:27.242873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d44fd-fc7d-44c9-aea0-fde8dc238e16 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:27.243274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d44fd-fc7d-44c9-aea0-fde8dc238e16 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:27.243370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d44fd-fc7d-44c9-aea0-fde8dc238e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:27.264608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf2d44fd-fc7d-44c9-aea0-fde8dc238e16 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:27.266204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf2d44fd-fc7d-44c9-aea0-fde8dc238e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:27.340280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1132/2248] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:27.365181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:27.367266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:27.455811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942da93-8215-4395-98d8-3ad08c89b741 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:27.478982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:27.479870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:27.485931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:27.485931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:27.501470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:27.503213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a37ee-825b-4eb2-bdc3-892eea2ea9d8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:27.515280 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1117/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:27.542372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:27.789303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:29.095299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:29.205461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:30.005640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:31.224327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:32.098742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:32.147659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:33.272050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:33.444720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:33.913107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:34.729515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:35.598194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:35.970499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:36.227517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:36.227802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:36.228077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:36.286262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] MFA Rules not processed for user `19fed41ad3ec4ceb8ae160a8840a9d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:36.287543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:36.418902 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1133/2250] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:36.429720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14a24-b6aa-4c03-b392-164959d7ed57 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:36.431817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14a24-b6aa-4c03-b392-164959d7ed57 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:36.431817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14a24-b6aa-4c03-b392-164959d7ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:36.464071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bcc14a24-b6aa-4c03-b392-164959d7ed57 None None] MFA Rules not processed for user `19fed41ad3ec4ceb8ae160a8840a9d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:36.465348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bcc14a24-b6aa-4c03-b392-164959d7ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:36.475001 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1118/2251] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:36.636657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:36.642418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:36.760978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab2d2-d9fe-4124-8493-43c4ad5fbe0c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:36.771953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:36.772586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:36.772863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:36.773132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:36.783331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:36.785359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c55ef-8c28-46f3-ace9-48e0f9b60f32 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:36.808007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1134/2252] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:37.283539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:37.492941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:37.924793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:38.524063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:38.524995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:38.525434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:38.556881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] MFA Rules not processed for user `9cc148a1570448d29d5c6d720b4d7baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:38.558437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:38.631223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1119/2253] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:39.337525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec579e2-6d61-4b81-9e8f-c0a85b1d92a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:39.338371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec579e2-6d61-4b81-9e8f-c0a85b1d92a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:39.339038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec579e2-6d61-4b81-9e8f-c0a85b1d92a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:39.353356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:39.373013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ec579e2-6d61-4b81-9e8f-c0a85b1d92a0 None None] MFA Rules not processed for user `f39fdca40d9b4035a56b79e13b375b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:39.374701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ec579e2-6d61-4b81-9e8f-c0a85b1d92a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:39.477352 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1135/2254] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:39.719400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:41.572682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:41.575928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:41.709043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff43a-560f-4f55-87bf-3f403b521d62 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:41.716361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:41.717347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:41.717619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:41.717884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:41.720478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:41.740378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:41.742481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546e31e-6626-4c13-8ddd-e20ac7f6940a service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:41.761120 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1120/2255] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:42.244498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:42.456443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:42.456729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:42.457000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:42.458470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1136/2256] 10.222.0.13 () {54 vars in 921 bytes} [Mon Oct 31 14:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:19:42.464351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a1d0-d0d8-4c33-b8d1-06944fcccf46 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:42.464642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a1d0-d0d8-4c33-b8d1-06944fcccf46 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:42.464916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3a1d0-d0d8-4c33-b8d1-06944fcccf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:42.522052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4fd3a1d0-d0d8-4c33-b8d1-06944fcccf46 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:42.523960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4fd3a1d0-d0d8-4c33-b8d1-06944fcccf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:42.547357 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1121/2257] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 14:19:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:19:42.558842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:42.561345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:42.573644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:42.574461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:42.574805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:42.589447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a600-e741-4345-8900-9c6d7c1f641e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:42.606208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:42.607930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:42.608913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:42.610033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:42.610504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:42.616297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:42.642099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:42.645177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:42.699776 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1137/2258] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:19:42.780379 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1122/2259] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:19:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:42.881372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:42.883855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:43.029826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:43.154574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b68ed-9cb6-4ae6-8586-dd205e209676 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:43.183415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:43.184059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:43.184398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:43.184595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:43.206956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:43.208596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2696a-b48a-40a9-a8fb-7fbc64834cf8 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:43.226927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1138/2260] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:19:44.778367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:45.034563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:45.154872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:45.217692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c2f7-89f3-45ea-96e2-c701f0bf9234 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:45.252772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:45.253751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:45.254191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:45.254639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:45.274470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:45.305316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:45.307252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:45.329023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1123/2261] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:19:47.563852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:47.701944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:48.853918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:49.073770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:49.882119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:50.026805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:50.472658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.087634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.376036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.495921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.671554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.822537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:51.959057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:52.152907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:52.357612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:52.585542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:54.238050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:54.329586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:54.832342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:54.833049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:54.833652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:54.868328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] MFA Rules not processed for user `f7bc608b554e4c6b94ec547f4e6c1d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:19:54.869976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:54.948123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1139/2262] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:19:55.432067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:56.007816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:56.974859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:19:59.816821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:19:59.818562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:59.844979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2ddc-54c0-4c55-be35-fc8a45a33c1c service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:19:59.865642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:19:59.866259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:19:59.866533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:19:59.866877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:19:59.868630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:19:59.971336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:19:59.973326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3f2a8-4c0f-4b5d-ac46-4ab41ab722d9 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:19:59.984616 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1124/2263] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:19:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:03.664540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:03.679405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9bb2-776c-4cc0-ae74-e841ee61b792 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:03.687334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:03.691504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:03.691504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:03.691504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:03.691504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:03.734695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:03.785602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:03.787500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:03.798511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1140/2264] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:08.303485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:08.303988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:08.304105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:08.323980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:08.325176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:08.332625 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1125/2265] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:08.345322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:08.357681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6e14-115d-415d-8b56-b869cbbb22aa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:08.363409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:08.364111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:08.364457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:08.364938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:08.373340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:08.375029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:08.383192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1141/2266] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:11.807503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:11.827543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87015d-7502-4037-9f76-71983ab911b8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:11.843548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:11.844549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:11.844983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:11.845439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] PATH_INFO: `/v3/users/19fed41ad3ec4ceb8ae160a8840a9d6d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:11.847609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fed41ad3ec4ceb8ae160a8840a9d6d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:11.850209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:11.858259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:12.042499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fed41ad3ec4ceb8ae160a8840a9d6d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:12.043404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fed41ad3ec4ceb8ae160a8840a9d6d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:12.146059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fed41ad3ec4ceb8ae160a8840a9d6d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:12.180621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fed41ad3ec4ceb8ae160a8840a9d6d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:12.181445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3029bd8b-9ee7-4787-970d-c15d2cd4f619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fed41ad3ec4ceb8ae160a8840a9d6d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:12.198501 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1126/2267] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:11 2022] DELETE /identity/v3/users/19fed41ad3ec4ceb8ae160a8840a9d6d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:12.838373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:12.853408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1e42-fd98-47ce-8c63-cce4b06e6b8a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:12.963109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:12.964412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:12.965023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:12.965669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] PATH_INFO: `/v3/projects/454de031725941dcbf7700d7763b91b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:12.971766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] RBAC: Authorizing `identity:delete_project(project_id=454de031725941dcbf7700d7763b91b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:12.974206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:13.558060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454de031725941dcbf7700d7763b91b1', 'request_id': 'req-97ec7d22-2958-455d-9cfe-476d07bd377d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:13.635549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454de031725941dcbf7700d7763b91b1', 'request_id': 'req-97ec7d22-2958-455d-9cfe-476d07bd377d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:13.665475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454de031725941dcbf7700d7763b91b1', 'request_id': 'req-97ec7d22-2958-455d-9cfe-476d07bd377d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:13.700036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] The token cache is being invalidate because project 454de031725941dcbf7700d7763b91b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:13.702223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:13.704374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ec7d22-2958-455d-9cfe-476d07bd377d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:13.708980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1142/2268] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:12 2022] DELETE /identity/v3/projects/454de031725941dcbf7700d7763b91b1 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:13.713757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:13.714323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:13.714429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:13.759636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:13.761064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:13.925532 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1127/2269] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:13.935377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:13.936837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:13.937275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.002324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:14.003936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:14.028691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.036968 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1143/2270] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:14.041186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de647-2277-4326-a9f0-54b8d2a882ff None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.047607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.048484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.048945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.049388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.050788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:14.051272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.053086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.096208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.097342 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1128/2271] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:14.098591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337ae37-9973-434c-9dfe-167f4e7417d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.122271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.128878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.128878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.128878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.128878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.128878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.259110 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1144/2272] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:14 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:20:14.260343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.270727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d96c0-22c8-4c50-89f1-2a64da47d72f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.333599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.334128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.334407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.334709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.335383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.337365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.426461 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1129/2273] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:14 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:14.431063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.439777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:14.451502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed301310-36b5-4188-9727-46448275ab64 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.456677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.457228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.457501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.457771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.458410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.460119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.475347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1145/2274] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:14.480547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.486822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:14.492938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f6683-c132-4589-a4cb-896a7949337c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.503197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.504189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.504540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.505024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.506654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.508915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86605-d98c-4b6e-ad9e-d476e6486722 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.524988 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1130/2275] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:14.531387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.547146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a558d-d9f2-44df-a37d-aa1a2b9195be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:14.551471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:14.552355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.552731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.553133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] PATH_INFO: `/v3/projects/285c3cb8fbbe44508a2a8a1f251ba496/users/afe1b459f9f84843b475a52a8eb2d7cb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.572949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285c3cb8fbbe44508a2a8a1f251ba496, user_id=afe1b459f9f84843b475a52a8eb2d7cb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:14.575820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:14.661074 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1146/2276] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:14 2022] PUT /identity/v3/projects/285c3cb8fbbe44508a2a8a1f251ba496/users/afe1b459f9f84843b475a52a8eb2d7cb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:14.675200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:14.675200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:14.675200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:14.710530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] MFA Rules not processed for user `afe1b459f9f84843b475a52a8eb2d7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:14.712107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:14.821538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1131/2277] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:14.833139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:14.834925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:15.016989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162230a-d1d0-4aa5-8b6e-c5e339d28175 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:15.027515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:15.028739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:15.029202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:15.029924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:15.042444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:15.044434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c83ae-bbad-4a7d-b329-48a7d2f2dff9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:15.085467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1147/2278] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:15.760208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:15.851085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db37cdf-2dd6-47f7-a5d1-82a89472ee7e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:15.869898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:15.870552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:15.870859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:15.871129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] PATH_INFO: `/v3/users/afe1b459f9f84843b475a52a8eb2d7cb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:15.872358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe1b459f9f84843b475a52a8eb2d7cb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:15.874843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:16.095799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe1b459f9f84843b475a52a8eb2d7cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:16.096527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe1b459f9f84843b475a52a8eb2d7cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:16.197927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe1b459f9f84843b475a52a8eb2d7cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:16.223399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe1b459f9f84843b475a52a8eb2d7cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:16.228776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe1b459f9f84843b475a52a8eb2d7cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:16.239562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:16.244173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1132/2279] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:15 2022] DELETE /identity/v3/users/afe1b459f9f84843b475a52a8eb2d7cb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:16.249207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:16.249762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:16.249762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:16.286445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:16.287789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:16.363457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1148/2280] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:16.374452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:16.376191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:16.454898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04764073-2f2a-41a1-88ce-9c1f8cf56158 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:16.459084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:16.459636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:16.459915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:16.460189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:16.470379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:16.471979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5330a4e-7e04-44db-a9b6-b15a66fe9dc6 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:16.484709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1133/2281] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:16.946693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:16.948220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:16.963919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc7869-7426-4394-aff3-2944fd0c9640 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:16.970014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:16.970887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:16.971206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:16.971582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] PATH_INFO: `/v3/projects/285c3cb8fbbe44508a2a8a1f251ba496` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:16.972854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285c3cb8fbbe44508a2a8a1f251ba496)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:16.974917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:17.109183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285c3cb8fbbe44508a2a8a1f251ba496', 'request_id': 'req-5ce5771b-4dc4-475b-9485-23454407c399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:17.114202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:17.243664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285c3cb8fbbe44508a2a8a1f251ba496', 'request_id': 'req-5ce5771b-4dc4-475b-9485-23454407c399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:17.257250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285c3cb8fbbe44508a2a8a1f251ba496', 'request_id': 'req-5ce5771b-4dc4-475b-9485-23454407c399'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:17.271280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] The token cache is being invalidate because project 285c3cb8fbbe44508a2a8a1f251ba496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:17.271781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:17.275011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ce5771b-4dc4-475b-9485-23454407c399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:17.275011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1149/2282] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:16 2022] DELETE /identity/v3/projects/285c3cb8fbbe44508a2a8a1f251ba496 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:17.279142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:17.280162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:17.280653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:17.330503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:17.331229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:17.485632 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1134/2283] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:17.495730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:17.496265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:17.496716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:17.543320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:17.545505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:17.570427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1150/2284] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:17.574806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:17.590162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68beb73-e603-4d30-9794-a57133f0cf07 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:17.599876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:17.600600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:17.600950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:17.601289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:17.602024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:17.602464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:17.604373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:17.627450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1135/2285] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:17.629019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:17.639000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a469be-841b-40f6-8f52-c8afebc6bc21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:17.656089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:17.656988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:17.657724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:17.658160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:17.659197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:17.661701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:17.776029 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1151/2286] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:17 2022] POST /identity/v3/projects => generated 395 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:17.776770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:17.795368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a74d50-e93f-47d8-a6b0-a3158d86d17c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:17.959889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:17.962723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:17.963010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:17.963286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:17.964098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:17.966084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:18.871734 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1136/2287] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:17 2022] POST /identity/v3/users => generated 298 bytes in 1096 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:18.872817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:18.888311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9673ba-597c-4191-959c-0fa127461e9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:18.916741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:18.917516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:18.917913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:18.918502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:18.919416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:18.921303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:18.941669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1152/2288] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:18.945931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:18.963525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250168f4-0bee-47c8-87eb-d6a120a61092 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:18.988646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:18.989277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:18.989558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:18.989829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:18.990487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:18.994243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f34b3-4848-4d3d-8c9f-7cbb34a3446d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:19.034864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1137/2289] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:19.035937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:19.064885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aece3d-e92a-43f2-8e91-0414f9380784 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:19.072121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:19.072920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:19.073299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:19.073673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] PATH_INFO: `/v3/projects/c21cc5116c8c40599da461864cdc58be/users/3a7d338cba1d4b38bc02f6081b8619dc/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:19.127361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21cc5116c8c40599da461864cdc58be, user_id=3a7d338cba1d4b38bc02f6081b8619dc, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:19.130160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:19.246461 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1153/2290] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:19 2022] PUT /identity/v3/projects/c21cc5116c8c40599da461864cdc58be/users/3a7d338cba1d4b38bc02f6081b8619dc/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:19.261890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b404-aefb-490d-be8b-f34bca1d558b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:19.262263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b404-aefb-490d-be8b-f34bca1d558b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:19.262511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35b404-aefb-490d-be8b-f34bca1d558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:19.310805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:19.328990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ae35b404-aefb-490d-be8b-f34bca1d558b None None] MFA Rules not processed for user `3a7d338cba1d4b38bc02f6081b8619dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:19.329666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae35b404-aefb-490d-be8b-f34bca1d558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:19.470338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1138/2291] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:19.633873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:19.633873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:19.725561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aed12-eb8f-4a32-8374-0bc9315aec80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:19.731663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:19.734685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:19.734685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:19.734685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:19.741260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:19.742929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:19.752178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1154/2292] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:19.811905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031336-4feb-40a6-8fd8-b66db9d65e4e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:19.812242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031336-4feb-40a6-8fd8-b66db9d65e4e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:19.812437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031336-4feb-40a6-8fd8-b66db9d65e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:19.832500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-48031336-4feb-40a6-8fd8-b66db9d65e4e None None] MFA Rules not processed for user `3a7d338cba1d4b38bc02f6081b8619dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:19.833694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48031336-4feb-40a6-8fd8-b66db9d65e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:19.840815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1139/2293] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:20.184757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:20.273721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d207-c3ae-433b-a40d-aab3015fe826 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:20.278693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:20.279950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:20.280373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:20.280843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] PATH_INFO: `/v3/users/3a7d338cba1d4b38bc02f6081b8619dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:20.282008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7d338cba1d4b38bc02f6081b8619dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:20.284066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:20.286133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:20.523358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7d338cba1d4b38bc02f6081b8619dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:20.524186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7d338cba1d4b38bc02f6081b8619dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:20.607988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7d338cba1d4b38bc02f6081b8619dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:20.620568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7d338cba1d4b38bc02f6081b8619dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:20.621267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7d338cba1d4b38bc02f6081b8619dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:20.641668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:20.642772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:20.643399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:20.647670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1155/2294] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:20 2022] DELETE /identity/v3/users/3a7d338cba1d4b38bc02f6081b8619dc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:20.667266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:20.670121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:20.759095 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1140/2295] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:20.776163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:20.777618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:20.846435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0387af-02a0-4f10-a806-da62c8b37346 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:20.849163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:20.849860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:20.850135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:20.850404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:20.861392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:20.863007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be823-f752-49a7-b3fc-193c70c03215 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:20.876847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1156/2296] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:21.360420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:21.361869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:21.374587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856ff3-d8ce-48b6-8b56-cb77f257f0fc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:21.383389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:21.383389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:21.383389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:21.383389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] PATH_INFO: `/v3/projects/c21cc5116c8c40599da461864cdc58be` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:21.383782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21cc5116c8c40599da461864cdc58be)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:21.383877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:21.507678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21cc5116c8c40599da461864cdc58be', 'request_id': 'req-8ba5a37d-a050-4933-b774-91163898092c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:21.590983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21cc5116c8c40599da461864cdc58be', 'request_id': 'req-8ba5a37d-a050-4933-b774-91163898092c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:21.597380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21cc5116c8c40599da461864cdc58be', 'request_id': 'req-8ba5a37d-a050-4933-b774-91163898092c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:21.611023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] The token cache is being invalidate because project c21cc5116c8c40599da461864cdc58be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:21.611315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:21.618048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ba5a37d-a050-4933-b774-91163898092c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:21.632894 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1141/2297] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:21 2022] DELETE /identity/v3/projects/c21cc5116c8c40599da461864cdc58be => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:21.634577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:21.635112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:21.635218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:21.668957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:21.671066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:21.750280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1157/2298] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:21.758005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:21.758516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:21.758669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:21.779509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:21.780797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:21.788802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1142/2299] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:21.793832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:21.806148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223920e-7fc1-4a79-9743-b4bc7ab3d670 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:21.811183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:21.811860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:21.812206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:21.812542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:21.813381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:21.813755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:21.816024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:21.828736 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1158/2300] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:21.833484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:21.843907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b773fc-e080-4b53-8eab-9aa0e2c303ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:21.849197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:21.849901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:21.850244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:21.850582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:21.851316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:21.853440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:21.860468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:21.940220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1143/2301] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:21 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:21.943930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:21.972821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39988af-bb77-42c4-9824-17685c3d7407 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:21.979327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:22.036443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:22.037086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.037371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.037645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.038274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:22.040771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:22.186681 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1159/2302] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:21 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:22.194846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:22.215138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc03ff-6e9d-4891-b2c2-534c0af22569 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:22.227501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:22.229298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.229600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.229874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.230601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:22.233899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:22.253617 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1144/2303] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:22.254709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:22.267673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ab35-7a27-4eb3-8feb-f192f0591911 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:22.273200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:22.273908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.274281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.274701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.275889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:22.277481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398240a5-e0ee-40a1-801a-800c576e21af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:22.289743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1160/2304] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:22.294122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:22.304334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fd60-88b6-43c3-beec-00acac556336 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:22.308832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:22.309598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.309827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.310095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] PATH_INFO: `/v3/projects/343897a8616e476bb4eec0c03e08cd62/users/7169450bb4114b44997715487a73d02e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.327380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343897a8616e476bb4eec0c03e08cd62, user_id=7169450bb4114b44997715487a73d02e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:22.331694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:22.409814 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1145/2305] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:22 2022] PUT /identity/v3/projects/343897a8616e476bb4eec0c03e08cd62/users/7169450bb4114b44997715487a73d02e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:22.415513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66fee-c733-4198-81b9-c96e4bfe2f40 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.415867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66fee-c733-4198-81b9-c96e4bfe2f40 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.416141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66fee-c733-4198-81b9-c96e4bfe2f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.438007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9e66fee-c733-4198-81b9-c96e4bfe2f40 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:22.439937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9e66fee-c733-4198-81b9-c96e4bfe2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:22.508901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1161/2306] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:22.519261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:22.521285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:22.586709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a39c4-f089-4903-be5e-817845a80573 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:22.590860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:22.591501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:22.591774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:22.592097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:22.601892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:22.603385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:22.613506 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1146/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:23.043607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf0f3-2beb-4c0d-8ff0-3b5e44c91f16 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:23.044138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf0f3-2beb-4c0d-8ff0-3b5e44c91f16 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:23.045122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf0f3-2beb-4c0d-8ff0-3b5e44c91f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:23.077963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64ebf0f3-2beb-4c0d-8ff0-3b5e44c91f16 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:23.080081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64ebf0f3-2beb-4c0d-8ff0-3b5e44c91f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:23.174830 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1162/2308] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:23.194785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:23.196847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:23.290402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1858e24-07d0-4465-ba56-b2fd7e64f512 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:23.298423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:23.299173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:23.299568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:23.299939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:23.311491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:23.312372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482deb2-4398-4b15-9bee-644947a4ffb9 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:23.339023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1147/2309] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:20:30.566885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:30.567425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:30.567795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:30.612822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] MFA Rules not processed for user `11020c20eb5d4a499766c3842b75802a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:30.613940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:30.677138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:30.731604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1163/2310] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:31.920272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:31.920801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:31.921095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:31.981334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] MFA Rules not processed for user `7169450bb4114b44997715487a73d02e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:31.983065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:32.086463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:32.161533 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1148/2311] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:32.263774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:32.265234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:32.416641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc017af-785d-4366-89e3-3078de348c6d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:32.423772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:32.424619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:32.425059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:32.429196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:32.436098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:32.437729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:32.458329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1164/2312] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:40.607307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:40.613559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:40.641135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45038c6-d33d-4493-ac4d-3ffd1a91e56a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:40.661418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:40.662311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:40.662744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:40.663266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] PATH_INFO: `/v3/users/1b95a2ca22b242de98e605dc3d3a6119` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:40.664553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b95a2ca22b242de98e605dc3d3a6119)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:40.666938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:40.919275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b95a2ca22b242de98e605dc3d3a6119'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:40.919932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b95a2ca22b242de98e605dc3d3a6119'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.063839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b95a2ca22b242de98e605dc3d3a6119'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.108353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b95a2ca22b242de98e605dc3d3a6119'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.109489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b95a2ca22b242de98e605dc3d3a6119'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.127902 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1149/2313] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:40 2022] DELETE /identity/v3/users/1b95a2ca22b242de98e605dc3d3a6119 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:41.447641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:41.469644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d883-ce19-4c19-8867-0682cad0065b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:41.561178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:41.562019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:41.562389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:41.562814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] PATH_INFO: `/v3/projects/fdbf9550103848c7a635aab654594f3a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:41.564007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbf9550103848c7a635aab654594f3a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:41.566010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:41.692049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbf9550103848c7a635aab654594f3a', 'request_id': 'req-4ecb6472-e513-4515-82a8-3c51a0bda79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.795874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbf9550103848c7a635aab654594f3a', 'request_id': 'req-4ecb6472-e513-4515-82a8-3c51a0bda79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.802453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbf9550103848c7a635aab654594f3a', 'request_id': 'req-4ecb6472-e513-4515-82a8-3c51a0bda79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.803658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:41.814549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] The token cache is being invalidate because project fdbf9550103848c7a635aab654594f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:41.814897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.815558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:41.817091 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1165/2314] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:41 2022] DELETE /identity/v3/projects/fdbf9550103848c7a635aab654594f3a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:41.821142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:41.822660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:41.836782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c289-efc4-4931-b7f4-821b83135fe8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:41.898123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:41.900157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:41.900157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:41.900157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] PATH_INFO: `/v3/users/b1da3fe8004747d78cc13a5707451708` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:41.901251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1da3fe8004747d78cc13a5707451708)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:41.903384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:42.115920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1da3fe8004747d78cc13a5707451708'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.116793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1da3fe8004747d78cc13a5707451708'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.120068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:42.279379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1da3fe8004747d78cc13a5707451708'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.292015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1da3fe8004747d78cc13a5707451708'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.292770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94e68d57-f145-40ad-b93b-60e2c3d6d8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1da3fe8004747d78cc13a5707451708'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.306757 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1150/2315] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:41 2022] DELETE /identity/v3/users/b1da3fe8004747d78cc13a5707451708 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:42.589647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:42.591800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:42.605860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6472-e513-4515-82a8-3c51a0bda79e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:42.677037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:42.678228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:42.678687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:42.678961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] PATH_INFO: `/v3/projects/938466b238384c99a84417bed70b3f7d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:42.680107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938466b238384c99a84417bed70b3f7d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:42.682188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:42.877649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938466b238384c99a84417bed70b3f7d', 'request_id': 'req-1e7807a4-cae1-4ed4-9a7d-414496755fb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.976789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938466b238384c99a84417bed70b3f7d', 'request_id': 'req-1e7807a4-cae1-4ed4-9a7d-414496755fb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:42.984570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938466b238384c99a84417bed70b3f7d', 'request_id': 'req-1e7807a4-cae1-4ed4-9a7d-414496755fb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:43.000099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] The token cache is being invalidate because project 938466b238384c99a84417bed70b3f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:43.000461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:43.001749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e7807a4-cae1-4ed4-9a7d-414496755fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:43.003337 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1166/2316] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:42 2022] DELETE /identity/v3/projects/938466b238384c99a84417bed70b3f7d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:43.008337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.009147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.009418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.030526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:43.031747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:43.128899 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1151/2317] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:43.136115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.136399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.136688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.156639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:43.157864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:43.170773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1167/2318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:43.175617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.189723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0f69-b0f4-41c3-af40-950d60458f31 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.195497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.196252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.196634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.197008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.197793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:43.198195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.200040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.218101 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1152/2319] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:43.219128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.232327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c796-8575-4b15-8bf0-bf7a37b0656c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.240606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.240899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.241281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.241653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.242388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.245058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.378716 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1168/2320] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:43.381182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.392280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34f1c-6ef2-46ef-8d24-cd6f26dc1f4c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.456305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.457129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.457413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.457691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.458343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.461195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.555820 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1153/2321] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:43.567690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.585057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275caec2-3c47-401e-afb2-ef57ff7c2e63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.597723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.599938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.600417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.600888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.601614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.603354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.615627 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1169/2322] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:43.619587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.631114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1171b-e76b-4a04-af86-9c9dd52de543 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.637315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.638069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.638749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.639347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.641599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.644387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdb1f-fd88-405a-9cde-0f29a4f5316f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.657913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1154/2323] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:43.662743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.676024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd7f31-74d7-430c-bd9f-255f8153dfa2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.680882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.681567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.681845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.683375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] PATH_INFO: `/v3/projects/a73c30f870c04817b5f2862ec9874b06/users/f7841751db6d44a7bdacd31f06665d41/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.704332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73c30f870c04817b5f2862ec9874b06, user_id=f7841751db6d44a7bdacd31f06665d41, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.707758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.809943 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1170/2324] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:43 2022] PUT /identity/v3/projects/a73c30f870c04817b5f2862ec9874b06/users/f7841751db6d44a7bdacd31f06665d41/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:43.820522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.820799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.821701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.867321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.871312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] MFA Rules not processed for user `f7841751db6d44a7bdacd31f06665d41`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:43.872696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:43.872817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:43.958262 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1155/2325] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:43.962131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626b83-4dd8-4d2f-9365-05e5d1b919b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.963514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:43.967124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.967900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.968181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.968452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] PATH_INFO: `/v3/users/da4c9e238a06434bb7fbca37a487a337` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.969602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4c9e238a06434bb7fbca37a487a337)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.971984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:43.977010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765e22-6a09-48c1-9941-1f8ea9aefd81 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:43.982148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:43.982910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:43.983187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:43.983452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:43.984083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:43.986156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.133714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:44.141792 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1156/2326] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:43 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:44.146011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.213077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc0f-ac56-4034-aa6c-e27e62447688 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.218159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.218784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.219061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.219327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.219973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.221894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.251461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4c9e238a06434bb7fbca37a487a337'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:44.252113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4c9e238a06434bb7fbca37a487a337'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:44.423214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4c9e238a06434bb7fbca37a487a337'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:44.444638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4c9e238a06434bb7fbca37a487a337'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:44.445315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1157/2327] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:44 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:44.446112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-311173b0-3ff4-4f6d-9082-bf8eeacbf968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4c9e238a06434bb7fbca37a487a337'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:44.446228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.448001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:44.459050 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1171/2328] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:43 2022] DELETE /identity/v3/users/da4c9e238a06434bb7fbca37a487a337 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:44.460778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ba57-cd9b-4409-94c9-0bb2f59c5808 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.463230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.463514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.463786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.489589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:44.490884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:44.529926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.530553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.530863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.531185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.531997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.533820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.546799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1158/2329] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:44.551083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.579835 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1172/2330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:44.588869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207d76-cb35-4118-ae23-fa27622f4821 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.602048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.602426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.603672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.604069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:44.604270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.604695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] PATH_INFO: `/v3/projects/e7e601db385d4421811b634f888b83b5/users/f2a364ecc573416486a2e6b9fcf85b14/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.622550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e601db385d4421811b634f888b83b5, user_id=f2a364ecc573416486a2e6b9fcf85b14, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.625631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.687545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b601-3404-418b-b5e1-457f21837173 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.691215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.691816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.692262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.692534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.702680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.704464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.716776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1159/2331] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:44 2022] PUT /identity/v3/projects/e7e601db385d4421811b634f888b83b5/users/f2a364ecc573416486a2e6b9fcf85b14/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:44.717964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.720974 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1173/2332] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:20:44.814165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60017d23-dff8-4470-9f08-9b7d14513240 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.819259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.819941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.820206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.820473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.821117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.822784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f91a-1ac6-405b-b6c0-7d4792124bf6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.833114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1160/2333] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:44.837421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:44.847994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec074bb-1545-4750-9d68-ce2c4cd057dc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:44.852934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:44.853669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.854025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.854478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] PATH_INFO: `/v3/projects/e7e601db385d4421811b634f888b83b5/users/f2a364ecc573416486a2e6b9fcf85b14/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.857014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e601db385d4421811b634f888b83b5, user_id=f2a364ecc573416486a2e6b9fcf85b14, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:44.859848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:44.883318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1174/2334] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:44 2022] PUT /identity/v3/projects/e7e601db385d4421811b634f888b83b5/users/f2a364ecc573416486a2e6b9fcf85b14/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:44.898305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:44.898720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:44.899062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:44.937829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] MFA Rules not processed for user `f2a364ecc573416486a2e6b9fcf85b14`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:44.938076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:44.962436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:45.041535 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1161/2335] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:45.261396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:45.265133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:45.378376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b7a6f-55ae-4fc7-9fec-86f6083c001b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:45.384648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:45.385408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:45.385529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:45.385829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:45.394800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:45.396375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:45.407010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1175/2336] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:45.508414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:45.510516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:45.574805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:45.588395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f16f-e706-4ac5-a07f-0ebc9bc9cf29 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:45.610197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:45.616534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:45.616961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:45.617440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:45.620742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:45.652806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e34f2-bc55-45b9-b751-4749f7c7f383 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:45.664392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:45.665549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:45.665885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:45.666208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] PATH_INFO: `/v3/projects/3d4d8e8c1f2941b29d19efbeacc7b54b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:45.667780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4d8e8c1f2941b29d19efbeacc7b54b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:45.669998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:45.744117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:45.746022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:45.762518 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1176/2337] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:45.874972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4d8e8c1f2941b29d19efbeacc7b54b', 'request_id': 'req-e0989018-ade2-4486-8384-95edeb999b36'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:45.972598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4d8e8c1f2941b29d19efbeacc7b54b', 'request_id': 'req-e0989018-ade2-4486-8384-95edeb999b36'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:45.980048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4d8e8c1f2941b29d19efbeacc7b54b', 'request_id': 'req-e0989018-ade2-4486-8384-95edeb999b36'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.002002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] The token cache is being invalidate because project 3d4d8e8c1f2941b29d19efbeacc7b54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:46.003387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.003926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.005577 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1162/2338] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:45 2022] DELETE /identity/v3/projects/3d4d8e8c1f2941b29d19efbeacc7b54b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:46.009777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:46.024316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7b3fd-c615-4b21-8e31-c2e191c8c75c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:46.104792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:46.105966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:46.106481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:46.106926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] PATH_INFO: `/v3/users/dca612cc2d5546649f1e10c3ea926cce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:46.108382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca612cc2d5546649f1e10c3ea926cce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:46.111909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:46.496685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca612cc2d5546649f1e10c3ea926cce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.497041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca612cc2d5546649f1e10c3ea926cce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.578295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca612cc2d5546649f1e10c3ea926cce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.591967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca612cc2d5546649f1e10c3ea926cce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.592875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca612cc2d5546649f1e10c3ea926cce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:46.610315 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1177/2339] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:46 2022] DELETE /identity/v3/users/dca612cc2d5546649f1e10c3ea926cce => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:47.140155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:47.141762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.158055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989018-ade2-4486-8384-95edeb999b36 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:47.285289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:47.286732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.287057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.287998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] PATH_INFO: `/v3/projects/a6673a3ad1934083a7dafdffcf953197` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.289204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6673a3ad1934083a7dafdffcf953197)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:47.291552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:47.424985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:47.427242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.451088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd329e-e00b-4956-a5df-ec3d37c6583e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:47.469789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6673a3ad1934083a7dafdffcf953197', 'request_id': 'req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.534006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:47.535621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.535621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.535621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] PATH_INFO: `/v3/users/f7841751db6d44a7bdacd31f06665d41` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.541086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7841751db6d44a7bdacd31f06665d41)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:47.541086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:47.590372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6673a3ad1934083a7dafdffcf953197', 'request_id': 'req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.596823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6673a3ad1934083a7dafdffcf953197', 'request_id': 'req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.608534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] The token cache is being invalidate because project a6673a3ad1934083a7dafdffcf953197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:47.608819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.609504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44383f3b-d28c-4b7a-b1ed-3c623cf3e683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.611038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1163/2340] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:47 2022] DELETE /identity/v3/projects/a6673a3ad1934083a7dafdffcf953197 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:47.615677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df074-7948-4de0-9350-06f1a0f101bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.615960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df074-7948-4de0-9350-06f1a0f101bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.616268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20df074-7948-4de0-9350-06f1a0f101bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.618496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:47.641659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f20df074-7948-4de0-9350-06f1a0f101bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:47.642400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f20df074-7948-4de0-9350-06f1a0f101bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.657192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1164/2341] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:47.665043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.665387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.666092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.685887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:47.687721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.695767 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1165/2342] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:47.699933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:47.710167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aa6a-1e7a-4c1a-b905-aaebc13a0ca9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:47.721308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:47.722278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.738123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.738123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.738123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:47.738123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:47.738123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:47.738605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7841751db6d44a7bdacd31f06665d41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.738605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7841751db6d44a7bdacd31f06665d41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.738910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1166/2343] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:47.742982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:47.744741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.757681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e773ff4-b16d-43db-86fb-529b43cc3c77 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:47.763224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:47.763847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.764120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.764390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.765013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:47.766972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:47.805220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7841751db6d44a7bdacd31f06665d41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.822315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7841751db6d44a7bdacd31f06665d41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.823129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19024042-b9c8-4971-8f00-a0de5a8aff51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7841751db6d44a7bdacd31f06665d41'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:47.839411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1178/2344] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:47 2022] DELETE /identity/v3/users/f7841751db6d44a7bdacd31f06665d41 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:47.844380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:47.844947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:47.845365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:47.868579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:47.869850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:47.895964 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1167/2345] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:47 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:20:47.902398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:47.989009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e92c83-8f79-4d5d-86ac-fa0507bbd1c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:47.992322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1179/2346] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:48.000440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.003679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.003872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:48.003968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.003968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.003968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.003968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.006763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.045312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:48.077092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162570a6-e4b3-47b4-bd82-12d2abb701af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.138222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.139134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.139565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.139868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.150596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.152372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.165438 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1180/2348] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:48.165571 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1168/2348] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:47 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:48.169798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.181942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c1d0-e4ab-480e-a8b1-e3078a2904ce admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.187750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.188766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.189044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.189315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.190025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.191897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.235063 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1169/2349] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:48.238185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.250454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25b91-12a3-46ac-a5c4-70427da31565 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.256223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.257229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.257515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.257842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.259224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.261066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2866c7-3202-4b1c-9374-ff6f1747323d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.275430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1181/2350] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:48.279781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.290840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da4da9-7e25-471a-b4a6-01fdde3f5702 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.297350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.299123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.299692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.300336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] PATH_INFO: `/v3/projects/61b60d364df4459f87438c9952040e59/users/277acd84bd3845fd9291ee53a2273097/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.321307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b60d364df4459f87438c9952040e59, user_id=277acd84bd3845fd9291ee53a2273097, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.325490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.429808 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1170/2351] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:48 2022] PUT /identity/v3/projects/61b60d364df4459f87438c9952040e59/users/277acd84bd3845fd9291ee53a2273097/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:48.444592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.444942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.445250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.491073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] MFA Rules not processed for user `277acd84bd3845fd9291ee53a2273097`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:48.492365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:48.580702 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1182/2352] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:48.581855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.675542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c18fbf-6206-4976-aff9-1b4936747b36 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.680543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.681162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.681452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.681728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.682375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.684393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.757531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.759629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:48.781086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7f38-6be4-448c-a7b1-a4ae5464a48f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.799620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.800060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.800331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.800790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] PATH_INFO: `/v3/projects/a73c30f870c04817b5f2862ec9874b06` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.802151 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1171/2353] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:48 2022] POST /identity/v3/projects => generated 395 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:48.805940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73c30f870c04817b5f2862ec9874b06)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.806307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:48.807914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.895759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ca98-49e6-4611-9108-53ce5fa1c294 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:48.901231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:48.901786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:48.902068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:48.902909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:48.903620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:48.905939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:48.972479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73c30f870c04817b5f2862ec9874b06', 'request_id': 'req-b7052a96-abc5-4971-a26c-3d35940d9b0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.040114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1172/2354] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:48 2022] POST /identity/v3/users => generated 304 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:49.044423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:49.055685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd165460-ed11-461b-8e6e-cf85771c30d0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:49.063624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73c30f870c04817b5f2862ec9874b06', 'request_id': 'req-b7052a96-abc5-4971-a26c-3d35940d9b0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.075188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73c30f870c04817b5f2862ec9874b06', 'request_id': 'req-b7052a96-abc5-4971-a26c-3d35940d9b0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.144361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] The token cache is being invalidate because project a73c30f870c04817b5f2862ec9874b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:49.146161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.150327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.160694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1183/2355] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:48 2022] DELETE /identity/v3/projects/a73c30f870c04817b5f2862ec9874b06 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:49.162788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:49.168242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:49.230157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:49.230157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.232383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.232383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.233293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:49.239334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:49.282060 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1173/2356] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:49.287934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:49.291111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:49.318972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97c9f8-c3c6-41b2-afde-49ad1ba73861 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:49.335481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:49.336220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.336563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.337026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] PATH_INFO: `/v3/projects/262deec78a0147098a3e4126f9b19c17/users/f368cdf742a44c56ad3a8742e26f0880/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.351066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a96-abc5-4971-a26c-3d35940d9b0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:49.357795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:49.358608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.359148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.359655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] PATH_INFO: `/v3/users/f2a364ecc573416486a2e6b9fcf85b14` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.361346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a364ecc573416486a2e6b9fcf85b14)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:49.364534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:49.378515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262deec78a0147098a3e4126f9b19c17, user_id=f368cdf742a44c56ad3a8742e26f0880, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:49.390695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:49.677795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1174/2357] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:49 2022] PUT /identity/v3/projects/262deec78a0147098a3e4126f9b19c17/users/f368cdf742a44c56ad3a8742e26f0880/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:49.681903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:49.772631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a364ecc573416486a2e6b9fcf85b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.773318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a364ecc573416486a2e6b9fcf85b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.784787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20c9ea-b487-4035-8b49-7adca3463260 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:49.791176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:49.791176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.791176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.791176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.791655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:49.793691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:49.805224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1175/2358] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:49.809232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:49.810909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:49.827006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2a79-3302-4d53-88fa-30c741e53ff1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:49.832469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:49.833398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.833680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.833953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] PATH_INFO: `/v3/projects/262deec78a0147098a3e4126f9b19c17/users/f368cdf742a44c56ad3a8742e26f0880/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.836147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262deec78a0147098a3e4126f9b19c17, user_id=f368cdf742a44c56ad3a8742e26f0880, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:49.838953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198a6a-a87b-4128-a2f2-4703c619b206 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:49.854662 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1176/2359] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:49 2022] PUT /identity/v3/projects/262deec78a0147098a3e4126f9b19c17/users/f368cdf742a44c56ad3a8742e26f0880/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:49.865921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:49.865921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:49.865921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:49.885013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a364ecc573416486a2e6b9fcf85b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.908719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a364ecc573416486a2e6b9fcf85b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.912483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a364ecc573416486a2e6b9fcf85b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:49.931061 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1184/2360] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:49 2022] DELETE /identity/v3/users/f2a364ecc573416486a2e6b9fcf85b14 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:49.934246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] MFA Rules not processed for user `f368cdf742a44c56ad3a8742e26f0880`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:49.934246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:50.022238 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1177/2361] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:50.034199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:50.036105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:50.045778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:50.179643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a46ee-8a44-4d39-8ccb-5151e53de398 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:50.195894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:50.197432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:50.198051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:50.198552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:50.209038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:50.211554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b7876-58a8-4dc2-8124-665dabb79e3e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:50.223906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1185/2362] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:50.225289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:50.595774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:50.601937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:50.737208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9486-48ed-4c54-b2db-a6eeaba172a0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:50.743584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:50.751305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:50.751305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:50.751305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] PATH_INFO: `/v3/projects/e7e601db385d4421811b634f888b83b5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:50.751305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e601db385d4421811b634f888b83b5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:50.751305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:50.813161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f50fd-9ddd-49e7-b3d8-5c86598f2854 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:50.814023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f50fd-9ddd-49e7-b3d8-5c86598f2854 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:50.814298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f50fd-9ddd-49e7-b3d8-5c86598f2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:50.837460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a4f50fd-9ddd-49e7-b3d8-5c86598f2854 None None] MFA Rules not processed for user `f7bc608b554e4c6b94ec547f4e6c1d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:50.838697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a4f50fd-9ddd-49e7-b3d8-5c86598f2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:50.895155 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1186/2363] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:50.923132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e601db385d4421811b634f888b83b5', 'request_id': 'req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:51.035558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e601db385d4421811b634f888b83b5', 'request_id': 'req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:51.047513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e601db385d4421811b634f888b83b5', 'request_id': 'req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:51.059709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] The token cache is being invalidate because project e7e601db385d4421811b634f888b83b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:51.059709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:51.060391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ff6ecd9-169b-4e30-8e9b-55dc4d8d7445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:51.061960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1178/2364] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:50 2022] DELETE /identity/v3/projects/e7e601db385d4421811b634f888b83b5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:51.066899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.067267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.067615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.096025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:51.097259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:51.219745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1187/2365] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:51.228337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.228612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.228888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.254547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:51.255804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:51.285151 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1179/2366] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:51.286958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.298993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a5762-2652-4d7e-9154-d9565951a8b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.304090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:51.310290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.310290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.310290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.310290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.310810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:51.310810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.310810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.323695 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1188/2367] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:51.328613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.338370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5768941-35b4-4eb6-8883-0ef1ca0382b8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.344445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.345187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.345465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.345728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.346590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.348703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.384371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.388276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:51.451796 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1180/2368] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:51 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:51.454360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.564012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a046f-4351-4130-9a69-1932b13dd0ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.584365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:51.591820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51626-48cf-42cb-90d0-0971999c8fa0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.597258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.598458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.599212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.600586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.602008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.604582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.656942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.657568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.657841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.658107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.660108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:51.727484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1181/2369] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:51 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:51.732303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.745244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be209579-c5f7-4a34-b7b0-16c99fcc1323 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.753081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.754040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.754581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.755131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.756014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.758307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.773671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1182/2370] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:51.777584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.791541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200fa0f-76f7-4bf2-a205-db7e56074483 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.794230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.796110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.804355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.805106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.805482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.807875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.807875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.809672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.811800 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1189/2371] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:51.828150 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1183/2372] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:51.832097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.848137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:51.848137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:51.849243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab348-a340-4834-81ff-f7e1c3c521f1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.854733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.855503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.855782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.856051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] PATH_INFO: `/v3/projects/3085597168c2474896dcb81da5c761b0/users/2bc11faa62c84e07b5f668e334d629f6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.875702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3085597168c2474896dcb81da5c761b0, user_id=2bc11faa62c84e07b5f668e334d629f6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.882255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6adeaa-6b7b-4129-9af5-13cb3fd5b667 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:51.882396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71590221-cb25-4c9e-ba72-7178dfb1b808 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.883577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:51.884537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.885235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.886236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] PATH_INFO: `/v3/users/277acd84bd3845fd9291ee53a2273097` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:51.888146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277acd84bd3845fd9291ee53a2273097)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:51.890258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:51.986713 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1190/2373] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:51 2022] PUT /identity/v3/projects/3085597168c2474896dcb81da5c761b0/users/2bc11faa62c84e07b5f668e334d629f6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:51.989061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:51.989476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:51.989904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.049656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] MFA Rules not processed for user `2bc11faa62c84e07b5f668e334d629f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:52.063636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:52.135612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277acd84bd3845fd9291ee53a2273097'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.136526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277acd84bd3845fd9291ee53a2273097'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.192436 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1191/2374] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:52.198506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.198506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:52.257333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277acd84bd3845fd9291ee53a2273097'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.274593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277acd84bd3845fd9291ee53a2273097'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.275902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b946dd3e-215e-4ba3-93d3-08282139f653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277acd84bd3845fd9291ee53a2273097'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.312832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997a87e-9fcc-4fe5-ae69-c868224bafb5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.319187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.320528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.320964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.321198 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1184/2375] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:51 2022] DELETE /identity/v3/users/277acd84bd3845fd9291ee53a2273097 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:52.321675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.322460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.325298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.325584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.325855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.326651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.363629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:52.365868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:52.449540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1185/2376] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:52.456004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.457869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:52.510033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1192/2377] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:52 2022] POST /identity/v3/projects => generated 389 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:52.511274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.546871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239079-4b05-418c-97cd-e8a9bf242fae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.615646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.617124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.617663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.618161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.624617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8778d-1d6e-411f-9d90-89ce9ad5b456 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.633051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.633329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.633329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.633535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.633926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.634401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.635616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.636705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.649103 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1186/2378] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:20:52.650754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.652994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:52.668129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021b28-c5dd-4e33-beb4-0b9f540ef242 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.673393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.674024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.674361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.674661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] PATH_INFO: `/v3/users/7169450bb4114b44997715487a73d02e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.676007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7169450bb4114b44997715487a73d02e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.677998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.806810 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1193/2379] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:52 2022] POST /identity/v3/users => generated 301 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:52.810710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.825421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357245a-7eb8-4dba-bb30-cacdae3b583e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.833503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.833984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.833984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.834151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.834754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.836355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.854314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1194/2380] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:52.855672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.866929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2042c-cd9a-423c-aa66-3d4049787a03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:52.872975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:52.874219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:52.874806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:52.875581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] PATH_INFO: `/v3/projects/46b9be24492d437889d2f5a5eed148bb/users/4d252b986ea643038f399c4309677325/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:52.894243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b9be24492d437889d2f5a5eed148bb, user_id=4d252b986ea643038f399c4309677325, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:52.899478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:52.913656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7169450bb4114b44997715487a73d02e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.915037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7169450bb4114b44997715487a73d02e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.978064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7169450bb4114b44997715487a73d02e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:52.985729 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1195/2381] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:52 2022] PUT /identity/v3/projects/46b9be24492d437889d2f5a5eed148bb/users/4d252b986ea643038f399c4309677325/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:52.989773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:52.992668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.002871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7169450bb4114b44997715487a73d02e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.003606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7169450bb4114b44997715487a73d02e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.028882 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1187/2382] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:52 2022] DELETE /identity/v3/users/7169450bb4114b44997715487a73d02e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:53.079087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6364b-4f4e-4a60-bfce-f69fff883fab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.118934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.121540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.141716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:53.195754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.196379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.196660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.196927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.197565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.202658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.217987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1196/2383] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:53.222120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.234065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fdf2-3f93-4617-b0fb-dbbfe60b61ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.239266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.241350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.241350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.241350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] PATH_INFO: `/v3/projects/46b9be24492d437889d2f5a5eed148bb/users/4d252b986ea643038f399c4309677325/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.242886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b9be24492d437889d2f5a5eed148bb, user_id=4d252b986ea643038f399c4309677325, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.246161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe827eb9-511f-44d4-be1a-701f995eac73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.270279 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1197/2384] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:53 2022] PUT /identity/v3/projects/46b9be24492d437889d2f5a5eed148bb/users/4d252b986ea643038f399c4309677325/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:53.271971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.272116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.272359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.309971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] MFA Rules not processed for user `4d252b986ea643038f399c4309677325`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:53.311549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.336381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e6265-5c18-4bc8-8551-a2daeebb8e79 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.391427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1198/2385] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:53.412929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.412929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.413226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.413827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.414166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.414868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] PATH_INFO: `/v3/projects/61b60d364df4459f87438c9952040e59` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.419582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b60d364df4459f87438c9952040e59)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.422332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.507396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72754cf7-d321-405a-ba34-b8afb992888e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.517613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.518258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.518602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.518989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.528909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.530546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.540222 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1199/2386] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:20:53.541071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.543052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.556082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d978b1-b8e2-48a2-9a6f-aec82cfc0268 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.561448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.562072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.562404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.562651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] PATH_INFO: `/v3/projects/343897a8616e476bb4eec0c03e08cd62` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.563792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343897a8616e476bb4eec0c03e08cd62)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.565671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.622951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b60d364df4459f87438c9952040e59', 'request_id': 'req-61e396db-5cab-4ebd-b384-a80cfc9204d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.725932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b60d364df4459f87438c9952040e59', 'request_id': 'req-61e396db-5cab-4ebd-b384-a80cfc9204d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.730832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:53.738305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b60d364df4459f87438c9952040e59', 'request_id': 'req-61e396db-5cab-4ebd-b384-a80cfc9204d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.741494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343897a8616e476bb4eec0c03e08cd62', 'request_id': 'req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.753959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] The token cache is being invalidate because project 61b60d364df4459f87438c9952040e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:53.754252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.755140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.756672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1188/2387] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:53 2022] DELETE /identity/v3/projects/61b60d364df4459f87438c9952040e59 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:53.760404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.761946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.848104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e396db-5cab-4ebd-b384-a80cfc9204d6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.852742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343897a8616e476bb4eec0c03e08cd62', 'request_id': 'req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.863351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343897a8616e476bb4eec0c03e08cd62', 'request_id': 'req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.880081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] The token cache is being invalidate because project 343897a8616e476bb4eec0c03e08cd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:53.880720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.881954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:53.885547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1200/2388] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:53 2022] DELETE /identity/v3/projects/343897a8616e476bb4eec0c03e08cd62 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:53.886466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:53.888147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.924580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.925187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.925475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.925729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.927610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:53.958076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b44e-59fb-457f-877d-a4cd6fec5ef5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:53.963256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:53.963906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:53.964179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:53.965001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] PATH_INFO: `/v3/users/f368cdf742a44c56ad3a8742e26f0880` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:53.966196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f368cdf742a44c56ad3a8742e26f0880)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.968164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:53.992455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:53.994283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab730-6dc8-4168-af3d-2b06fe6d285c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.003987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1189/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:54.005250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeb1aa-58cd-4cbb-9b0d-64cc9c2a91c4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.005534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeb1aa-58cd-4cbb-9b0d-64cc9c2a91c4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.005804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeb1aa-58cd-4cbb-9b0d-64cc9c2a91c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.029816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dcbeb1aa-58cd-4cbb-9b0d-64cc9c2a91c4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:54.031117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dcbeb1aa-58cd-4cbb-9b0d-64cc9c2a91c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:54.047244 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1190/2390] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:54.055836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166360a-4064-4409-b737-5df8e690d082 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.056451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166360a-4064-4409-b737-5df8e690d082 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.057035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166360a-4064-4409-b737-5df8e690d082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.090026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1166360a-4064-4409-b737-5df8e690d082 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:54.091500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1166360a-4064-4409-b737-5df8e690d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:54.110463 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1191/2391] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:54.118597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166360a-4064-4409-b737-5df8e690d082 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.129616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166360a-4064-4409-b737-5df8e690d082 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.137133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.138045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.138566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.139162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.140145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:54.140547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.142415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.164296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1192/2392] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:54.178263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.191497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982cf89-2752-48f5-a5f5-fcbf08daabbb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.198016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.199365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.200204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.200783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.202389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.204553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.283088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f368cdf742a44c56ad3a8742e26f0880'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.283683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f368cdf742a44c56ad3a8742e26f0880'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.311371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1193/2393] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:54 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:54.315868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.326046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:54.401620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3ebd-566d-428f-95ef-cd58c528a1ba admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.407291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.407572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.407845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.408176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.408801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.410738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.429694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f368cdf742a44c56ad3a8742e26f0880'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.445934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f368cdf742a44c56ad3a8742e26f0880'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.446939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f368cdf742a44c56ad3a8742e26f0880'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.461560 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1201/2394] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:53 2022] DELETE /identity/v3/users/f368cdf742a44c56ad3a8742e26f0880 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:54.462555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.464032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:54.508452 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1194/2395] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:54 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:20:54.509717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.531596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b8f0d-db22-4744-a56b-cd0593428c8c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.582453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e785dc-d0bc-4b51-8bf5-2365dbd8ccae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.593579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.596322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.596608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.596887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] PATH_INFO: `/v3/users/2bc11faa62c84e07b5f668e334d629f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.599660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc11faa62c84e07b5f668e334d629f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.606659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.668940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.669632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.669914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.670186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.670878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.672495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.694515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1195/2396] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:54.696177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.736460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a47eaa-06d9-4d99-a3ea-a20cd1144b2c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.760618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.761782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.762384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.763420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.763568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.765387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.788145 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1196/2397] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:54.793945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:54.809161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfc7e8-66dc-4f99-8d5c-27e6904bc701 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:54.815285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:54.815954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.816249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.816704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] PATH_INFO: `/v3/projects/47c07334b72c4be089609b217944b341/users/9e936cb29a634b9da2e4ba5e2901de6b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.833151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c07334b72c4be089609b217944b341, user_id=9e936cb29a634b9da2e4ba5e2901de6b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:54.836184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844674fa-9805-4652-9cc5-2a28edb192b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:54.892587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:54.908958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc11faa62c84e07b5f668e334d629f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.909704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc11faa62c84e07b5f668e334d629f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:54.960372 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1197/2398] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:54 2022] PUT /identity/v3/projects/47c07334b72c4be089609b217944b341/users/9e936cb29a634b9da2e4ba5e2901de6b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:54.969020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:54.969299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:54.969591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:54.990540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:54.991754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.010008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc11faa62c84e07b5f668e334d629f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.024719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc11faa62c84e07b5f668e334d629f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.026281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1079f441-27bb-44ff-a397-4556e6fd21a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc11faa62c84e07b5f668e334d629f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.046524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1202/2399] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:54 2022] DELETE /identity/v3/users/2bc11faa62c84e07b5f668e334d629f6 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:55.050946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.051583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.052151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.063217 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1198/2400] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:55.074343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.075316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:55.075768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.077037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.139039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11a1b7-ed33-4fcc-aa76-ea971cb0e10c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.153168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1203/2401] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:55.163891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.232928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.234139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.234601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.235122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.245312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2990-1843-4a80-bb8c-10accc7f4092 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.246545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.248348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e682c-a210-43e1-ad67-c76cc5e88aad service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:55.249171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.249796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.250120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.250392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.260861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.263040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:55.273816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1204/2402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:55.274507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.275930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.276544 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1199/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:20:55.281036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:55.293111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785ac0-24e4-4160-88b9-1ec16e2be41b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.299354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.300063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.300373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.301398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] PATH_INFO: `/v3/projects/262deec78a0147098a3e4126f9b19c17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.303020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=262deec78a0147098a3e4126f9b19c17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.304912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:55.381821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.382146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.382429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.416800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:55.418731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.454654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262deec78a0147098a3e4126f9b19c17', 'request_id': 'req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.506443 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1200/2404] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:55.530994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.532599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.535968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262deec78a0147098a3e4126f9b19c17', 'request_id': 'req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.544443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262deec78a0147098a3e4126f9b19c17', 'request_id': 'req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.563566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] The token cache is being invalidate because project 262deec78a0147098a3e4126f9b19c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:55.563968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.565776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4fce0b8-7a96-41c2-9876-2cd1910cd8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:55.572179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1205/2405] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:55 2022] DELETE /identity/v3/projects/262deec78a0147098a3e4126f9b19c17 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:55.574107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f11fa-0d4f-407e-800d-5055c103c774 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.574498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f11fa-0d4f-407e-800d-5055c103c774 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.574900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f11fa-0d4f-407e-800d-5055c103c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.603111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-826f11fa-0d4f-407e-800d-5055c103c774 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:55.604458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-826f11fa-0d4f-407e-800d-5055c103c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.661925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e792f0-773b-4e5c-8e37-e7ce89a13584 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.782536 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1206/2406] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:55.790773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471c74-c9e9-4611-9946-234769ff405d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.791192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471c74-c9e9-4611-9946-234769ff405d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.791562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471c74-c9e9-4611-9946-234769ff405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.794711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.795337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.795611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.795892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.798611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.840482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47471c74-c9e9-4611-9946-234769ff405d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:55.841694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47471c74-c9e9-4611-9946-234769ff405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:55.867765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1207/2407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:55.874263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47471c74-c9e9-4611-9946-234769ff405d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.889519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47471c74-c9e9-4611-9946-234769ff405d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.893719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.896956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.897724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.897869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.898087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.898989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:55.899515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.899858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:55.903454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:55.915423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1201/2408] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:20:55.927386 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1208/2409] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:55.932465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:55.946351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5b10-c263-49a6-911b-100fa3c27517 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:55.951263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:55.952215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:55.952690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:55.953027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:55.953761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:55.955983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.081880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1202/2410] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:55 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:56.086789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.104677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eab9d-1511-49e3-859b-907d23f004c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.216108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.216317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:56.242505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.255844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.257378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.257898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.259693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.263590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.330581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d29e4-2465-43e0-a58b-778de87c553f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.337936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.338766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.339048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.339394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] PATH_INFO: `/v3/projects/3085597168c2474896dcb81da5c761b0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.347839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3085597168c2474896dcb81da5c761b0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.347839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.408661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1209/2411] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:56 2022] POST /identity/v3/users => generated 296 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:56.410936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.432133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a8d6b-7209-4f63-86f6-e670c6f5d3c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.444086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.444798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.445075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.445347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.446015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.449333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.468078 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1210/2412] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:56.469129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.489928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc344f1-db32-4834-9c43-6f88a46d1465 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.509968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3085597168c2474896dcb81da5c761b0', 'request_id': 'req-43a89651-097f-4570-ae8e-c1a99240e0ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.583904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.584615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.584808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.585069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.585709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.587364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.590517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3085597168c2474896dcb81da5c761b0', 'request_id': 'req-43a89651-097f-4570-ae8e-c1a99240e0ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.601221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3085597168c2474896dcb81da5c761b0', 'request_id': 'req-43a89651-097f-4570-ae8e-c1a99240e0ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.609040 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1211/2413] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:56.610000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.621200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] The token cache is being invalidate because project 3085597168c2474896dcb81da5c761b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:56.622171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.623006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.631261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805334b3-7f86-4bb7-8ffd-7b17e2d50d3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.635649 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1203/2414] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:56 2022] DELETE /identity/v3/projects/3085597168c2474896dcb81da5c761b0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:56.640817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.642516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:56.647541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:56.649702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.650455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.653354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.653354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] PATH_INFO: `/v3/projects/c71186f1881b447391dbe5db6e5efa3b/users/35d6efe3e9524f628b367ac0306f110b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.690471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89651-097f-4570-ae8e-c1a99240e0ee admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:56.693166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71186f1881b447391dbe5db6e5efa3b, user_id=35d6efe3e9524f628b367ac0306f110b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.699121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:56.699964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.700375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.700748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] PATH_INFO: `/v3/users/4d252b986ea643038f399c4309677325` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.700878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e154122-aaf9-4f82-b59d-9a89c7d974fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.703173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d252b986ea643038f399c4309677325)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:56.707072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:56.812904 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1212/2415] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:56 2022] PUT /identity/v3/projects/c71186f1881b447391dbe5db6e5efa3b/users/35d6efe3e9524f628b367ac0306f110b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:56.824708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:56.825240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:56.825786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:56.894312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] MFA Rules not processed for user `35d6efe3e9524f628b367ac0306f110b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:56.895269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:56.982369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d252b986ea643038f399c4309677325'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.983398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d252b986ea643038f399c4309677325'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:56.988932 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1213/2416] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:56.994291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:56.997251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:57.069013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:57.100841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f661f-f528-45d9-b0ef-c821e9365bb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:57.105341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d252b986ea643038f399c4309677325'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:57.110209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:57.111540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:57.111898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:57.112716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:57.113523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:57.116025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:57.128448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d252b986ea643038f399c4309677325'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:57.129210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d252b986ea643038f399c4309677325'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:57.153451 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1204/2417] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:56 2022] DELETE /identity/v3/users/4d252b986ea643038f399c4309677325 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:57.225401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1214/2418] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:56 2022] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:57.230007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:57.231690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:57.362265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d144-5ec5-4c00-ae6d-9e015f7b55bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:57.454288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:57.455421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:57.455907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:57.456605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:57.457478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:57.460576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:57.673751 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1205/2419] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:57 2022] POST /identity/v3/users => generated 302 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:57.677792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:57.689075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016843b0-44e4-4142-9874-6055ae07965b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:57.722440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:57.723837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:57.724093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:57.724368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:57.725030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:57.732910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:57.766979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1215/2420] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:57.769770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:57.782921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:57.784705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:57.790649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b1fc-f26e-4dbf-8f8a-d4526d958717 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:57.814665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:57.817197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:57.818066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:57.818645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] PATH_INFO: `/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318/users/0141fc930fd94bf08e7ac53e023dd28d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:57.820514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ee6a7-441d-491a-ba8a-1bb9e3bdfe8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:57.826434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:57.827614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:57.828205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:57.828786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] PATH_INFO: `/v3/projects/46b9be24492d437889d2f5a5eed148bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:57.830420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b9be24492d437889d2f5a5eed148bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:57.832937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:57.876583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d7adaff2b64cf1ae30d0e40fa21318, user_id=0141fc930fd94bf08e7ac53e023dd28d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:57.882093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.024946 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1206/2421] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:57 2022] PUT /identity/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318/users/0141fc930fd94bf08e7ac53e023dd28d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:58.029319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.050418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b9be24492d437889d2f5a5eed148bb', 'request_id': 'req-8349f6be-2416-40db-b987-8fd977dc0bde'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:58.144392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b9be24492d437889d2f5a5eed148bb', 'request_id': 'req-8349f6be-2416-40db-b987-8fd977dc0bde'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:58.155469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b9be24492d437889d2f5a5eed148bb', 'request_id': 'req-8349f6be-2416-40db-b987-8fd977dc0bde'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:58.174325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] The token cache is being invalidate because project 46b9be24492d437889d2f5a5eed148bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:20:58.175069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:58.175951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8349f6be-2416-40db-b987-8fd977dc0bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:58.182016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1216/2422] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:20:57 2022] DELETE /identity/v3/projects/46b9be24492d437889d2f5a5eed148bb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:58.187513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a58af-1429-4cc2-b9a4-11c6cdf26618 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:58.189974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0346a0-062a-4c87-94e9-f4aff5914629 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.191387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0346a0-062a-4c87-94e9-f4aff5914629 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.192746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0346a0-062a-4c87-94e9-f4aff5914629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.263716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8c0346a0-062a-4c87-94e9-f4aff5914629 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:58.265348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c0346a0-062a-4c87-94e9-f4aff5914629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:58.297923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:58.298518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.298850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.299125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.300058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:58.301955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.318827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1207/2423] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:20:58.320146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.323017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:58.343325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729e4f-e9aa-4ade-9ec5-7cbdd8237dc0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:58.359021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:58.360517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.361510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.361795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] PATH_INFO: `/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318/users/0141fc930fd94bf08e7ac53e023dd28d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.366433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d7adaff2b64cf1ae30d0e40fa21318, user_id=0141fc930fd94bf08e7ac53e023dd28d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:58.372890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c680def-1ba4-428c-8b47-07075309e5ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.393810 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1208/2424] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:58 2022] PUT /identity/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318/users/0141fc930fd94bf08e7ac53e023dd28d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:58.404644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.404974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.405299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.421321 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1217/2425] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:58.435189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.435752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.436199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.454948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] MFA Rules not processed for user `0141fc930fd94bf08e7ac53e023dd28d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:58.457380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:58.483781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:58.485196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:58.572611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:58.621144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1209/2426] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:58.672128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.674723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:58.675618 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1218/2427] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:20:58.679831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.697319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3e4a4-6c3a-4b35-9d9d-5b16e3f8a0d5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:58.724628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:58.725255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.725659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.725777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.726532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:20:58.726862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:58.728470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.760957 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1219/2428] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:20:58.766171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.793767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb69b0-951a-480b-b9a6-48b7b73d7ba2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:58.802115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:58.802777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.803060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.803333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.803981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:58.806274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.811465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:58.874852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc025b-77b4-4f57-96fa-150ce52dbad9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:58.880845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:58.881633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:58.881940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:58.882193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:58.892916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:58.894533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:58.906974 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1210/2429] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:58.969357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.978893 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1220/2430] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:58 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:20:58.980281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:58.986044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a561131-f831-43e0-a763-eb6408d8c57a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.089120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f762468-411e-4955-8c5a-04ef245fdcde admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.101529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.102160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.102442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.102744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.108144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.115086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.147360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.148715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.149010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.149285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.152493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:59.241005 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1221/2431] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:20:58 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:20:59.247499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:59.270763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58919d-19d5-45d8-8d04-b434c315bbbb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.277817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.278710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.279341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.282540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.298527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.304132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.319967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.326135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.345875 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1222/2432] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:59.346497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:59.366590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744799-79b8-4846-86b0-c550beef01ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.371032 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1211/2433] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:20:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:20:59.393055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.393184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.393695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.393811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:59.393970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.394790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.397635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.410550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb343-ec3b-4b60-9b4e-aa60b30bd3f0 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.425681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.426459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.426903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.427286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] PATH_INFO: `/v3/users/35d6efe3e9524f628b367ac0306f110b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.429170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d6efe3e9524f628b367ac0306f110b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.436680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.438750 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1223/2434] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:20:59.441852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:59.469730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be464c-d3dc-4cbc-a074-96a67261845f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:20:59.481115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:20:59.488401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:20:59.489410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.489839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.490259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] PATH_INFO: `/v3/projects/05739e43d0dd44b89a23203d17cf894b/users/5f352afaab2a45a48e745382f78cae4b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.519725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05739e43d0dd44b89a23203d17cf894b, user_id=5f352afaab2a45a48e745382f78cae4b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:20:59.522678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16105-e9fa-44b8-8e4d-1cd640d3893d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:20:59.617780 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1224/2435] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:20:59 2022] PUT /identity/v3/projects/05739e43d0dd44b89a23203d17cf894b/users/5f352afaab2a45a48e745382f78cae4b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:20:59.638205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.638495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.638841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.716458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d6efe3e9524f628b367ac0306f110b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:59.719367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] MFA Rules not processed for user `5f352afaab2a45a48e745382f78cae4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:59.720197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d6efe3e9524f628b367ac0306f110b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:59.720593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:59.821952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d6efe3e9524f628b367ac0306f110b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:59.848434 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1225/2436] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:20:59.849574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:20:59.852740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:59.859201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d6efe3e9524f628b367ac0306f110b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:59.860842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-484dac83-6682-4cdb-9265-7830510705c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d6efe3e9524f628b367ac0306f110b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:20:59.888164 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1212/2437] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:20:59 2022] DELETE /identity/v3/users/35d6efe3e9524f628b367ac0306f110b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:20:59.898643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:20:59.902909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:20:59.902909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:20:59.925191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:20:59.926685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:20:59.976565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aaecd-0479-4de0-8b00-955b40c28015 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:00.070813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1213/2438] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:00.090470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:00.094328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:00.116316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:00.117615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:00.118064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:00.118510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:00.119391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:00.121771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:00.191289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef59e-099a-489a-963d-7504fbdd5b62 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:00.195398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:00.196283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:00.196625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:00.196900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:00.212694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:00.214557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:00.265391 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1226/2439] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:20:59 2022] POST /identity/v3/projects => generated 383 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:00.269197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:00.280821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1214/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:00.450243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd041-ded8-4965-9e08-237065fe190d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:00.458896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:00.459641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:00.459927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:00.460201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:00.461878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:00.465831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:00.584956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1227/2441] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:00 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:00.589144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:00.608701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64482c-ee48-409b-aab2-93e0c302a362 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:00.613573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:00.623295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:00.625525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:00.625525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:00.625525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:00.625525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:00.627946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:00.682146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1215/2442] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:00.688475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:00.710744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a72f-d681-4129-b664-6766a3410da9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:00.729388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:00.730197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:00.730300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:00.730959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] PATH_INFO: `/v3/projects/68da9ccc889040e1ae49f749a9516d01/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:00.762541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68da9ccc889040e1ae49f749a9516d01, user_id=dcd851ed7ceb423b8e02e1b7a4d1ed3c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:00.767256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:00.807049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:00.876112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1228/2443] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:00 2022] PUT /identity/v3/projects/68da9ccc889040e1ae49f749a9516d01/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:00.880566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:00.896075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb2d2e-a996-4419-8fd4-b43a0d0b33da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:01.068701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:01.068701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:01.068701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:01.068701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:01.069116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:01.070324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc867ac-03fb-4b63-8db5-0ae45e17024a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:01.083745 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1216/2444] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:01.092912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:01.120673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb39c2d-3979-4f43-bd69-37cccd026a89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:01.132078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:01.144116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:01.144116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:01.150418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] PATH_INFO: `/v3/projects/68da9ccc889040e1ae49f749a9516d01/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:01.159833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68da9ccc889040e1ae49f749a9516d01, user_id=dcd851ed7ceb423b8e02e1b7a4d1ed3c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:01.163662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:01.209154 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1229/2445] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:01 2022] PUT /identity/v3/projects/68da9ccc889040e1ae49f749a9516d01/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:01.228488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:01.229401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:01.230767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:01.274695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] MFA Rules not processed for user `dcd851ed7ceb423b8e02e1b7a4d1ed3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:01.276146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:01.414576 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1217/2446] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:01.564812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:01.692206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:01.865005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:01.866996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:02.070110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e45e9-9986-4006-960a-6fa06db28fd8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:02.090681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:02.091305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:02.091601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:02.091865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:02.121026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:02.145798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:02.159909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:02.175590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:02.189987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1230/2447] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:02.395825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3633d2-ea8d-4307-948e-814faa47a82d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:02.395825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:02.395825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:02.397802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:02.397802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] PATH_INFO: `/v3/projects/c71186f1881b447391dbe5db6e5efa3b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:02.397802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71186f1881b447391dbe5db6e5efa3b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:02.404106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:02.580972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71186f1881b447391dbe5db6e5efa3b', 'request_id': 'req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:02.689744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71186f1881b447391dbe5db6e5efa3b', 'request_id': 'req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:02.719480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71186f1881b447391dbe5db6e5efa3b', 'request_id': 'req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:02.751601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] The token cache is being invalidate because project c71186f1881b447391dbe5db6e5efa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:02.752146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:02.753139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:02.754786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1218/2448] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:02 2022] DELETE /identity/v3/projects/c71186f1881b447391dbe5db6e5efa3b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:02.758888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:02.782048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2625-ce35-4d10-a891-bb1bc6e74984 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:02.848128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:02.848644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:02.848932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:02.849206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] PATH_INFO: `/v3/users/0141fc930fd94bf08e7ac53e023dd28d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:02.850362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0141fc930fd94bf08e7ac53e023dd28d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:02.852347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:03.070960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0141fc930fd94bf08e7ac53e023dd28d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:03.071687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0141fc930fd94bf08e7ac53e023dd28d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:03.189533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0141fc930fd94bf08e7ac53e023dd28d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:03.211551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0141fc930fd94bf08e7ac53e023dd28d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:03.212379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0141fc930fd94bf08e7ac53e023dd28d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:03.233012 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1231/2449] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:02 2022] DELETE /identity/v3/users/0141fc930fd94bf08e7ac53e023dd28d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:03.419411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:03.787186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:03.900938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:03.902603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:03.934208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35ed0-1d43-433e-8a4f-8bce8dbc75b2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:04.047969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:04.049007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:04.053362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:04.053362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] PATH_INFO: `/v3/users/5f352afaab2a45a48e745382f78cae4b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:04.053362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f352afaab2a45a48e745382f78cae4b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:04.055925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:04.352852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f352afaab2a45a48e745382f78cae4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.356347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f352afaab2a45a48e745382f78cae4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.388519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:04.390173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:04.414504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebbb04-06ee-4bbe-86a0-a416b57a3211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:04.427270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:04.427922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:04.428457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:04.430756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] PATH_INFO: `/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:04.430756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d7adaff2b64cf1ae30d0e40fa21318)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:04.435763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:04.473967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f352afaab2a45a48e745382f78cae4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.497097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f352afaab2a45a48e745382f78cae4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.498060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ecdc5e2a-9728-48cf-99b6-75609314e1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f352afaab2a45a48e745382f78cae4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.528813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1219/2450] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:03 2022] DELETE /identity/v3/users/5f352afaab2a45a48e745382f78cae4b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:04.530222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:04.530519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:04.530818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:04.566744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:04.568332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:04.649392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d7adaff2b64cf1ae30d0e40fa21318', 'request_id': 'req-8472c95c-8a90-44c5-87fa-30d5ba5a7948'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.741541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d7adaff2b64cf1ae30d0e40fa21318', 'request_id': 'req-8472c95c-8a90-44c5-87fa-30d5ba5a7948'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.748139 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1220/2451] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:04.756059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d7adaff2b64cf1ae30d0e40fa21318', 'request_id': 'req-8472c95c-8a90-44c5-87fa-30d5ba5a7948'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.757460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:04.759910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:04.771884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] The token cache is being invalidate because project f4d7adaff2b64cf1ae30d0e40fa21318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:04.772667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.773479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8472c95c-8a90-44c5-87fa-30d5ba5a7948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:04.797433 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1232/2452] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:04 2022] DELETE /identity/v3/projects/f4d7adaff2b64cf1ae30d0e40fa21318 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:04.804656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479593-b231-4874-af21-98e1cea47ed8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:04.804858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479593-b231-4874-af21-98e1cea47ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:04.805009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479593-b231-4874-af21-98e1cea47ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:04.860280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62d4ae-a882-45cc-a40d-9454ced59a36 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:04.869349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47479593-b231-4874-af21-98e1cea47ed8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:04.870640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47479593-b231-4874-af21-98e1cea47ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:04.992715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:04.992715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:04.997952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:04.997952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.005865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:05.130235 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1233/2453] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:05.139217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:05.139520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:05.139784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.221616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:05.223645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:05.236732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:05.238180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:05.257344 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1234/2454] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:05.258330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:05.259933 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1221/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:05.292112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd34e0-9762-4ead-9bce-c215dcc82d19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:05.307704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:05.308112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:05.308401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:05.308680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.309330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:05.312976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:05.316227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:05.362971 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1235/2456] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:05.363911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:05.384937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae20-3295-4765-ac25-820d9068e613 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:05.417664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:05.418302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:05.418584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:05.418884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.425820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:05.433875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758234e-4dca-40e9-bbc6-46487b285cdd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:05.591316 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1222/2457] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:05 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:05.595706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:05.609258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459585e-f5d7-4c07-8143-fc0bc438d70d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:05.789072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:05.791324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:05.791837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:05.793115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.793976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:05.802610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:05.875711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:05.892068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc78b-014a-4493-8a57-0fc726126dd6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:05.892359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc78b-014a-4493-8a57-0fc726126dd6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:05.892637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc78b-014a-4493-8a57-0fc726126dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:05.949419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1f7cc78b-014a-4493-8a57-0fc726126dd6 None None] MFA Rules not processed for user `9e936cb29a634b9da2e4ba5e2901de6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:05.965987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1236/2458] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:05 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:05.966593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:05.967381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f7cc78b-014a-4493-8a57-0fc726126dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:05.996644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896ad19-0f86-463f-b43c-95214ff1a6f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.010231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.013744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.014037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.014312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.017871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:06.019634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:06.064021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1237/2459] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:06.065025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:06.090969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d168f-c6ce-4d76-8f72-50d9e4b7e775 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.116513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.117144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.118914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.119187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.120421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:06.126714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:06.161769 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1238/2460] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:06.166278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:06.184608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:06.198579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1223/2461] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:06.200216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.202287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.203003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.208731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f1e-f526-4dc1-9a46-67c4d9e80a0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.223256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.230697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.230697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.230697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] PATH_INFO: `/v3/projects/f7be95d8d24a4ae6aea721ea528dc4f1/users/362815f4862e42b5babc7248ab09aa84/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.274542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] MFA Rules not processed for user `9e936cb29a634b9da2e4ba5e2901de6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:06.275919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:06.280921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7be95d8d24a4ae6aea721ea528dc4f1, user_id=362815f4862e42b5babc7248ab09aa84, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:06.283848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b833d5-1c9a-4590-ba2d-fbd2773d3add admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:06.290846 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1224/2462] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:06.304240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:06.305813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:06.409037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1239/2463] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:06 2022] PUT /identity/v3/projects/f7be95d8d24a4ae6aea721ea528dc4f1/users/362815f4862e42b5babc7248ab09aa84/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:06.417586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.418050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.418730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.466590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:06.469895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:06.484879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e884158-eb98-4864-9f05-d5b9293e2634 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.621347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1240/2464] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:06.621347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:06.627672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:06.640623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.641540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.641828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.642102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.653949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99adc-2775-4286-bba5-e700a67880a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.660350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.664363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.665296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.666118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] PATH_INFO: `/v3/projects/05739e43d0dd44b89a23203d17cf894b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:06.668070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05739e43d0dd44b89a23203d17cf894b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:06.670010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:06.768979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:06.770929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:06.821435 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1225/2465] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:06.822493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:06.824795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:06.905484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e2026-43ff-40ea-848f-042cbd27eef4 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:06.910457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05739e43d0dd44b89a23203d17cf894b', 'request_id': 'req-6e0a18ae-7fff-4836-9951-0d3dc597d36e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:06.969717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:06.970390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:06.970732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:06.971015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:07.017583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05739e43d0dd44b89a23203d17cf894b', 'request_id': 'req-6e0a18ae-7fff-4836-9951-0d3dc597d36e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.028817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05739e43d0dd44b89a23203d17cf894b', 'request_id': 'req-6e0a18ae-7fff-4836-9951-0d3dc597d36e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.054816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] The token cache is being invalidate because project 05739e43d0dd44b89a23203d17cf894b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:07.067592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.069617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.071705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1241/2466] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:06 2022] DELETE /identity/v3/projects/05739e43d0dd44b89a23203d17cf894b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:07.075769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:07.077632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:07.087880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:07.091271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:07.105971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a18ae-7fff-4836-9951-0d3dc597d36e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:07.112189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:07.113381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:07.116465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:07.116465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] PATH_INFO: `/v3/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:07.116465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd851ed7ceb423b8e02e1b7a4d1ed3c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:07.117718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:07.126246 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1226/2467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:07.390273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd851ed7ceb423b8e02e1b7a4d1ed3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.391021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd851ed7ceb423b8e02e1b7a4d1ed3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.507573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd851ed7ceb423b8e02e1b7a4d1ed3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.536714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd851ed7ceb423b8e02e1b7a4d1ed3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.537533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-452247d2-ca0d-42b3-88b1-dbd276b7565f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd851ed7ceb423b8e02e1b7a4d1ed3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:07.633610 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1242/2468] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:07 2022] DELETE /identity/v3/users/dcd851ed7ceb423b8e02e1b7a4d1ed3c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:07.887609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:08.667703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:08.681132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce503-2dae-4e23-b824-669670de6c4d service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:08.778485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:08.879127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:08.887872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:08.888538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:08.888818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:08.889090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] PATH_INFO: `/v3/projects/68da9ccc889040e1ae49f749a9516d01` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:08.891675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68da9ccc889040e1ae49f749a9516d01)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:08.902920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:09.519996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68da9ccc889040e1ae49f749a9516d01', 'request_id': 'req-f8321246-9800-4174-9f7d-b9dc684c4186'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:09.688034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68da9ccc889040e1ae49f749a9516d01', 'request_id': 'req-f8321246-9800-4174-9f7d-b9dc684c4186'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:09.701463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68da9ccc889040e1ae49f749a9516d01', 'request_id': 'req-f8321246-9800-4174-9f7d-b9dc684c4186'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:09.778466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] The token cache is being invalidate because project 68da9ccc889040e1ae49f749a9516d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:09.778466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:09.779041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f8321246-9800-4174-9f7d-b9dc684c4186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:09.782338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1227/2469] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:08 2022] DELETE /identity/v3/projects/68da9ccc889040e1ae49f749a9516d01 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:09.787532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:09.787813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:09.788082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:09.825083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:09.826555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:09.947266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1243/2470] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:09.955506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:09.955840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:09.956110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:09.980096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:09.992666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:10.022710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.032097 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1228/2471] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:10.034511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee57ad-bba9-46c5-b26b-6bb7ea35ce0e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.048238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.049149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.049602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.050069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.050948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:10.051419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.053315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:10.095705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1244/2472] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:10.099256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.112739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b0f0-7817-4ca1-9d82-907be20699f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.137672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.139574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.140052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.140473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.141261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.149062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:10.363226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.368557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1229/2473] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:10 2022] POST /identity/v3/projects => generated 393 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:10.376009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462fac-6b31-4aab-a37d-376e003142a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.547057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.547934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.548956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.549441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.550816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.553868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:10.680415 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1245/2474] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:10 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:21:10.685616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.702369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6664-86eb-4b6c-ae10-09574633beed admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.715447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.716414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.716973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.717485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.718346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.723485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:10.737811 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1230/2475] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:10.741787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.756161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d9b5-76b9-4c53-85c4-9c44a309d268 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.776167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.777314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.777592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.777860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.778512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.798091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c468db-cf12-492b-96fb-e4f93e8911f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:10.862334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1246/2476] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:10.866878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:10.884949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d0f8-29d4-4df0-b8d0-98a674b2e6c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:10.903062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:10.908479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:10.909346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:10.909796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] PATH_INFO: `/v3/projects/d57f8578f4084c12bf6c7ebd6e6cc783/users/17385e428fb04e75aa4ba9559a329976/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:10.967234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57f8578f4084c12bf6c7ebd6e6cc783, user_id=17385e428fb04e75aa4ba9559a329976, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:10.970718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:11.091400 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1231/2477] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:10 2022] PUT /identity/v3/projects/d57f8578f4084c12bf6c7ebd6e6cc783/users/17385e428fb04e75aa4ba9559a329976/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:11.109735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:11.111896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:11.112426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:11.160989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:11.207198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] MFA Rules not processed for user `17385e428fb04e75aa4ba9559a329976`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:11.225787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:11.422759 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1247/2478] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:11.427754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:11.632055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a3870-9b48-497e-99cd-4ba0cf5c6fd2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:11.644038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:11.644661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:11.644942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:11.645212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:11.646009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:11.648026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:11.696480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:11.834496 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1232/2479] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:11 2022] POST /identity/v3/projects => generated 391 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:21:11.837126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:11.855656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed93d8-cb41-438d-a9b6-5d44ea1f6692 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:12.076932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:12.078871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.081176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.081176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:12.082980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:12.089853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:12.245238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1248/2480] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:11 2022] POST /identity/v3/users => generated 302 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:12.246133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:12.266502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6caabe-17cd-47f0-92a1-7d60376078da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:12.273873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:12.275429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.279560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.279560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:12.279560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:12.281110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:12.299188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1233/2481] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:21:12.304846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:12.321366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67c7bf-44a6-4b1d-8e48-5e982d9c7514 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:12.328149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:12.329647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.330119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.330538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] PATH_INFO: `/v3/projects/f4c84a94e65349bb87826b8c21b660d3/users/5fc3995722f141689017efe92b735ff7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:12.381071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c84a94e65349bb87826b8c21b660d3, user_id=5fc3995722f141689017efe92b735ff7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:12.384396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:12.499500 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1249/2482] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:12 2022] PUT /identity/v3/projects/f4c84a94e65349bb87826b8c21b660d3/users/5fc3995722f141689017efe92b735ff7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:12.503668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:12.532159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8f8a-db5f-461e-8cab-48280dcff5fe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:12.799908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:12.801995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.801995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.802610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:12.803468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:12.806068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6c7e-ca29-4ac5-acd5-c86623bcc3b1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:12.840454 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1234/2483] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:12.844778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:12.863590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6cd5-d9a5-4c92-ad02-f5399efb4318 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:12.884069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:12.884905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.887293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.891284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] PATH_INFO: `/v3/projects/f4c84a94e65349bb87826b8c21b660d3/users/5fc3995722f141689017efe92b735ff7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:12.898062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c84a94e65349bb87826b8c21b660d3, user_id=5fc3995722f141689017efe92b735ff7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:12.911158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:12.943043 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1250/2484] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:12 2022] PUT /identity/v3/projects/f4c84a94e65349bb87826b8c21b660d3/users/5fc3995722f141689017efe92b735ff7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:12.954837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:12.958985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:12.959374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:13.131693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] MFA Rules not processed for user `5fc3995722f141689017efe92b735ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:13.138854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:13.396977 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1235/2485] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:13.414412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:13.419310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:13.621869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4593fe-d0fb-4c5b-9c17-7255b638ad0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:13.659645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:13.660287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:13.662991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:13.663284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:13.691397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:13.704224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891a04-17fd-497f-b2af-8bd178677ad0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:13.780131 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1251/2486] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:13.839186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:14.303797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:14.390410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:14.544019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b989-c771-4c38-9543-6d05cba2c70f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:14.551771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:14.554753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:14.554753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:14.554753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] PATH_INFO: `/v3/users/17385e428fb04e75aa4ba9559a329976` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:14.555225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17385e428fb04e75aa4ba9559a329976)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:14.558520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:14.954740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17385e428fb04e75aa4ba9559a329976'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:14.965925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17385e428fb04e75aa4ba9559a329976'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:15.072274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17385e428fb04e75aa4ba9559a329976'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:15.099291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17385e428fb04e75aa4ba9559a329976'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:15.100075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17385e428fb04e75aa4ba9559a329976'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:15.122475 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1236/2487] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:14 2022] DELETE /identity/v3/users/17385e428fb04e75aa4ba9559a329976 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:15.130455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:15.131036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:15.133466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:15.195010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:15.197963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:15.388295 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1252/2488] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:15.433302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:15.436007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:15.561454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125fc08-8831-4e34-bc0d-2fb55b2c665d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:15.571945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:15.573064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:15.573343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:15.573732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:15.599496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:15.601077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:15.626302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1237/2489] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:16.137342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:16.506260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:17.027391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:17.806017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:18.942896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:18.943432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:18.943432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:18.981290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8bd83-64b0-4467-9227-3f62e3a9ffef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:19.027399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:19.032404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:19.032725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:19.033007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] PATH_INFO: `/v3/projects/d57f8578f4084c12bf6c7ebd6e6cc783` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:19.043117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57f8578f4084c12bf6c7ebd6e6cc783)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:19.053057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:19.055520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:19.358295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57f8578f4084c12bf6c7ebd6e6cc783', 'request_id': 'req-1e20c55f-20d2-4725-98ac-2c33a021d53b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:19.588521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57f8578f4084c12bf6c7ebd6e6cc783', 'request_id': 'req-1e20c55f-20d2-4725-98ac-2c33a021d53b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:19.597606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57f8578f4084c12bf6c7ebd6e6cc783', 'request_id': 'req-1e20c55f-20d2-4725-98ac-2c33a021d53b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:19.637161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] The token cache is being invalidate because project d57f8578f4084c12bf6c7ebd6e6cc783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:19.641869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:19.642949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:19.648936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:19.654821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1253/2490] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:18 2022] DELETE /identity/v3/projects/d57f8578f4084c12bf6c7ebd6e6cc783 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:19.664961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9dc82-30b8-4c76-a38c-022f73cbf566 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:19.919061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:19.919722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:19.925614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:19.926243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] PATH_INFO: `/v3/users/5fc3995722f141689017efe92b735ff7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:19.934253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc3995722f141689017efe92b735ff7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:19.945731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:20.434209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc3995722f141689017efe92b735ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:20.435661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc3995722f141689017efe92b735ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:20.595839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc3995722f141689017efe92b735ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:20.624506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc3995722f141689017efe92b735ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:20.625617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2096cb93-1502-4477-b3d0-b2c6cdd5b83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc3995722f141689017efe92b735ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:20.640561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1238/2491] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:19 2022] DELETE /identity/v3/users/5fc3995722f141689017efe92b735ff7 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:21.290871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:22.137364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:22.476126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:22.477883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:22.500184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c55f-20d2-4725-98ac-2c33a021d53b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:22.598390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:22.598390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:22.598390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:22.654991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] MFA Rules not processed for user `362815f4862e42b5babc7248ab09aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:22.656269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:22.701380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:22.702295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:22.703041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:22.703525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] PATH_INFO: `/v3/projects/f4c84a94e65349bb87826b8c21b660d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:22.705541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c84a94e65349bb87826b8c21b660d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:22.709125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:22.794962 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1239/2492] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:22.799562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:22.801506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:22.826169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aca24-daec-4258-a82a-6807cfee1658 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:22.833939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:22.834558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:22.834977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:22.835247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:22.835887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:22.838448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:22.897800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c84a94e65349bb87826b8c21b660d3', 'request_id': 'req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:23.008559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1240/2493] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:22 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:23.012679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.029930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c84a94e65349bb87826b8c21b660d3', 'request_id': 'req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:23.040182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c84a94e65349bb87826b8c21b660d3', 'request_id': 'req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:23.079893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] The token cache is being invalidate because project f4c84a94e65349bb87826b8c21b660d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:23.079893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:23.084033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f020846-0d34-4e60-ab22-9e2b5dbc4a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:23.084033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1254/2494] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:22 2022] DELETE /identity/v3/projects/f4c84a94e65349bb87826b8c21b660d3 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:23.086950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b36a5a-c4e8-49e4-b311-b0230aff95c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.087234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b36a5a-c4e8-49e4-b311-b0230aff95c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.088090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b36a5a-c4e8-49e4-b311-b0230aff95c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.207375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0b36a5a-c4e8-49e4-b311-b0230aff95c6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:23.208631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0b36a5a-c4e8-49e4-b311-b0230aff95c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:23.229841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae290-2323-44eb-8b86-f1c719e025fc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.242280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1255/2495] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:23.242965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.242965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.242965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.242965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.243313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.243938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.244227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.244498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.246103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.276020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:23.278296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:23.291349 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1256/2496] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:23.292270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.302915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:23.303317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12c30e-14d4-4062-8635-73e15cc445bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.312313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.312313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.312313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.312313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.312771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:23.312771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.312925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.344213 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1241/2497] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:23 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:21:23.345170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.346988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:23.354787 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1257/2498] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:23.355796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.363473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a5b-9558-473f-b2d1-8f37e46be8a2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.369639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.370312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.370680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.378365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.378365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.378365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.381937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc177-42ef-413a-9c7f-0a2a928a3e54 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.391076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1242/2499] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:23.395262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.408583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.408843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936ce2-0aa7-493f-b09b-5b31a11814db admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.409208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.409495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.409836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.411045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.418485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.418656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.418656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.418656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.418656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] PATH_INFO: `/v3/projects/646c7cfdde1045a5b69bdd69a57609aa/users/33362a8885944015801ad18a3885bc17/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.453574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646c7cfdde1045a5b69bdd69a57609aa, user_id=33362a8885944015801ad18a3885bc17, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.456565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.542692 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1258/2500] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:23 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:23.546810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.575410 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1243/2501] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:23 2022] PUT /identity/v3/projects/646c7cfdde1045a5b69bdd69a57609aa/users/33362a8885944015801ad18a3885bc17/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:23.579626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.642123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036754a1-a947-4870-9fce-d64d33ebceac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.652724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76fb72-2dcc-476e-ba0f-dd90d1aec009 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.662508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.667240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.667240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.667240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.667240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.667240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.680485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1244/2502] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:23.685312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.695867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d337c-be51-46b1-b422-a76c207fef6e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.704399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.704666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.704931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.705209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] PATH_INFO: `/v3/projects/646c7cfdde1045a5b69bdd69a57609aa/users/33362a8885944015801ad18a3885bc17/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.711168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646c7cfdde1045a5b69bdd69a57609aa, user_id=33362a8885944015801ad18a3885bc17, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.715605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.723113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.724740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.725067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.725347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.726082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.728629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.736661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1245/2503] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:23 2022] PUT /identity/v3/projects/646c7cfdde1045a5b69bdd69a57609aa/users/33362a8885944015801ad18a3885bc17/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:23.842233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1259/2504] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:23 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:23.843306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.951860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144d9c-3496-4b4f-a137-e356244f4491 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:23.958430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:23.959199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:23.959637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:23.959991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:23.961078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:23.962810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:23.976419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1246/2505] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:21:23.980754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:23.996466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b75be-29de-4533-96c0-10cfce615324 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:24.003001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:24.003650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.003932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.004277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.004905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:24.006662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c1f91-2c21-4285-851a-fdd30d9e7842 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:24.026727 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1260/2506] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:24.027924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:24.040469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b594c-7c7b-49ea-8f74-bcc80a99a075 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:24.047436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:24.048868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.049571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.050039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] PATH_INFO: `/v3/projects/5ad2d8fc3fbb48c095455d09edf9547e/users/5a5d13261088446f87da9577c0f4cc80/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.078065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad2d8fc3fbb48c095455d09edf9547e, user_id=5a5d13261088446f87da9577c0f4cc80, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:24.081309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:24.172402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1247/2507] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:24 2022] PUT /identity/v3/projects/5ad2d8fc3fbb48c095455d09edf9547e/users/5a5d13261088446f87da9577c0f4cc80/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:24.186054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.186337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.186643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.240525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] MFA Rules not processed for user `5a5d13261088446f87da9577c0f4cc80`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:24.241948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:24.362881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1261/2508] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:24.366023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:24.417671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:24.441045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400e93-ef7d-4bcc-be78-17b90efeb9ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:24.447953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:24.448911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.449338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.450165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.450467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:24.459009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:24.605216 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1248/2509] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:24 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:24.605828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:24.637082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee439c-0766-456f-b133-036b8ed498bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:24.755024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:24.770703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:24.781220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.781582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.782590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.785221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:24.787454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:24.898739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1262/2510] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:24 2022] POST /identity/v3/users => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:24.903578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:24.919444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9e1dd-7496-4841-a827-c4cbc7a5a473 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:24.948202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:24.950953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:24.951509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:24.951951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:24.954163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:24.959249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:24.988467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1249/2511] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:24.992132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:25.006388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382e51e-376a-4026-ac11-2d99b0ffc915 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:25.020792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:25.021709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:25.022193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:25.022657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] PATH_INFO: `/v3/projects/94733d8c680e41d69b419f0ceab54e55/users/11fe64ec5f6a4a92b6a3651dd9af34f1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:25.060684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94733d8c680e41d69b419f0ceab54e55, user_id=11fe64ec5f6a4a92b6a3651dd9af34f1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:25.069443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:25.197574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1263/2512] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:24 2022] PUT /identity/v3/projects/94733d8c680e41d69b419f0ceab54e55/users/11fe64ec5f6a4a92b6a3651dd9af34f1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:25.202049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:25.220191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894e76-b3c9-4692-bf9c-081469a76a22 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:25.386329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:25.388361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:25.389947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:25.396545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:25.396545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:25.396545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df143b-33f6-4f06-9e9c-1edd440d30a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:25.417452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:25.426016 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1250/2513] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:25.431972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e477d-f361-4c4b-9605-fc090b8e7167 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:25.439767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:25.440773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:25.441418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:25.441942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] PATH_INFO: `/v3/projects/94733d8c680e41d69b419f0ceab54e55/users/11fe64ec5f6a4a92b6a3651dd9af34f1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:25.444426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94733d8c680e41d69b419f0ceab54e55, user_id=11fe64ec5f6a4a92b6a3651dd9af34f1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:25.449711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:25.499945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:25.500496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:25.500963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:25.506642 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1264/2514] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:25 2022] PUT /identity/v3/projects/94733d8c680e41d69b419f0ceab54e55/users/11fe64ec5f6a4a92b6a3651dd9af34f1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:25.557769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] MFA Rules not processed for user `11fe64ec5f6a4a92b6a3651dd9af34f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:25.560431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:25.617380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:25.662953 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1251/2515] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:25.671372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:25.673397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:25.826708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1f6e-355d-44e3-a207-6e6c4f451784 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:25.833451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:25.834328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:25.834806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:25.835263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:25.866858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:25.870931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f7608-e4ac-4e17-a1f9-7f7327df0698 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:25.902077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1265/2516] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:26.448598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:26.585781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d621f2-8055-479d-814a-6e680013e949 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:26.593500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:26.594431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:26.595118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:26.595582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] PATH_INFO: `/v3/users/5a5d13261088446f87da9577c0f4cc80` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:26.596982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5d13261088446f87da9577c0f4cc80)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:26.599614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:26.740635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:26.888764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5d13261088446f87da9577c0f4cc80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:26.890054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5d13261088446f87da9577c0f4cc80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:27.017231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5d13261088446f87da9577c0f4cc80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:27.040257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5d13261088446f87da9577c0f4cc80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:27.041786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5d13261088446f87da9577c0f4cc80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:27.060258 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1252/2517] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:26 2022] DELETE /identity/v3/users/5a5d13261088446f87da9577c0f4cc80 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:27.064723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:27.065235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:27.065235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:27.094293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:27.101521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:27.187166 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1266/2518] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:27.199101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:27.200143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:27.320169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:27.352454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7787e-1fe8-454a-b9c3-4e6d7213f20b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:27.357474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:27.360698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:27.361174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:27.361642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:27.376001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:27.379059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:27.420749 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1253/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:28.471480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:28.473066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:28.486383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f953-ae80-4040-93a5-f665043abcaa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:28.497640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:28.497640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:28.497640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:28.497640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] PATH_INFO: `/v3/projects/5ad2d8fc3fbb48c095455d09edf9547e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:28.498933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad2d8fc3fbb48c095455d09edf9547e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:28.498933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:28.720530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad2d8fc3fbb48c095455d09edf9547e', 'request_id': 'req-06877d7e-19e1-4e77-b9a0-3c422b435250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:28.808223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad2d8fc3fbb48c095455d09edf9547e', 'request_id': 'req-06877d7e-19e1-4e77-b9a0-3c422b435250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:28.817205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad2d8fc3fbb48c095455d09edf9547e', 'request_id': 'req-06877d7e-19e1-4e77-b9a0-3c422b435250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:28.854011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] The token cache is being invalidate because project 5ad2d8fc3fbb48c095455d09edf9547e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:28.854308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:28.854996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:28.857008 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1267/2520] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:28 2022] DELETE /identity/v3/projects/5ad2d8fc3fbb48c095455d09edf9547e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:28.860832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:28.875149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bc05-bbcd-49de-a5cb-7d6871906887 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:28.989299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:28.990060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:28.990342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:28.990636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] PATH_INFO: `/v3/users/11fe64ec5f6a4a92b6a3651dd9af34f1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:28.992089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fe64ec5f6a4a92b6a3651dd9af34f1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:28.995014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:29.106473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:29.288461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:29.289765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fe64ec5f6a4a92b6a3651dd9af34f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:29.291297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fe64ec5f6a4a92b6a3651dd9af34f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:29.414760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fe64ec5f6a4a92b6a3651dd9af34f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:29.436760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fe64ec5f6a4a92b6a3651dd9af34f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:29.437876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-677bfc2c-9556-4dac-8b60-3d19084f716b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fe64ec5f6a4a92b6a3651dd9af34f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:29.468968 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1254/2521] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:28 2022] DELETE /identity/v3/users/11fe64ec5f6a4a92b6a3651dd9af34f1 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:30.179955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:30.184088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:30.210435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06877d7e-19e1-4e77-b9a0-3c422b435250 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:30.290709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:30.291359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:30.291937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:30.292577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] PATH_INFO: `/v3/projects/94733d8c680e41d69b419f0ceab54e55` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:30.294756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94733d8c680e41d69b419f0ceab54e55)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:30.298100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:30.515333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94733d8c680e41d69b419f0ceab54e55', 'request_id': 'req-42376474-d1b2-4682-a114-e2c1a3d56dbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:30.654842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94733d8c680e41d69b419f0ceab54e55', 'request_id': 'req-42376474-d1b2-4682-a114-e2c1a3d56dbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:30.662576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94733d8c680e41d69b419f0ceab54e55', 'request_id': 'req-42376474-d1b2-4682-a114-e2c1a3d56dbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:30.712519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] The token cache is being invalidate because project 94733d8c680e41d69b419f0ceab54e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:30.718639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:30.719666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42376474-d1b2-4682-a114-e2c1a3d56dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:30.722502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1268/2522] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:30 2022] DELETE /identity/v3/projects/94733d8c680e41d69b419f0ceab54e55 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:30.727345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:30.728841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:30.729288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:30.775124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:30.776649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:30.966472 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1255/2523] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:30.976187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:30.976187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:30.976187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.028413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:31.036837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:31.059736 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1269/2524] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:31.067072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.090629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42d44-a136-4ca6-aa08-046c45c3e187 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.126216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.129472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.129472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.129472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.129472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:31.129472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.130738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:31.159387 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1256/2525] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:31.170210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.193105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca6aff-b054-4b3e-b29f-458da0143ec6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.205706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:31.245149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.246034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.246478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.247031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.248427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.253980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:31.401953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:31.503573 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1270/2526] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:31 2022] POST /identity/v3/projects => generated 409 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:31.506071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.520637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b710df-a926-4aea-a538-900f703912d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.707457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.707457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.707457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.707457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.708144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.708144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:31.769961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.770322 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1257/2527] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:31 2022] POST /identity/v3/users => generated 305 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:31.793070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840ed0-6561-4c44-9a58-0e125123c6ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.799998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.800774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.801192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.801552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.802283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.804331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:31.816690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1271/2528] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:31.834439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.835015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51532206-61fb-46a9-a9b0-3c9387b82ad4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.842294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.843099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.843385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.843648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.845183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.847100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c739d-e4ca-4b57-9398-045a25df4d4f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:31.875578 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1258/2529] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:31.877088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:31.891820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32f609-8271-44fd-80de-f6075e4d6ac9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:31.894995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:31.896565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:31.896924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:31.897156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] PATH_INFO: `/v3/projects/257a3702e8c34dd392e3f04ab9020479/users/d24dc1baad2e43f3886398aa2ffd3d12/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:31.920999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257a3702e8c34dd392e3f04ab9020479, user_id=d24dc1baad2e43f3886398aa2ffd3d12, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:31.923634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:32.064176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1272/2530] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:31 2022] PUT /identity/v3/projects/257a3702e8c34dd392e3f04ab9020479/users/d24dc1baad2e43f3886398aa2ffd3d12/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:32.065881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:32.066488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:32.066984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:32.140035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] MFA Rules not processed for user `d24dc1baad2e43f3886398aa2ffd3d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:32.142356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:32.257203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1259/2531] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:32.257634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:32.354550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebeb4c-bb5c-48af-b029-8e1fe3ea25e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:32.372006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:32.373539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:32.373539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:32.374226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:32.375119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:32.377873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b229e-3dac-4176-bc6c-2d1befd64a90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:32.532588 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1273/2532] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:32 2022] POST /identity/v3/projects => generated 409 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:32.533564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:32.575403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9dcef-dac2-46cf-82c8-009c7414d2bb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:32.683805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:32.684106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:32.684588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:32.745054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:32.747833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:32.753386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:32.754969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:32.755452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:32.755936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:32.756886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:32.760451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:32.839974 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1274/2533] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:32.854264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:32.859155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:32.913245 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1260/2534] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:32 2022] POST /identity/v3/users => generated 311 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:21:32.917964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:32.929627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f255b14-23ea-433f-9771-8c5c8ed67bb7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:32.934769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:32.935293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:32.935576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:32.936292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:32.936951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:32.938655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:32.951576 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1261/2535] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:21:32.956021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:32.976166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0bf53-ae06-4236-9109-506c3f4d82b5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:33.007837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa18f-b2c9-4bb5-aab2-7a3b49cc8b06 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:33.010284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:33.010994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.011278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.011832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] PATH_INFO: `/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2/users/b0bcff2cb17943b3a7099ff9837db62d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.015625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:33.016303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.016795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.017084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.035867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:33.041444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:33.048734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2ceafe18ef46fc9eeb959c2b49f0f2, user_id=b0bcff2cb17943b3a7099ff9837db62d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:33.051556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:33.057584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1275/2536] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:21:33.200329 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1262/2537] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:32 2022] PUT /identity/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2/users/b0bcff2cb17943b3a7099ff9837db62d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:33.204566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:33.219234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602a21-739e-4fa0-b64b-da8e07efc91f service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:33.349312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:33.350135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.350252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.350515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.351240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:33.353011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791e92-e1dd-42bd-8e46-d73cb9dee4e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:33.378024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1276/2538] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:33.382482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:33.402176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b0b-a014-4470-8cde-27c396fdf990 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:33.415138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:33.416326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.416822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.417411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] PATH_INFO: `/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2/users/b0bcff2cb17943b3a7099ff9837db62d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.424639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2ceafe18ef46fc9eeb959c2b49f0f2, user_id=b0bcff2cb17943b3a7099ff9837db62d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:33.427943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc16d0b-8674-443b-b182-1b72e53be660 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:33.458669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1263/2539] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:33 2022] PUT /identity/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2/users/b0bcff2cb17943b3a7099ff9837db62d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:33.469379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.469960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.470514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.540632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] MFA Rules not processed for user `b0bcff2cb17943b3a7099ff9837db62d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:33.542240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:33.659538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:33.661227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:33.665328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:33.723006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] MFA Rules not processed for user `33362a8885944015801ad18a3885bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:33.726462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:33.781720 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1277/2540] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:33.847314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1264/2541] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:33.863398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:33.865435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:33.937553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:33.984787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:33.987167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:34.004326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:34.010253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17db11-0861-421d-bfc5-ce1177bb9874 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:34.014685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:34.016073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:34.016495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:34.016960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:34.047924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:34.050065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:34.081563 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1278/2542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:34.149093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af9a7-6c52-4ae9-8d83-e49126676950 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:34.171901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:34.172680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:34.173046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:34.173319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:34.187971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:34.191499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:34.211392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1265/2543] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:34.324869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:34.326323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:34.365004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641502d-6a5c-4741-b674-2312a892947a service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:34.378183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:34.379289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:34.379767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:34.380251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:34.499408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:34.503050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694340-284d-45da-871e-f7aec96b73c3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:34.515586 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1279/2544] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:34.811855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:35.423548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:35.838390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:36.171569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:36.553149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:36.779377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0737d8-899e-4130-8010-ce5593a8c7dd service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:36.801202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:36.802301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:36.804014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:36.804569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] PATH_INFO: `/v3/users/d24dc1baad2e43f3886398aa2ffd3d12` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:36.830014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24dc1baad2e43f3886398aa2ffd3d12)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:36.837974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:37.210663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24dc1baad2e43f3886398aa2ffd3d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:37.215034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24dc1baad2e43f3886398aa2ffd3d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:37.359058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24dc1baad2e43f3886398aa2ffd3d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:37.381517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24dc1baad2e43f3886398aa2ffd3d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:37.385862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24dc1baad2e43f3886398aa2ffd3d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:37.462724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1266/2545] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:36 2022] DELETE /identity/v3/users/d24dc1baad2e43f3886398aa2ffd3d12 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:37.463445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:37.465204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:37.465677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:37.549808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:37.552304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:37.791752 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1280/2546] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:37.818356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:37.820584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:38.035165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d95e1-2474-4697-8b90-e85d592f9fe2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:38.058486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:38.059155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:38.059464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:38.060862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:38.079904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:38.081315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:38.105338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1267/2547] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:38.330463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:38.480202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:39.584803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:39.587953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:39.644466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d04e0f-3858-4770-be4a-1b7578c99a68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:39.667229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:39.668928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:39.670609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:39.671800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] PATH_INFO: `/v3/projects/257a3702e8c34dd392e3f04ab9020479` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:39.694155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=257a3702e8c34dd392e3f04ab9020479)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:39.733927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:39.960218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:39.992791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257a3702e8c34dd392e3f04ab9020479', 'request_id': 'req-b4f35762-f90f-4455-92d2-0bda15e6c9fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.130276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257a3702e8c34dd392e3f04ab9020479', 'request_id': 'req-b4f35762-f90f-4455-92d2-0bda15e6c9fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.141418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257a3702e8c34dd392e3f04ab9020479', 'request_id': 'req-b4f35762-f90f-4455-92d2-0bda15e6c9fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.164458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] The token cache is being invalidate because project 257a3702e8c34dd392e3f04ab9020479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:40.164925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.165740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.170148 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1281/2548] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:39 2022] DELETE /identity/v3/projects/257a3702e8c34dd392e3f04ab9020479 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:40.176050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:40.190556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8fa11-0a3c-4307-a2b7-b27d3c70386e service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:40.237114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:40.367576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:40.368880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:40.369268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:40.369646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] PATH_INFO: `/v3/users/b0bcff2cb17943b3a7099ff9837db62d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:40.371603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bcff2cb17943b3a7099ff9837db62d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:40.378063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:40.745278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bcff2cb17943b3a7099ff9837db62d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.747102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bcff2cb17943b3a7099ff9837db62d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.839334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bcff2cb17943b3a7099ff9837db62d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.898170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bcff2cb17943b3a7099ff9837db62d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.899496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c48ea419-64ad-4396-bd0c-cb1d14475b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bcff2cb17943b3a7099ff9837db62d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:40.943558 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1268/2549] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:40 2022] DELETE /identity/v3/users/b0bcff2cb17943b3a7099ff9837db62d => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:41.409241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:41.972106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:42.618976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:42.623191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:42.680642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f35762-f90f-4455-92d2-0bda15e6c9fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:43.032013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:43.032798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:43.033083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:43.033426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] PATH_INFO: `/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:43.040809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2ceafe18ef46fc9eeb959c2b49f0f2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:43.050707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:43.260330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:43.294556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2ceafe18ef46fc9eeb959c2b49f0f2', 'request_id': 'req-4768eb32-bdbf-43d3-b729-5042eef0deb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:43.376282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2ceafe18ef46fc9eeb959c2b49f0f2', 'request_id': 'req-4768eb32-bdbf-43d3-b729-5042eef0deb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:43.376599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:43.384839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2ceafe18ef46fc9eeb959c2b49f0f2', 'request_id': 'req-4768eb32-bdbf-43d3-b729-5042eef0deb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:43.415124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] The token cache is being invalidate because project 5e2ceafe18ef46fc9eeb959c2b49f0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:43.416266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:43.417344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4768eb32-bdbf-43d3-b729-5042eef0deb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:43.421013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1282/2550] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:42 2022] DELETE /identity/v3/projects/5e2ceafe18ef46fc9eeb959c2b49f0f2 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:43.425853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:43.426418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:43.426869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:43.556596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:43.567994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:43.899235 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1269/2551] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:44.016267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:44.016841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:44.016841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:44.095622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:44.096915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:44.146980 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1283/2552] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:44.150820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:44.174714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5457b-aee1-42ce-9ae9-b15fcf8bbddb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:44.189553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:44.191725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:44.192447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:44.208932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:44.218237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:44.224512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:44.235111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:44.275782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1270/2553] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:44.276215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:44.285510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e51a1-b6f4-4fbb-b870-d8fb64e8579f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:44.327537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:44.328258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:44.328850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:44.328956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:44.329792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:44.340682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:44.417586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:44.588701 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1284/2554] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:44 2022] POST /identity/v3/projects => generated 359 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:44.589842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:44.612568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1e40d-db8a-466a-9bd2-4347f8745f84 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:44.802911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:44.803792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:44.804335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:44.805418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:44.806212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:44.808393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:44.918758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1271/2555] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:44 2022] POST /identity/v3/users => generated 280 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:44.926832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:44.945900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c29714-be40-4f72-bb64-1afb9580b2e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:44.955922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:44.957158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:44.957513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:44.957945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:44.958598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:44.962173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:45.005224 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1285/2556] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:45.010504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:45.025609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97eee-255a-4398-975e-202b4170a9fc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:45.039151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:45.047917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:45.047917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:45.047917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:45.047917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:45.047917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9d11a-a179-4efd-bad7-64db06d53c69 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:45.080185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1272/2557] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:45.081360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:45.092701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667961-21ea-4796-837c-b7925268eb66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:45.116892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:45.118357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:45.118986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:45.119412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] PATH_INFO: `/v3/projects/f40cb0105e6f46888fd1f8531d8cb081/users/d91a7dd3eca84a6182caf479f91e155d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:45.152542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40cb0105e6f46888fd1f8531d8cb081, user_id=d91a7dd3eca84a6182caf479f91e155d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:45.157270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:45.256682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1286/2558] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:45 2022] PUT /identity/v3/projects/f40cb0105e6f46888fd1f8531d8cb081/users/d91a7dd3eca84a6182caf479f91e155d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:45.269892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:45.270340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:45.270812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:45.340817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] MFA Rules not processed for user `d91a7dd3eca84a6182caf479f91e155d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:45.342089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:45.548623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1273/2559] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:45.551332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:45.673712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:45.681883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6218a-36d7-4580-88da-8d68b83a1459 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:45.709876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:45.712685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:45.712685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:45.712685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:45.712685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:45.714341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:45.942697 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1287/2560] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:45 2022] POST /identity/v3/projects => generated 359 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:45.943858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:45.963706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cc96-13c2-40df-9d94-5c2583b8e931 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:46.333695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:46.335863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:46.341228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:46.343458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:46.372053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:46.379001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:46.647998 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1274/2561] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:45 2022] POST /identity/v3/users => generated 286 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:46.650766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:46.676650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7bedc-90b4-418a-ac08-ff5d598559c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:46.706603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:46.721372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:46.721372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:46.721372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:46.721372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:46.732836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:46.767274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:46.768023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1288/2562] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:46.782276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df0e3d-3708-4610-9a9c-bd4797f2ce42 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:46.795758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:46.796835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:46.797347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:46.797860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] PATH_INFO: `/v3/projects/fd517caa35c14936ab23fc1735598ede/users/3f3e9669dc1c4fe2a9abcffabf331d49/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:46.893633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd517caa35c14936ab23fc1735598ede, user_id=3f3e9669dc1c4fe2a9abcffabf331d49, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:46.897239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:47.074867 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1275/2563] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:46 2022] PUT /identity/v3/projects/fd517caa35c14936ab23fc1735598ede/users/3f3e9669dc1c4fe2a9abcffabf331d49/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:47.075029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:47.095397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2658ed2-4e90-429b-a772-6a392c53a12e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:47.179641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:47.321815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:47.324225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:47.324689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:47.327084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:47.327960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:47.333274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090541b9-b296-4c75-80f4-770d1dd8b9b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:47.377179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:47.387538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1289/2564] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:47.395730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07db19-798b-4a99-a04a-93a0ee703f28 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:47.409107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:47.410080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:47.410538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:47.410988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] PATH_INFO: `/v3/projects/fd517caa35c14936ab23fc1735598ede/users/3f3e9669dc1c4fe2a9abcffabf331d49/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:47.413396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd517caa35c14936ab23fc1735598ede, user_id=3f3e9669dc1c4fe2a9abcffabf331d49, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:47.424624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:47.454903 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1276/2565] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:47 2022] PUT /identity/v3/projects/fd517caa35c14936ab23fc1735598ede/users/3f3e9669dc1c4fe2a9abcffabf331d49/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:47.460301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:47.460905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:47.461463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:47.549911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] MFA Rules not processed for user `3f3e9669dc1c4fe2a9abcffabf331d49`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:47.551133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:47.771633 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1290/2566] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:47.786700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:47.792216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:47.848704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:47.983575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08f55-a10a-4738-abda-37d890abce9e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:47.997984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:47.999240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:47.999833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:48.000412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:48.041311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:48.044017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b085-ff06-4e8e-b435-1792d63b08ae service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:48.082671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1277/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:50.630784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:50.944078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621de7f-f408-4539-aa4b-a70c758e19f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:50.961640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:50.983457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:50.987828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:50.988124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] PATH_INFO: `/v3/users/d91a7dd3eca84a6182caf479f91e155d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:50.994650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91a7dd3eca84a6182caf479f91e155d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:51.014818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:51.452544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91a7dd3eca84a6182caf479f91e155d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:51.454381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91a7dd3eca84a6182caf479f91e155d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:51.456301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:51.579903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91a7dd3eca84a6182caf479f91e155d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:51.654552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91a7dd3eca84a6182caf479f91e155d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:51.659941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91a7dd3eca84a6182caf479f91e155d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:51.753337 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1291/2568] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:50 2022] DELETE /identity/v3/users/d91a7dd3eca84a6182caf479f91e155d => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:51.755760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:51.756269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:51.756503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:51.812761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:51.821951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.096680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1278/2569] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:52.158988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:52.160640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.204539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d605c-bd35-4906-a750-33e3ce09189c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:52.241546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:52.243872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:52.249268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:52.249268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] PATH_INFO: `/v3/users/9cc148a1570448d29d5c6d720b4d7baa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:52.255399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc148a1570448d29d5c6d720b4d7baa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:52.271222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:52.377726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:52.382472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.563840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382ba3-fea4-4656-9d91-43e47e9416a3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:52.578651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:52.580317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:52.581645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:52.582888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:52.593551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc148a1570448d29d5c6d720b4d7baa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:52.594307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc148a1570448d29d5c6d720b4d7baa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:52.610470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:52.613050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9196e2-4244-4064-af92-2bf8b450bb1f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:52.636605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1279/2570] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:21:52.644347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:52.644347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:52.644347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:52.671026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:52.672528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.707875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc148a1570448d29d5c6d720b4d7baa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:52.732223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc148a1570448d29d5c6d720b4d7baa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:52.733902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49a96305-69e9-4e7d-bf6c-91ba8e138920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc148a1570448d29d5c6d720b4d7baa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:52.749292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:52.772009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1292/2571] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:52 2022] DELETE /identity/v3/users/9cc148a1570448d29d5c6d720b4d7baa => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:52.775195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:52.775742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:52.776339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:52.801399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:52.803323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.824296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1280/2572] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:52.841365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:52.845050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:52.946642 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1293/2573] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:52.968350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:52.970518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:53.039919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efa250-0695-4958-b1d5-e9570ca9fb93 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:53.120590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:53.174448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74c773-8918-45e3-ab72-1982165084c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:53.186929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:53.187652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:53.188113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:53.188499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:53.192597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:53.201128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:53.207866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:53.208372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:53.235961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:53.237408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:53.272697 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1294/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:53.533416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:53.534907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:53.556883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1281/2575] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:21:54.068548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:54.070640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:54.110935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7f75-e16c-4477-bfe5-c224b1a29433 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:54.125197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:54.126446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:54.126446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:54.127496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] PATH_INFO: `/v3/projects/389204737241492380d24e9f45caff43` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:54.129009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=389204737241492380d24e9f45caff43)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:54.131131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:54.295840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:54.297847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:54.322088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389204737241492380d24e9f45caff43', 'request_id': 'req-351d2418-9110-4a89-8266-2306c54bed5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.339642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe935e9-3eb6-4e42-a4a6-c3abe6bc5f79 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:54.398723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:54.429883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389204737241492380d24e9f45caff43', 'request_id': 'req-351d2418-9110-4a89-8266-2306c54bed5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.437787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389204737241492380d24e9f45caff43', 'request_id': 'req-351d2418-9110-4a89-8266-2306c54bed5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.456031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] The token cache is being invalidate because project 389204737241492380d24e9f45caff43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:54.456447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.459413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.459413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1295/2576] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:54 2022] DELETE /identity/v3/projects/389204737241492380d24e9f45caff43 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:54.463289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:54.464777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:54.517343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:54.518266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:54.522672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:54.522672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] PATH_INFO: `/v3/projects/f40cb0105e6f46888fd1f8531d8cb081` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:54.522672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40cb0105e6f46888fd1f8531d8cb081)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:54.525015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:54.634453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2418-9110-4a89-8266-2306c54bed5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:54.642562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:54.648891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:54.648891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:54.648891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] PATH_INFO: `/v3/users/024f363df3ba483c8bb19eb7549e9976` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:54.648891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=024f363df3ba483c8bb19eb7549e9976)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:54.648891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:54.703819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40cb0105e6f46888fd1f8531d8cb081', 'request_id': 'req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.804868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40cb0105e6f46888fd1f8531d8cb081', 'request_id': 'req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.818516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40cb0105e6f46888fd1f8531d8cb081', 'request_id': 'req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.839451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] The token cache is being invalidate because project f40cb0105e6f46888fd1f8531d8cb081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:54.839752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.842180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.847201 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1282/2577] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:54 2022] DELETE /identity/v3/projects/f40cb0105e6f46888fd1f8531d8cb081 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:54.848105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:54.850266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:54.901967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024f363df3ba483c8bb19eb7549e9976'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.912370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024f363df3ba483c8bb19eb7549e9976'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:54.988018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024f363df3ba483c8bb19eb7549e9976'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.006304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:55.011651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024f363df3ba483c8bb19eb7549e9976'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.012605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024f363df3ba483c8bb19eb7549e9976'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.043087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1296/2578] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:54 2022] DELETE /identity/v3/users/024f363df3ba483c8bb19eb7549e9976 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:55.068077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09f90a-719c-4ae6-bb67-a6d32cfbc1e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:55.235337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:55.236288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:55.237372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:55.240717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] PATH_INFO: `/v3/users/3f3e9669dc1c4fe2a9abcffabf331d49` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:55.242389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3e9669dc1c4fe2a9abcffabf331d49)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:55.246266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:55.249449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:55.446852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:55.446852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:55.487636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176eced-0dd5-461e-96ff-43ae5e5c0e1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:55.501155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:55.501944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:55.502354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:55.503594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] PATH_INFO: `/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:55.520712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3e9669dc1c4fe2a9abcffabf331d49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.521304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe3e163c6f049f29e0a23d7a546d7e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:55.521421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3e9669dc1c4fe2a9abcffabf331d49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.521537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:55.636614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3e9669dc1c4fe2a9abcffabf331d49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.652596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3e9669dc1c4fe2a9abcffabf331d49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.653441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5a580c0-1643-46dc-9fd1-0662e84562c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3e9669dc1c4fe2a9abcffabf331d49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.697108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1283/2579] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:21:54 2022] DELETE /identity/v3/users/3f3e9669dc1c4fe2a9abcffabf331d49 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:55.697388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe3e163c6f049f29e0a23d7a546d7e2', 'request_id': 'req-d079ed41-792f-432f-892e-f962bdf9ae95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.836824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe3e163c6f049f29e0a23d7a546d7e2', 'request_id': 'req-d079ed41-792f-432f-892e-f962bdf9ae95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.850988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe3e163c6f049f29e0a23d7a546d7e2', 'request_id': 'req-d079ed41-792f-432f-892e-f962bdf9ae95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.870929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] The token cache is being invalidate because project cbe3e163c6f049f29e0a23d7a546d7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:55.881207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.881207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d079ed41-792f-432f-892e-f962bdf9ae95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:55.881207 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1297/2580] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:55 2022] DELETE /identity/v3/projects/cbe3e163c6f049f29e0a23d7a546d7e2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:55.883829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:55.884116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:55.884414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:55.906394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:55.913164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:56.083452 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1284/2581] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:56.085448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.086202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.086487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.121711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:56.123856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:56.137507 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1298/2582] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:56.145643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.154995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfce0-01ce-42f7-8afd-9f56b7d02f88 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.172480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.180741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.181103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.181480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.183216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:56.184798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.189128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:56.224096 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1285/2583] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:56.228197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.253028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8e202-2443-4ff9-9be2-6828cba62083 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.280706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.281620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.283701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.283701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.283701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.286079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:56.431206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1299/2584] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:56 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:56.435449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.448345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f07072-3ba0-47f8-8325-ba2d788f6127 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.626325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.627813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.628289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.628743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.629600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.632161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:56.742680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:56.750255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1286/2585] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:56 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:56.754762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.779116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfc34-c0c1-46f8-a2f9-07676c57a098 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.801909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.803448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.803956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.804476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.805352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.807243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:56.834002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1300/2586] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:56.843584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.855035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6f35-b72f-470a-9473-e3b3b484189d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.869718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.870358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.873211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.873504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.874201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.878078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:56.918733 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1287/2587] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:56.924141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:56.934768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54571-09f9-43f9-b02b-5203866d6211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:56.944600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:56.944600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:56.944600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:56.944600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] PATH_INFO: `/v3/projects/443ef5cf6a7d45f0b6321cecfad998d2/users/fe26fb07ae1043d883ac18853296764a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:56.977601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443ef5cf6a7d45f0b6321cecfad998d2, user_id=fe26fb07ae1043d883ac18853296764a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:56.992207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24718a6e-d183-4843-a560-975d86178237 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:57.029408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:57.031595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.077440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77cea-1e63-42ef-960a-70bb8271147f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:57.082781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:57.083421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.084194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.084194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] PATH_INFO: `/v3/projects/fd517caa35c14936ab23fc1735598ede` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.108169 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1301/2588] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:56 2022] PUT /identity/v3/projects/443ef5cf6a7d45f0b6321cecfad998d2/users/fe26fb07ae1043d883ac18853296764a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:21:57.110277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd517caa35c14936ab23fc1735598ede)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:57.113381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.113894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.114513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.119901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:57.184591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:57.191081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.289984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1302/2589] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:57.304421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:57.307039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.317496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:57.332162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd517caa35c14936ab23fc1735598ede', 'request_id': 'req-fda6a925-80a6-4255-9fae-009aafd9b586'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:57.387261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd517caa35c14936ab23fc1735598ede', 'request_id': 'req-fda6a925-80a6-4255-9fae-009aafd9b586'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:57.397418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd517caa35c14936ab23fc1735598ede', 'request_id': 'req-fda6a925-80a6-4255-9fae-009aafd9b586'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:57.422645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] The token cache is being invalidate because project fd517caa35c14936ab23fc1735598ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:21:57.422936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:57.431494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fda6a925-80a6-4255-9fae-009aafd9b586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:21:57.438251 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1288/2590] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:21:57 2022] DELETE /identity/v3/projects/fd517caa35c14936ab23fc1735598ede => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:57.443565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700ff7-1df7-4b49-bed7-d9c88897315c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.447885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700ff7-1df7-4b49-bed7-d9c88897315c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.447885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700ff7-1df7-4b49-bed7-d9c88897315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.455614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68ecbb-8617-474b-a871-4e5c37f50734 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:57.488578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b9700ff7-1df7-4b49-bed7-d9c88897315c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:57.492932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9700ff7-1df7-4b49-bed7-d9c88897315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.550218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:57.557150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.558092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.558798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.563472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.633622 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1289/2591] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:57.641279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.641664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.642016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.669096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:57.670826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:57.713062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:57.714473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:57.728743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1303/2592] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:21:57.743745 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1290/2593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:21:57.746360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:57.767626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247045c2-de8d-4ff0-8b67-7044a3be348b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:57.783637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:57.784508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.785028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.785710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.786551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:21:57.787092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:57.789741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:57.814764 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1304/2594] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:21:57.819386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:57.830739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760603c-be99-48d3-ae84-3fa815ac2ad5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:57.839788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:57.840509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:57.840797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:57.841072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:57.841714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:57.846093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:58.002141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1291/2595] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:57 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:58.006476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:58.020028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3cf44-0141-417e-b8be-721fc3309c09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:58.108819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:58.117707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:58.118809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:58.119140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:58.119510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:58.120142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:58.123166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:58.263598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1305/2596] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:58 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:58.269518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:58.296611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8efd1-56df-4f05-a13c-80d4a6719c4c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:58.317561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:58.318127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:58.318421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:58.318820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:58.319484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:58.323343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:58.347538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1292/2597] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:58.351868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:58.372393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8b2e-c3de-409e-a1cb-f201e7c0e3b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:58.377400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:58.378036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:58.378385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:58.378769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:58.379480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:58.381149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a73d-a4d7-48cf-af20-a3dc95515a08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:58.402607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1306/2598] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:21:58.403824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:58.416917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c2d1-a63c-4edd-83d9-3fe279598d95 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:58.423353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:58.424160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:58.424513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:58.424881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] PATH_INFO: `/v3/projects/b4080736c44945d3a58caee2611d03c2/users/51efe0e13217445a8e22edf017e15536/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:58.451022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4080736c44945d3a58caee2611d03c2, user_id=51efe0e13217445a8e22edf017e15536, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:58.454252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:58.561611 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1293/2599] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:58 2022] PUT /identity/v3/projects/b4080736c44945d3a58caee2611d03c2/users/51efe0e13217445a8e22edf017e15536/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:21:58.572699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:58.572985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:58.573264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:58.727512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] MFA Rules not processed for user `51efe0e13217445a8e22edf017e15536`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:21:58.735231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:21:58.924136 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1307/2600] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:21:58.929117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:58.949786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:21:59.120232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6f8-99ef-42a1-a713-891a248e4631 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:59.136471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:59.137150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:59.137636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:59.138085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:59.138946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:59.141659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:59.312451 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1294/2601] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:21:58 2022] POST /identity/v3/projects => generated 393 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:21:59.317594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:59.346516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8972-2c3b-453e-9ecb-75b153c191b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:59.466872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:59.467592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:59.467797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:59.468043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:59.468701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:59.470690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:59.593839 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1308/2602] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:21:59 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:21:59.598038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:59.612957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784594b9-75cd-4f42-9de7-bc946be87017 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:59.645531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:59.645531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:59.645531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:59.645531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:59.645947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:59.645947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:21:59.656022 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1295/2603] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:21:59.716853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:21:59.731782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cf8d6-ab53-4a4e-8ee6-1f8ac4a15fb8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:21:59.736671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:21:59.737331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:21:59.737610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:21:59.737882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] PATH_INFO: `/v3/projects/04d97be34ea44d4ba6f70eccdc518362/users/5c8f047d694448ddb0f7b46777cbd1ae/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:21:59.754717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d97be34ea44d4ba6f70eccdc518362, user_id=5c8f047d694448ddb0f7b46777cbd1ae, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:21:59.757968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:00.123154 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1309/2604] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:21:59 2022] PUT /identity/v3/projects/04d97be34ea44d4ba6f70eccdc518362/users/5c8f047d694448ddb0f7b46777cbd1ae/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:00.127164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:00.145290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95bbfc-1b83-4cc4-aabe-5d1de93dec55 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:00.333556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:00.342130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:00.347420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:00.347697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:00.348385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:00.355353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1a406-f392-4c5f-8855-153401eaf0d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:00.399071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1296/2605] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:22:00.400968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:00.422644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfa65-0baa-489c-9cbc-d05901704048 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:00.439749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:00.442603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:00.442998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:00.443290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] PATH_INFO: `/v3/projects/04d97be34ea44d4ba6f70eccdc518362/users/5c8f047d694448ddb0f7b46777cbd1ae/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:00.455138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d97be34ea44d4ba6f70eccdc518362, user_id=5c8f047d694448ddb0f7b46777cbd1ae, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:00.457957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b5255-7e74-4b3a-850e-c17f99dec763 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:00.508481 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1310/2606] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:22:00 2022] PUT /identity/v3/projects/04d97be34ea44d4ba6f70eccdc518362/users/5c8f047d694448ddb0f7b46777cbd1ae/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:00.508670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:00.508670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:00.508670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:00.561801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] MFA Rules not processed for user `5c8f047d694448ddb0f7b46777cbd1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:00.563206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:00.814978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1297/2607] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:00.817342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252f619-97fa-4dbe-ae55-6a740f1ba713 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:00.818141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252f619-97fa-4dbe-ae55-6a740f1ba713 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:00.818691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252f619-97fa-4dbe-ae55-6a740f1ba713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:00.857047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f252f619-97fa-4dbe-ae55-6a740f1ba713 None None] MFA Rules not processed for user `51efe0e13217445a8e22edf017e15536`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:00.860946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f252f619-97fa-4dbe-ae55-6a740f1ba713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:00.891487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:00.999294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1311/2608] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:01.289341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:01.293417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:01.300053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:01.499402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:01.499402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:01.499402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:01.526837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:01.531803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:01.621893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5023104-95a9-4d0b-bc6e-222b8b768a1e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:01.629637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:01.630527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:01.631576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:01.633160 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1312/2609] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:22:01.638827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:01.695573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:01.697272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:01.738816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1298/2610] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:01.747939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:01.749613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:01.996346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5957df-f09b-4d5a-ad9b-d5860624738b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:02.007652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:02.008701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:02.009756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:02.010093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:02.031525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:02.036169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:02.061179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1313/2611] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:03.910172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:03.911619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:04.065993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb6a2a-cc93-4e10-9e22-b5540ac08a4a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:04.073807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:04.075427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:04.079207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:04.079207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:04.079207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:04.098117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:04.101408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:04.126075 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1299/2612] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:04.911146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:04.915064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:05.086174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:05.137458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b176e-d52e-473c-a020-e27d4dfd1cc4 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:05.169903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:05.170370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:05.170680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:05.170953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:05.183675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:05.223340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:05.223340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f292-0abe-435d-a7fc-974be8da446c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:05.253992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1314/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:06.951902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:06.955702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:07.171381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b06fa-7c35-40da-a8e4-124893b1a4ae service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:07.186511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:07.187293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:07.187845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:07.188347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:07.221187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:07.282855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:07.285358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96df785-f756-412a-8855-832e03c018ed service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:07.302702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1300/2614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:08.170038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:08.170568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:08.170568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:08.207822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] MFA Rules not processed for user `11020c20eb5d4a499766c3842b75802a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:08.209055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:08.357130 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1315/2615] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:11.945616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:11.946105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:11.946215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:12.050353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] MFA Rules not processed for user `fe26fb07ae1043d883ac18853296764a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:12.057453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:12.162739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:12.251758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1301/2616] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:12.453201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:12.455219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:12.472339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:12.474295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:12.508665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16101bc-c622-4bef-af5c-ba8ad2602ec6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:12.520649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:12.521283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:12.521560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:12.521813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:12.539435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:12.546792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768104-7b7f-49ea-bfe5-30813445f923 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:12.579489 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1302/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:22:12.628602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad88f5f-6532-4328-80be-9b9e4576375f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:12.644903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:12.654651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:12.654651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:12.654651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] PATH_INFO: `/v3/users/3d05af2414d145289877d75c87cd74e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:12.654651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d05af2414d145289877d75c87cd74e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:12.663688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:12.967431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d05af2414d145289877d75c87cd74e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:12.969625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d05af2414d145289877d75c87cd74e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:13.090869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d05af2414d145289877d75c87cd74e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:13.114113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d05af2414d145289877d75c87cd74e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:13.115067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d05af2414d145289877d75c87cd74e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:13.164849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1316/2618] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:22:12 2022] DELETE /identity/v3/users/3d05af2414d145289877d75c87cd74e8 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:13.167116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:13.167613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:13.167717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:13.228923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:13.232309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:13.341359 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1303/2619] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:13.385644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:13.387239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:13.426259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:13.590204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e1f4-6a48-4666-b805-7dc3c86ad260 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:13.603795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:13.604638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:13.605028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:13.605405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:13.627966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:13.629927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:13.652977 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1317/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:15.238884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:15.241228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:15.271883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eea613-6b72-4aa0-a953-8be4044561b0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:15.305550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:15.306310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:15.306807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:15.307811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:15.313477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:15.354306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:15.359473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:15.386490 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1304/2621] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:16.222266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:16.229164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:16.273527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bdf55-f54b-4244-9a74-752bb9486b44 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:16.299667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:16.300679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:16.303682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:16.304227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] PATH_INFO: `/v3/projects/1c9420f5b37941d0b48556a6604fa7f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:16.307903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9420f5b37941d0b48556a6604fa7f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:16.313705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:16.554185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9420f5b37941d0b48556a6604fa7f8', 'request_id': 'req-5b336f14-fc99-4dec-a7b5-443ad3eaac46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:16.642716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9420f5b37941d0b48556a6604fa7f8', 'request_id': 'req-5b336f14-fc99-4dec-a7b5-443ad3eaac46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:16.666925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9420f5b37941d0b48556a6604fa7f8', 'request_id': 'req-5b336f14-fc99-4dec-a7b5-443ad3eaac46'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:16.695584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] The token cache is being invalidate because project 1c9420f5b37941d0b48556a6604fa7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:22:16.696204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:16.697816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:16.708617 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1318/2622] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:22:16 2022] DELETE /identity/v3/projects/1c9420f5b37941d0b48556a6604fa7f8 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:16.711062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:16.738687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc4fd-246d-4f03-9b6d-74f3dd3e9938 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:16.833182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:16.834325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:16.835306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:16.835804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] PATH_INFO: `/v3/users/511b4b792da04994a147e34c1898f4f3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:16.837373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=511b4b792da04994a147e34c1898f4f3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:16.840110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:17.048013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:17.084775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511b4b792da04994a147e34c1898f4f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:17.089604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511b4b792da04994a147e34c1898f4f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:17.244394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511b4b792da04994a147e34c1898f4f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:17.282967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511b4b792da04994a147e34c1898f4f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:17.282967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511b4b792da04994a147e34c1898f4f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:17.333909 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1305/2623] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:22:16 2022] DELETE /identity/v3/users/511b4b792da04994a147e34c1898f4f3 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:17.738265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:17.740349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:17.994556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b336f14-fc99-4dec-a7b5-443ad3eaac46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:18.189947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:18.190836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:18.191287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:18.191726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:18.199315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:18.213659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:18.218112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:18.223853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:18.252002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1319/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:20.252211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:20.253686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:20.343552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47c7cb-bc55-4bca-aec2-bec2d3592e0f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:20.349124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:20.351118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:20.351118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:20.351118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] PATH_INFO: `/v3/projects/69e271556d954583bb2ff61953a76a55` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:20.353035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e271556d954583bb2ff61953a76a55)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:20.355486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:20.551406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e271556d954583bb2ff61953a76a55', 'request_id': 'req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:20.638273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e271556d954583bb2ff61953a76a55', 'request_id': 'req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:20.657822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:20.660545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:20.661833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e271556d954583bb2ff61953a76a55', 'request_id': 'req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:20.687064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] The token cache is being invalidate because project 69e271556d954583bb2ff61953a76a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:22:20.690524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:20.690524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f4ec593a-6250-4b9f-b50a-75ce32b19bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:20.690790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ff2d-8353-49db-9a5a-f239372b2ac9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:20.696310 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1306/2625] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:22:20 2022] DELETE /identity/v3/projects/69e271556d954583bb2ff61953a76a55 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:20.699347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:20.699632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:20.699910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:20.754594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:20.756686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:20.814992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:20.815878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:20.819933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:20.819933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] PATH_INFO: `/v3/users/9e936cb29a634b9da2e4ba5e2901de6b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:20.819933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e936cb29a634b9da2e4ba5e2901de6b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:20.820779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:20.845461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:20.868617 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1307/2626] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:20.869862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:20.871617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:20.981576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403240-5e74-4a9c-affa-72e4a57caefa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:20.989286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:20.990111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:20.990606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:20.990998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:20.992972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.053384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e936cb29a634b9da2e4ba5e2901de6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.054026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e936cb29a634b9da2e4ba5e2901de6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.063545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.067718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af8156-b10c-447c-92c9-97c1d4854bac service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.076136 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1308/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:21.077396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1347-5776-441e-838c-9983a2503791 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.077681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1347-5776-441e-838c-9983a2503791 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.077955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1347-5776-441e-838c-9983a2503791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.099819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-06ff1347-5776-441e-838c-9983a2503791 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:21.101094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06ff1347-5776-441e-838c-9983a2503791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.109701 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1309/2628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:21.114271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1347-5776-441e-838c-9983a2503791 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.124077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1347-5776-441e-838c-9983a2503791 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.129164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.129787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.130064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.130335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.131756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:22:21.132141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.133769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.143913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e936cb29a634b9da2e4ba5e2901de6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.146467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1310/2629] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:22:21.151628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.162425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff895d-e400-405c-9591-65ee54cebde9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.166369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e936cb29a634b9da2e4ba5e2901de6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.167753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e936cb29a634b9da2e4ba5e2901de6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.170957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.176880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.176880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.176880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.176880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.176880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.187996 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1320/2630] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:22:20 2022] DELETE /identity/v3/users/9e936cb29a634b9da2e4ba5e2901de6b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:21.235640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.243084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.309524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1311/2631] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:22:21 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:22:21.313589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.343327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1e7d7-dbb6-420e-ae0f-879cc12dcd94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.357793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:21.418819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f734-4bea-4371-a018-c7c689601f6f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.426196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.427029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.427412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.428552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.429254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.432876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.438018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.438669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.439005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.439281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.442074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.458458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.468261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.497259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1321/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:21.550662 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1312/2633] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:22:21 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:22:21.555305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.572783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980ea8d-299a-4465-a349-abba273346fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.580856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.584143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.584143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.584143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.584143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.585973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.587772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.600422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.615959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25f45-b5f6-455e-9f24-74c8062c8b3f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.628085 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1322/2634] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:22:21.630233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.630689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.632343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.633095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.633095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] PATH_INFO: `/v3/projects/47c07334b72c4be089609b217944b341` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.634592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c07334b72c4be089609b217944b341)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.636556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.657098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941eec-0318-4fc8-a297-b922aa87a85f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.668118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.670152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.671886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.672829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.673719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.676714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.701789 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1323/2635] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:22:21.706652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:21.727244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c4bc-6fe5-4b7b-8834-d0d4b7d4c595 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:21.732802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:21.733694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.734145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.734582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] PATH_INFO: `/v3/projects/17e11c8103e14bdfa09313bfabe03ed6/users/a91a72e234564fff97f25377a7940c0a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.757497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e11c8103e14bdfa09313bfabe03ed6, user_id=a91a72e234564fff97f25377a7940c0a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:21.760993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8d3dd-983f-4efe-a2f8-c3ec59548110 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:21.877881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1324/2636] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:22:21 2022] PUT /identity/v3/projects/17e11c8103e14bdfa09313bfabe03ed6/users/a91a72e234564fff97f25377a7940c0a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:21.882871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:21.883358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:21.883793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:21.909216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c07334b72c4be089609b217944b341', 'request_id': 'req-9c27643c-61eb-497e-ac79-d776b52d2414'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.922337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:21.923592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:21.978252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c07334b72c4be089609b217944b341', 'request_id': 'req-9c27643c-61eb-497e-ac79-d776b52d2414'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:21.991669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c07334b72c4be089609b217944b341', 'request_id': 'req-9c27643c-61eb-497e-ac79-d776b52d2414'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:22.009287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] The token cache is being invalidate because project 47c07334b72c4be089609b217944b341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:22:22.009701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:22.011952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c27643c-61eb-497e-ac79-d776b52d2414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:22:22.018770 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1313/2637] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:22:21 2022] DELETE /identity/v3/projects/47c07334b72c4be089609b217944b341 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:22.020776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca62e7-8418-4421-b81e-4689f50291f9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.021172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca62e7-8418-4421-b81e-4689f50291f9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.021336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca62e7-8418-4421-b81e-4689f50291f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.044138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1325/2638] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:22.061915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-49ca62e7-8418-4421-b81e-4689f50291f9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:22.066117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.067681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-49ca62e7-8418-4421-b81e-4689f50291f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:22.068737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:22.100607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1314/2639] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:22.106248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.106536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.106901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.131638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:22.135396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:22.154972 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1315/2640] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:22:22.157226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.157989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105695-23a3-4b9e-8845-b9fd73ccd499 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.185769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.187718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.189064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.190864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.193234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72641168-7c3a-4d33-b7af-7c1f1a620808 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.199553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.199940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.200442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.200888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.201771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:22:22.202480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.204239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.221732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.221960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1316/2641] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:22:22.223800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.227406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.237173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1326/2642] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:22.241699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424626fd-b903-459d-a511-34c7f4e49593 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.259987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.259987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.259987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.259987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.260525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.264833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.433287 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1317/2643] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/projects => generated 395 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:22:22.433871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.445361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b35f68-f916-4277-b54f-4ba35fb79681 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.527868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.528622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.529179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.529595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.530324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.532448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.610100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:22.614790 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1327/2644] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:22:22.618966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.630193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042d80-c7c0-4d17-9d73-1712a6394b0e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.636489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.637218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.637595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.637958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.638648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.643771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.651821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1318/2645] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:22:22.655768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.667002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58647db-6ceb-46d7-b04f-03e20609f57c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.673880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.675229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.675509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.675957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.676611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.678213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bdf43-b615-430d-bf6b-e80e46428ea9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.689217 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1328/2646] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:22:22.693784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:22.705384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623f9b-91f4-4347-9755-2a8521e7bd94 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.705849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623f9b-91f4-4347-9755-2a8521e7bd94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.705971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbbc0-e38f-439b-8940-b82644137747 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:22.706427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623f9b-91f4-4347-9755-2a8521e7bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.721250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:22.721937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.722215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.722488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] PATH_INFO: `/v3/projects/cfc4de1d0b8a48e5b13e3c23e0f5cc56/users/6eca2331ff25478e950c85c4a8d2f2b4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.732371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-14623f9b-91f4-4347-9755-2a8521e7bd94 None None] MFA Rules not processed for user `fe26fb07ae1043d883ac18853296764a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:22.734138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14623f9b-91f4-4347-9755-2a8521e7bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:22.755501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc4de1d0b8a48e5b13e3c23e0f5cc56, user_id=6eca2331ff25478e950c85c4a8d2f2b4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:22.759699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:22.802590 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1329/2647] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:22.831943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1319/2648] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:22:22 2022] PUT /identity/v3/projects/cfc4de1d0b8a48e5b13e3c23e0f5cc56/users/6eca2331ff25478e950c85c4a8d2f2b4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:22:22.837395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6909f2-4ffc-4d9a-b720-afe91260e17a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:22.837686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6909f2-4ffc-4d9a-b720-afe91260e17a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:22.838061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6909f2-4ffc-4d9a-b720-afe91260e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:22.871966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e6909f2-4ffc-4d9a-b720-afe91260e17a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:22.873441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e6909f2-4ffc-4d9a-b720-afe91260e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:22.966448 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1330/2649] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:22:23.018514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:23.148132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d758b-da48-4e68-9c8e-4b6e5e13e679 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:23.152671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:23.153596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:23.154384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:23.155491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:23.168636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:23.169781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:23.195759 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1320/2650] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:23.821977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:24.118600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:25.703741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566e36-4de4-48fc-a008-be3c9869bb95 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:25.704231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566e36-4de4-48fc-a008-be3c9869bb95 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:25.704319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566e36-4de4-48fc-a008-be3c9869bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:25.791485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01566e36-4de4-48fc-a008-be3c9869bb95 None None] MFA Rules not processed for user `362815f4862e42b5babc7248ab09aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:25.801129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01566e36-4de4-48fc-a008-be3c9869bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:25.836326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:25.929173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1331/2651] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:33.173580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:33.173580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:33.431152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6905b5-f320-4d29-be98-9e15f4326506 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:33.431697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6905b5-f320-4d29-be98-9e15f4326506 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:33.431697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6905b5-f320-4d29-be98-9e15f4326506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:33.507182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc6905b5-f320-4d29-be98-9e15f4326506 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:33.515137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc6905b5-f320-4d29-be98-9e15f4326506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:33.526119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cb331-1133-43f9-a898-a22e91c0d4f3 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:33.547767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:33.551171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:33.551704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:33.552854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:33.571304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:33.619177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:33.624472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:33.660881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1321/2652] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:33.730492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1332/2653] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:22:33.739586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:33.742461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:34.033431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6490b-edaf-4330-a57e-7ac8b4e9b57f service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:34.044661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:34.046203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:34.047534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:34.047969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:34.064132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:34.066834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:34.091831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1322/2654] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:22:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:22:34.181171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cef-cc17-4508-b6ef-5c305234f91b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:34.181456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cef-cc17-4508-b6ef-5c305234f91b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:34.181734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138cef-cc17-4508-b6ef-5c305234f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:34.309530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c138cef-cc17-4508-b6ef-5c305234f91b None None] MFA Rules not processed for user `a91a72e234564fff97f25377a7940c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:34.313457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c138cef-cc17-4508-b6ef-5c305234f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:34.640316 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1333/2655] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:34.985650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:34.987216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:35.054495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687da97-ddf0-42ff-ae9f-b15633978f84 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:35.090437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:35.091114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:35.091396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:35.091670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:35.111824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:35.279438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:35.311246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:35.316192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:35.339126 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1323/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:35.387945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fff0-3f7e-4266-b701-4b6241ea2808 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:35.388921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fff0-3f7e-4266-b701-4b6241ea2808 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:35.388921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0fff0-3f7e-4266-b701-4b6241ea2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:35.398407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:35.422989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87860-c6df-4c8f-8c1d-f4da373aebdb service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:35.449968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:35.455212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:35.456941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:35.457347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:35.462379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98f0fff0-3f7e-4266-b701-4b6241ea2808 None None] MFA Rules not processed for user `51efe0e13217445a8e22edf017e15536`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:35.474399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98f0fff0-3f7e-4266-b701-4b6241ea2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:35.495126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:35.500968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0924d73-5a8f-49cc-be4a-4cf98789794d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:35.542191 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1324/2657] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:35.704949 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1334/2658] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:41.284400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:41.284960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:41.284960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:41.379304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] MFA Rules not processed for user `6eca2331ff25478e950c85c4a8d2f2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:41.380926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:41.616301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1325/2659] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:41.630984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:41.632746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:41.633327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:41.674720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:22:41.826264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] MFA Rules not processed for user `6eca2331ff25478e950c85c4a8d2f2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:22:41.826264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:41.826264 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1335/2660] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:22:45.766831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:45.796397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9427e7c-3920-4bac-aa8c-f6a16b558fe6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:45.828317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:45.829011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:45.829379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:45.829624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:45.849954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:45.854043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:45.886881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1326/2661] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:48.127325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:48.137860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377d74-18ca-4424-ae28-466eed9db986 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:48.144228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:48.145660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:48.146752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:48.147104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:48.152459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:48.166647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:48.168466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:48.193546 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1336/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:49.346364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:49.346364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:49.429051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c882d-6e57-48c9-ad49-01defd65156d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:49.445272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:49.449925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:49.450295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:49.450762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:49.474661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:49.493615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:49.495686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d69d-f629-4697-9786-962cc7b45214 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:49.509089 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1327/2663] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:57.398431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:22:57.414815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5eab57-0a0d-4cbd-9fce-e474353ea55a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:22:57.420548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:22:57.421355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:22:57.421859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:22:57.422131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:22:57.425357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:22:57.513657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:22:57.515663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:22:57.541806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1337/2664] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:22:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:22:59.503136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:01.639655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:01.640315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:01.640315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:01.661361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] MFA Rules not processed for user `f39fdca40d9b4035a56b79e13b375b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:01.663123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:01.670419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1328/2665] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:05.119175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:05.151916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250430-4145-4f93-b1f7-0cf34b06d77a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:05.173268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:05.176499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:05.177944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:05.178551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:05.184412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:05.237016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:05.239299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:05.301385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1338/2666] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:08.842029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:08.856313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd90b-e870-4ac5-bded-fa688484ebb3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:08.863030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:08.863940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:08.864371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:08.864794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:08.867649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:08.955899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:08.963186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:08.987312 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1329/2667] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:10.883572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:10.885070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:10.901222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f312b4c-514e-442b-af45-bb9fa96f5f09 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:10.906175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:10.906906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:10.907484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:10.907817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] PATH_INFO: `/v3/users/a91a72e234564fff97f25377a7940c0a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:10.909217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91a72e234564fff97f25377a7940c0a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:10.911963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:11.141734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91a72e234564fff97f25377a7940c0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:11.143182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91a72e234564fff97f25377a7940c0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:11.263387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91a72e234564fff97f25377a7940c0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:11.291401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91a72e234564fff97f25377a7940c0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:11.292731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3fe216b5-ffdb-42b2-b108-26ccf1635b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91a72e234564fff97f25377a7940c0a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:11.330658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1339/2668] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:23:10 2022] DELETE /identity/v3/users/a91a72e234564fff97f25377a7940c0a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:12.067924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:12.089534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806093-21f8-4002-a6f3-7d76c2f220c8 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:12.180623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:12.181569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:12.182007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:12.182527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] PATH_INFO: `/v3/projects/17e11c8103e14bdfa09313bfabe03ed6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:12.184218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e11c8103e14bdfa09313bfabe03ed6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:12.186532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:12.380414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e11c8103e14bdfa09313bfabe03ed6', 'request_id': 'req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:12.529040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e11c8103e14bdfa09313bfabe03ed6', 'request_id': 'req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:12.539463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e11c8103e14bdfa09313bfabe03ed6', 'request_id': 'req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:12.556804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] The token cache is being invalidate because project 17e11c8103e14bdfa09313bfabe03ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:23:12.558820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:12.559746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a13fc75b-3b05-4a0b-b8ea-22440e0e9ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:12.562177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1330/2669] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:23:12 2022] DELETE /identity/v3/projects/17e11c8103e14bdfa09313bfabe03ed6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:12.566947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:12.567889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:12.569060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:12.577916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:12.633002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:12.635383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:12.788578 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1340/2670] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:12.798472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:12.798862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:12.799473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:12.831005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:12.834249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:12.860698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:12.879069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1331/2671] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:12.884925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b6b9-49c5-4afe-be5d-deaf57830b2a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:12.887232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:12.888120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:12.888562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:12.889098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:12.890876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:23:12.891525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:12.894657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:12.916337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:12.923307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1341/2672] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:23:12.927933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c562fd-b0d1-4899-ae7b-054aa8358557 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:12.936252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:12.951235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:12.951235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:12.951235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:12.951235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:12.951235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:12.966451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:13.045405 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1332/2673] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:23:12 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:23:13.049118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:13.066739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172820-87cd-45c6-9f4f-19c9cd3c8e0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:13.208515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:13.210199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.210725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.211201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.211814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:13.214817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:13.326747 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1342/2674] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:23:13 2022] POST /identity/v3/users => generated 281 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:23:13.330755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:13.343019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8ebd6-3f40-46f7-a7e1-bb87b77dd75f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:13.353033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:13.354112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.354404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.356571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.356571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:13.357771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:13.369841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1333/2675] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:23:13.374227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:13.385963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418360e9-f8a8-4af8-b04c-060b09f53700 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:13.405885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:13.406506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.407019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.407489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.408294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:13.414090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba2e2-dc82-4ab8-9f99-541199a106ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:13.428168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1343/2676] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:23:13.440383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:13.456857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8d02-0195-49e1-96ad-477a90fddb65 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:13.470005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:13.470005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.470005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.470005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] PATH_INFO: `/v3/projects/e07ae5405c0b492f824759456fdca7b7/users/cba1c08f53b14729adf893683ccec5a2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.509533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07ae5405c0b492f824759456fdca7b7, user_id=cba1c08f53b14729adf893683ccec5a2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:13.519355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:13.654306 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1334/2677] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:23:13 2022] PUT /identity/v3/projects/e07ae5405c0b492f824759456fdca7b7/users/cba1c08f53b14729adf893683ccec5a2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:13.659505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bb1b-c102-45c0-a810-c157dde5d011 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.660667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bb1b-c102-45c0-a810-c157dde5d011 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.661141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bb1b-c102-45c0-a810-c157dde5d011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.719943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ad9bb1b-c102-45c0-a810-c157dde5d011 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:13.722946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ad9bb1b-c102-45c0-a810-c157dde5d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:13.843202 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1344/2678] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:13.853277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:13.855083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:13.948492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6b84-4199-45b8-b81d-2d74707801c5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:13.954647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:13.955287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:13.961677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:13.961677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:13.969851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:13.971489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:13.986700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1335/2679] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:22.577568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da918-8afa-4ad3-8540-259e5ab49266 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:22.579026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da918-8afa-4ad3-8540-259e5ab49266 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:22.579026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da918-8afa-4ad3-8540-259e5ab49266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:22.619517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a61da918-8afa-4ad3-8540-259e5ab49266 None None] MFA Rules not processed for user `f7bc608b554e4c6b94ec547f4e6c1d20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:22.621705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a61da918-8afa-4ad3-8540-259e5ab49266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:22.634367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:22.755579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1345/2680] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:23.712714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:23.723109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:23.758178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b7551-5c6f-49c5-8796-480f5bfdbd69 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:23.786691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:23.787397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:23.787955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:23.788979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] PATH_INFO: `/v3/users/51efe0e13217445a8e22edf017e15536` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:23.790085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51efe0e13217445a8e22edf017e15536)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:23.799077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:24.158201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51efe0e13217445a8e22edf017e15536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:24.159173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51efe0e13217445a8e22edf017e15536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:24.251665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51efe0e13217445a8e22edf017e15536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:24.289836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51efe0e13217445a8e22edf017e15536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:24.302241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51efe0e13217445a8e22edf017e15536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:24.335628 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1336/2681] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:23:23 2022] DELETE /identity/v3/users/51efe0e13217445a8e22edf017e15536 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:24.336430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:24.336983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:24.336983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:24.384377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:24.388526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:24.499077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1346/2682] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:23:24.514106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:24.516101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:24.617507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:24.663805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303c985-cdf4-4d2d-8c43-258841529f2f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:24.668206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:24.672404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:24.672404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:24.672404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:24.683602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:24.685377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:24.710357 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1337/2683] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:25.229529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:25.231002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:25.266736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bd80a-f2f4-4925-a42f-08073f78a1e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:25.282040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:25.283855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:25.283855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:25.283855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] PATH_INFO: `/v3/projects/b4080736c44945d3a58caee2611d03c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:25.285597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4080736c44945d3a58caee2611d03c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:25.288244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:26.166597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4080736c44945d3a58caee2611d03c2', 'request_id': 'req-93246894-7464-4e29-8823-fca0721bb313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.252778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4080736c44945d3a58caee2611d03c2', 'request_id': 'req-93246894-7464-4e29-8823-fca0721bb313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.264397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4080736c44945d3a58caee2611d03c2', 'request_id': 'req-93246894-7464-4e29-8823-fca0721bb313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.285192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] The token cache is being invalidate because project b4080736c44945d3a58caee2611d03c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:23:26.288371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.288371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.291833 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1347/2684] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:23:25 2022] DELETE /identity/v3/projects/b4080736c44945d3a58caee2611d03c2 => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:26.305205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:26.360143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b1dde-44ce-4665-aeff-a4b143cc32e8 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:26.521196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:26.521856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:26.522334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:26.530770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] PATH_INFO: `/v3/users/5c8f047d694448ddb0f7b46777cbd1ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:26.530770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8f047d694448ddb0f7b46777cbd1ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:26.530770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:26.918192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8f047d694448ddb0f7b46777cbd1ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:26.919235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8f047d694448ddb0f7b46777cbd1ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:27.009985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8f047d694448ddb0f7b46777cbd1ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:27.048215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8f047d694448ddb0f7b46777cbd1ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:27.051282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0580da67-c390-4c7c-a5e2-9c05235bd9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8f047d694448ddb0f7b46777cbd1ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:27.081028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1338/2685] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:23:26 2022] DELETE /identity/v3/users/5c8f047d694448ddb0f7b46777cbd1ae => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:23:27.747053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:27.748632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:27.776553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93246894-7464-4e29-8823-fca0721bb313 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:27.914031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:27.990942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:27.996216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:27.996216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:27.996216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] PATH_INFO: `/v3/projects/04d97be34ea44d4ba6f70eccdc518362` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:27.996216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d97be34ea44d4ba6f70eccdc518362)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:27.996216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:28.108373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e1c0-330a-46ab-8344-be3a8870f998 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.108956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e1c0-330a-46ab-8344-be3a8870f998 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.108956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e1c0-330a-46ab-8344-be3a8870f998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.186021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-57c4e1c0-330a-46ab-8344-be3a8870f998 None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:28.188879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57c4e1c0-330a-46ab-8344-be3a8870f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.214205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d97be34ea44d4ba6f70eccdc518362', 'request_id': 'req-e04db2f4-df79-440d-9755-fe98b56f8012'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:28.338999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:28.339544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d97be34ea44d4ba6f70eccdc518362', 'request_id': 'req-e04db2f4-df79-440d-9755-fe98b56f8012'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:28.351418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d97be34ea44d4ba6f70eccdc518362', 'request_id': 'req-e04db2f4-df79-440d-9755-fe98b56f8012'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:28.401154 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1339/2686] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:28.402528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] The token cache is being invalidate because project 04d97be34ea44d4ba6f70eccdc518362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:23:28.402712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432abd-4a0c-462a-83bf-9022db2a0019 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.402910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432abd-4a0c-462a-83bf-9022db2a0019 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.403187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432abd-4a0c-462a-83bf-9022db2a0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.404782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:28.405940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e04db2f4-df79-440d-9755-fe98b56f8012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:23:28.411936 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1348/2687] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:23:27 2022] DELETE /identity/v3/projects/04d97be34ea44d4ba6f70eccdc518362 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:28.417333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.417913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.418427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.463044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9d432abd-4a0c-462a-83bf-9022db2a0019 None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:28.464271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9d432abd-4a0c-462a-83bf-9022db2a0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.470574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:28.480133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.482893 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1340/2688] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:28.650343 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1349/2689] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:28.661276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.661563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.661837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.692157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:28.693369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.700526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:28.702402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.735230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1341/2690] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:28.739074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:28.755453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b887a-2b88-4f20-af56-4dfeae0be9ad None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:28.771162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:28.771803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.772080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.772359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.775474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:23:28.775810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:28.784628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:28.813832 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1342/2691] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:23:28.817250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:28.868177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537337-6b43-44a7-b824-5ffbf81ffaa4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:28.888982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:28.889655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.891047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.891444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.893506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:28.897314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:28.924222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9a1b6-3b48-40b2-bb48-617661408407 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:28.949639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:28.949639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:28.949639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:28.949639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:28.957783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:28.975779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:28.983421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:28.985068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:28.997202 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1350/2692] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:23:29.066581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:29.077051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1343/2693] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:23:28 2022] POST /identity/v3/projects => generated 397 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:23:29.087116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389406f-95a4-4722-aea5-b2de6bb115f9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:29.307692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:29.308624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:29.310013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:29.310186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:29.310967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:29.313029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:29.441047 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1351/2694] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:23:29 2022] POST /identity/v3/users => generated 299 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:23:29.446599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:29.465373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4c2d-b375-426c-8003-ce72a6fb5b63 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:29.486491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:29.487612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:29.488094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:29.488567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:29.489425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:29.496231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:29.532979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1344/2695] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:23:29.536492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:29.558180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802dd88-3544-49a1-b0b4-3631ad89c42d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:29.572928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:29.573552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:29.573831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:29.574108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:29.574795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:29.576453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057043-a1b9-43e0-a9a4-d46243ad25e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:29.612706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1352/2696] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:23:29.614763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:29.627144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488baf-dd61-4b14-a1e9-6ea3047ff2d5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:29.640247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:29.641819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:29.643552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:29.648521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] PATH_INFO: `/v3/projects/f8329b7a996b44ac8064754f3d3228ec/users/1bf9e8a3a122438c95ca0705008a816c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:29.690665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8329b7a996b44ac8064754f3d3228ec, user_id=1bf9e8a3a122438c95ca0705008a816c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:29.698673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:29.806035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1345/2697] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:23:29 2022] PUT /identity/v3/projects/f8329b7a996b44ac8064754f3d3228ec/users/1bf9e8a3a122438c95ca0705008a816c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:23:29.807642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:29.807928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:29.808230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:29.845072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:29.849395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:30.000080 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1353/2698] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:30.014037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:30.018816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:30.176135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159408f6-88e7-446a-af8a-a7e89c15f5dd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:30.185280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:30.185920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:30.186213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:30.186472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:30.212826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:30.214281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f128b6f-48fb-4429-886a-4636f8cb4aaf service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:30.233520 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1346/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:23:36.293272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:36.463011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb2f60-9f45-4c66-899a-d2f9c2e10bd2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:36.473276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:36.473276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:36.473276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:36.473276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:36.473923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:36.492055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:36.570733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:36.572800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30ac1-f04f-4cd0-913d-87f2117309e3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:36.588177 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1354/2700] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:40.228355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:41.445998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:41.446911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:41.446911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:41.479096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] MFA Rules not processed for user `1bf9e8a3a122438c95ca0705008a816c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:41.480944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:41.669328 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1347/2701] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:41.684445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:41.685941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:41.686512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:41.735288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] MFA Rules not processed for user `1bf9e8a3a122438c95ca0705008a816c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:41.737546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:41.762021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1355/2702] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:41.787534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:41.802075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a390e6-de8f-443f-9ec0-a6d3731b6032 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:41.814863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:41.816194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:41.816901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:41.824348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:41.859666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:41.861889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:41.876036 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1348/2703] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:49.188056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:49.199672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:49.432463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9b86-6e40-4f9e-b449-d83b338c7c68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:49.436552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:49.437178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:49.437460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:49.437734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:49.440122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:49.504781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:49.506147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a918a1d-16b5-4f02-851f-fce8bbfb3724 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:49.515502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1356/2704] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:49 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:52.074830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=38 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:56.378781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:56.380240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:56.400864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc7296-1a20-4961-841f-075e913b4eb7 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:56.412252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:56.412252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:56.412252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:56.412252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:56.413169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:56.438760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:56.440370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:56.450148 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1349/2705] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:23:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:23:57.273580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:57.274691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:57.275162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:57.304273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:23:57.305936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:57.362974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:23:57.405601 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1357/2706] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:23:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:23:57.473610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:23:57.475796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:23:57.648117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44f6f-8804-46c1-b62c-c9c12e988259 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:23:57.662160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:23:57.667393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:23:57.667393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:23:57.667393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:23:57.691616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:23:57.693407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156985f8-79aa-4552-a4f4-b4e6b98c40d1 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:23:57.704449 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1350/2707] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:23:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:24:07.518481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:07.699510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=38 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:08.543784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:08.544285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:08.572992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2fb2-733e-47f8-82a7-cec85f912071 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:08.586282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:08.586966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:08.587247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:08.587522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] PATH_INFO: `/v3/users/11020c20eb5d4a499766c3842b75802a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:08.593574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11020c20eb5d4a499766c3842b75802a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:08.598032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:08.881049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11020c20eb5d4a499766c3842b75802a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:08.882007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11020c20eb5d4a499766c3842b75802a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:08.969377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11020c20eb5d4a499766c3842b75802a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:08.988652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11020c20eb5d4a499766c3842b75802a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:08.989603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11020c20eb5d4a499766c3842b75802a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:09.019325 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1358/2708] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:08 2022] DELETE /identity/v3/users/11020c20eb5d4a499766c3842b75802a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:09.023606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:09.024232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:09.024587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:09.070179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:09.071829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:09.285174 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1351/2709] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:09.303050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:09.304556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:09.407507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a041-dfaf-4014-baaf-bceb1bdcead6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:09.411594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:09.413858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:09.413858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:09.413858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:09.425388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:09.427292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:09.457837 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1359/2710] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:09.885910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:09.887406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:09.908876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6320ef-2b52-4182-b950-397b73119bd0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:09.911863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:09.912843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:09.913687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:09.914124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] PATH_INFO: `/v3/projects/8885cfcc6a134e1e93ff7214ba33e07f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:09.916684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8885cfcc6a134e1e93ff7214ba33e07f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:09.932622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:10.110964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8885cfcc6a134e1e93ff7214ba33e07f', 'request_id': 'req-c4e24cba-c819-4c0c-8707-daacccfe9643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.184082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8885cfcc6a134e1e93ff7214ba33e07f', 'request_id': 'req-c4e24cba-c819-4c0c-8707-daacccfe9643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.192101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8885cfcc6a134e1e93ff7214ba33e07f', 'request_id': 'req-c4e24cba-c819-4c0c-8707-daacccfe9643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.207308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] The token cache is being invalidate because project 8885cfcc6a134e1e93ff7214ba33e07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:10.210033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.210033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.215614 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1352/2711] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:09 2022] DELETE /identity/v3/projects/8885cfcc6a134e1e93ff7214ba33e07f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:10.216986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:10.231442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8d78-fedd-43a0-9204-893296247f6e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:10.319879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:10.320428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:10.320726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:10.321034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] PATH_INFO: `/v3/users/6dea75acded746dda132b34774a15beb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:10.323632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dea75acded746dda132b34774a15beb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:10.330669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:10.360747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:10.549366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dea75acded746dda132b34774a15beb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.551017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dea75acded746dda132b34774a15beb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.637648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dea75acded746dda132b34774a15beb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.666793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dea75acded746dda132b34774a15beb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.668978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec60ab2a-f3cf-4635-9e23-1bf00c88ace0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dea75acded746dda132b34774a15beb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:10.702661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1360/2712] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:10 2022] DELETE /identity/v3/users/6dea75acded746dda132b34774a15beb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:11.169879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:11.172077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:11.189035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24cba-c819-4c0c-8707-daacccfe9643 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:11.317542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:11.318606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:11.319147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:11.319735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] PATH_INFO: `/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:11.321535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dd5cfcabcd4e77a6c945a7cef50e86)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:11.324153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:11.476406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:11.516408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dd5cfcabcd4e77a6c945a7cef50e86', 'request_id': 'req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:11.594424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dd5cfcabcd4e77a6c945a7cef50e86', 'request_id': 'req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:11.601487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dd5cfcabcd4e77a6c945a7cef50e86', 'request_id': 'req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:11.620365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] The token cache is being invalidate because project 93dd5cfcabcd4e77a6c945a7cef50e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:11.620658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:11.621563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a27b94b-f042-4134-a6fb-06b0a8d64ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:11.627269 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1353/2713] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:11 2022] DELETE /identity/v3/projects/93dd5cfcabcd4e77a6c945a7cef50e86 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:11.628831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:11.629318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:11.629434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:11.660549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:11.662005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:11.853258 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1361/2714] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:11.862404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:11.863105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:11.863601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:11.899922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:11.901523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:11.913836 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1354/2715] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:11.923628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:11.940037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b6ad-47e7-4ac6-8978-7b4861d0ff53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:11.959311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:11.960248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:11.960641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:11.961101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:11.970154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:11.970560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:11.972731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.001608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.003708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1362/2716] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:12.021927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b05c1-8a1c-45bf-b64d-f7d12d8bcc0e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.044485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.045667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.046308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.047068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.048033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.050319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.391467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.393390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:12.499156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1355/2717] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:12 2022] POST /identity/v3/projects => generated 383 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:12.501311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.508855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634723c4-c590-4a15-bf27-6245c6b3d052 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.549940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:12.609785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa4654-398f-4b5d-aa32-57639e452d24 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.618919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.619693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.620188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.621891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.624066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.626975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.650039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.650701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.650970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.651570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.664500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:12.716235 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1356/2718] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:12 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:12.720994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.761284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed2bed-ac13-405c-b5fc-d2b8e15b7b77 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.793026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.795152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.795456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.795789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.799385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.801040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.811502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.814881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.832551 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1357/2719] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:12.840136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.862442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e91b5-1626-4123-97a6-58a6500673ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.869034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.869910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.870355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.871864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.873081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.875770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53044-3992-4405-97f2-b063baaeb50d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:12.876151 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1363/2720] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:12.904851 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1358/2721] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:12.909183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:12.928637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9843c-0929-4846-b928-3f90b4438f6a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:12.942369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:12.943484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:12.944405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:12.945179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050/users/cf672958a21c4763acd6f4cc82d9d58d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:12.988845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3578e366685444ffa499e78199c4c050, user_id=cf672958a21c4763acd6f4cc82d9d58d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:12.992208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:13.080223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1364/2722] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:12 2022] PUT /identity/v3/projects/3578e366685444ffa499e78199c4c050/users/cf672958a21c4763acd6f4cc82d9d58d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:13.093784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:13.093784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:13.093784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:13.177283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] MFA Rules not processed for user `cf672958a21c4763acd6f4cc82d9d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:13.179938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:13.342725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:13.409040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1359/2723] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:13.412899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:13.565317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccafc1-020f-4ae0-a152-045c5c1b2ec1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:13.571887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:13.572996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:13.573885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:13.574431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:13.575798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:13.579415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:13.732616 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1365/2724] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:13 2022] POST /identity/v3/projects => generated 381 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:13.737465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:13.755102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bb07f-7ec5-4cdb-9807-e8110a6dd45c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:13.941764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:13.943741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:13.944484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:13.944992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:13.946337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:13.950055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.090712 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1360/2725] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:13 2022] POST /identity/v3/users => generated 297 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:14.091942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.107010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4a62b-80c2-4627-9c94-4fc45dc8ce21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.118225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.118828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.119106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.119375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.120014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.121692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1dde-77cb-4837-b1aa-8b39bf67f821 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.158461 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1366/2726] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:14.163046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.177714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77452-7e40-4fa1-b30e-2128367e4028 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.184467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.185314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.185722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.186110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] PATH_INFO: `/v3/projects/f3e681231252454eaf1506b6dfcddcec/users/173d35ba54004b379f6ab67a355e24c5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.209800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e681231252454eaf1506b6dfcddcec, user_id=173d35ba54004b379f6ab67a355e24c5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.213346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.305598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.306022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.306425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.319338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1361/2727] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:14 2022] PUT /identity/v3/projects/f3e681231252454eaf1506b6dfcddcec/users/173d35ba54004b379f6ab67a355e24c5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:14.323290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.326929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:14.342055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:14.349912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:14.415203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2dd9-70db-41b9-b451-4bf413e13566 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.420893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.421645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.422658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1367/2728] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:14.429042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.429396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.430269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.432217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.443618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.448332 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1362/2729] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:14.448499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:14.450956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.463098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2d3a-2100-4891-8b25-f71e8f5cb9d1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.469001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.469744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.474971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.474971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] PATH_INFO: `/v3/projects/f3e681231252454eaf1506b6dfcddcec/users/173d35ba54004b379f6ab67a355e24c5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.474971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e681231252454eaf1506b6dfcddcec, user_id=173d35ba54004b379f6ab67a355e24c5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.477565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606abaf2-c630-49fb-a648-fba075a7832c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.502654 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1363/2730] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:14 2022] PUT /identity/v3/projects/f3e681231252454eaf1506b6dfcddcec/users/173d35ba54004b379f6ab67a355e24c5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:14.505117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.505419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.505739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.559255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] MFA Rules not processed for user `173d35ba54004b379f6ab67a355e24c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:14.563523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:14.582673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df856be1-1d6b-48c0-9d03-b5926e758875 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.592383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:14.663644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.664202 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1364/2731] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:14.665229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:14.666659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:14.670199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.670324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.670599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.746074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:14.757333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.758139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809710a8-6c2f-46ed-b5fb-85183f01414a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:14.759206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.765612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:14.766350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:14.766653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:14.766962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:14.768816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:14.773940 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1368/2732] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:24:14.794226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:14.797640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa70a-1187-41c2-b15b-f983424db54e service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:14.810184 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1365/2733] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:15.964707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:16.150026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd68b-3683-4722-8f22-1f128c0407b7 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:16.164175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:16.164887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:16.165208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:16.167048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:16.188888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:16.191073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:16.204566 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1369/2734] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:16.225966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410216-b539-4d15-9abf-0bb47cac8396 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:16.226941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410216-b539-4d15-9abf-0bb47cac8396 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:16.227379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44410216-b539-4d15-9abf-0bb47cac8396 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:16.229023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1366/2735] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:16.235287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:16.259774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:16.270297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac778835-4afb-450d-87bd-c6605551fdb1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:16.278491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:16.278491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:16.278491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:16.278931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:16.278931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:16.280655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:16.282860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1370/2736] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:16 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:17.164438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5089-b549-4b88-b160-389e05fb3af3 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:17.164714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5089-b549-4b88-b160-389e05fb3af3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:17.165172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5089-b549-4b88-b160-389e05fb3af3 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:17.166723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1367/2737] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:17.176702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:17.178654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:17.198174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:17.209727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b32ea-d3fc-49d1-bda2-c8e3fc530425 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:17.215417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:17.216373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:17.216853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:17.217347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:17.219402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:17.222544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea60b9-fe79-49f5-acf2-d0cd7784f23c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:17.233567 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1371/2738] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:17 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:17.466444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:17.467071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:17.467071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:17.514251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] MFA Rules not processed for user `cf672958a21c4763acd6f4cc82d9d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:17.518296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:17.575855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:17.580632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:17.581300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:17.637602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:17.639324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:17.684969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1368/2739] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:17.784628 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1372/2740] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:18.088465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:18.103326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4e865-e7a4-4f24-9138-44ff58120981 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:18.114926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:18.115859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:18.120291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:18.120291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:18.131965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:18.133943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:18.145679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1369/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:18.507171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:18.508646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:18.525057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab26b-7154-4986-a4f4-1fc7d0fc58c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:18.530606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:18.537260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:18.537260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:18.537260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:18.537260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:18.553058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:18.555522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e2d60-11d5-4fec-8ef9-23984964d7ae service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:18.571553 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1373/2742] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:18.759909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:18.762153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:18.840855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:18.898111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15d341-1e86-474c-a966-381209f4c643 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:18.904867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:18.906824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:18.907457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:18.907932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] PATH_INFO: `/v3/users/6eca2331ff25478e950c85c4a8d2f2b4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:18.909895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eca2331ff25478e950c85c4a8d2f2b4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:18.914148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:19.152932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eca2331ff25478e950c85c4a8d2f2b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:19.153724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eca2331ff25478e950c85c4a8d2f2b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:19.255085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eca2331ff25478e950c85c4a8d2f2b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:19.269887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eca2331ff25478e950c85c4a8d2f2b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:19.270806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eca2331ff25478e950c85c4a8d2f2b4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:19.283374 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1370/2743] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:18 2022] DELETE /identity/v3/users/6eca2331ff25478e950c85c4a8d2f2b4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:19.342446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:19.342759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:19.343236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:19.344926 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1374/2744] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:19.350992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:19.352500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:19.504445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:19.506866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:19.583243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:19.601069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963206-17c5-4341-877f-9eaf3f6dfeba admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:19.607780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:19.609655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:19.609655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:19.609848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:19.611299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:19.619427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b31631-be18-42ba-94ad-85b7bdb2eaae tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:19.621442 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1371/2745] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:19 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:19.650235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:19.652400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:19.798285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:19.820412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625fa1-eced-44b5-9cb3-b0f3bd0d693f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:19.829870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:19.831125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:19.831632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:19.832228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] PATH_INFO: `/v3/projects/cfc4de1d0b8a48e5b13e3c23e0f5cc56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:19.833946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc4de1d0b8a48e5b13e3c23e0f5cc56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:19.837596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:19.992593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:19.993145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:19.993145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:19.995971 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1372/2746] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:20.004803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:20.007194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.009602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc4de1d0b8a48e5b13e3c23e0f5cc56', 'request_id': 'req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:20.089510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:20.114492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc4de1d0b8a48e5b13e3c23e0f5cc56', 'request_id': 'req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:20.121558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc4de1d0b8a48e5b13e3c23e0f5cc56', 'request_id': 'req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:20.152068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] The token cache is being invalidate because project cfc4de1d0b8a48e5b13e3c23e0f5cc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:20.152068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:20.152068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eefaf94a-b55e-43e1-bb44-3d1bdc2c6b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:20.152068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1375/2747] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:19 2022] DELETE /identity/v3/projects/cfc4de1d0b8a48e5b13e3c23e0f5cc56 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:20.154552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.154869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.155140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.207569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:20.213122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.224307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3b92-017b-41d7-92ca-dcbba6b4b20a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:20.231353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:20.232559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.233302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.233649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.235765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:20.238546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649768ef-61a9-410e-bbae-b28eb0f0b6de tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:20.249358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1373/2748] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:20 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:20.379474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90fc-ead9-4713-a081-779a4e0bf1b1 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.379754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90fc-ead9-4713-a081-779a4e0bf1b1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.380236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90fc-ead9-4713-a081-779a4e0bf1b1 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.382531 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1374/2749] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:24:20.384558 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1376/2750] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:20.392999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.393277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.393594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.395352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:20.397303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.437525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:20.439087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.440796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:20.445513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.450766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1375/2751] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:20.455683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:20.472162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a9b33-eaa9-4d76-b5e6-e10b2c38dcc5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:20.474758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849b394-8121-4fa5-9190-b297882ce97b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:20.483311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:20.485006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.486119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.486394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.488154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:20.488154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:20.489304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:20.489946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.490384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.490810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.492150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:20.493909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:20.498085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:20.532238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1377/2752] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:20 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:20.554501 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1376/2753] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:20.558845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:20.573446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc343e5-77dd-483a-a939-6508bb5dc91e tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:20.588658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:20.590367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.590969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.591413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.592241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:20.596883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8d3e0-3ae7-4afe-bcd8-8e1c470612ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:20.731196 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1378/2754] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:20.736639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:20.765960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.766518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.767264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.783465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed260ee0-5814-4a80-958b-e3f9d362e6f0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:20.804421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] MFA Rules not processed for user `cf672958a21c4763acd6f4cc82d9d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:20.817084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:20.931481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:20.943776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:20.949391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:20.949391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:20.949391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:20.949391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:20.957037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:20.998265 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1379/2755] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:21.097344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:21.106976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1377/2756] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:20 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:21.107784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:21.129387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e486d7-f5ed-429e-a81a-f7b6adac5e61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:21.151082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:21.158394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.158394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.158394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.158394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:21.159902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:21.186913 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1380/2757] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:21.191256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:21.211393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159deb-3297-445d-8660-a17a09a8a075 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:21.216413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:21.217280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.217745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.218174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.219097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:21.220873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a0c27-8a34-4172-8789-ffc10fc09c74 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:21.236885 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1378/2758] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:21.241379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:21.265784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977352b4-6014-4597-8069-b5158593b148 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:21.281131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:21.282374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.282797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.283170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] PATH_INFO: `/v3/projects/52bbeecdb50f419da36108b6cb13ff1f/users/4afd080c900741648cc11b10e0ac9ea9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.303001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bbeecdb50f419da36108b6cb13ff1f, user_id=4afd080c900741648cc11b10e0ac9ea9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:21.306426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e38a75-613e-4b84-a987-01a4d54a6a8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:21.508603 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1381/2759] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:21 2022] PUT /identity/v3/projects/52bbeecdb50f419da36108b6cb13ff1f/users/4afd080c900741648cc11b10e0ac9ea9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:21.509506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.510052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.510417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.553626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] MFA Rules not processed for user `4afd080c900741648cc11b10e0ac9ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:21.554877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:21.575013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.575659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.576156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.578430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1382/2760] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:24:21.584466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:21.588278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:21.673892 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1379/2761] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:21.722995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:21.783106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:21.792369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c63c4-a09c-4e1a-8766-e895a235a9d5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:21.797116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:21.797794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.798137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.798734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.800246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:21.802293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636725d9-1a37-40e8-8baf-192a782342b3 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:21.803347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5a160-1ca9-4d8a-825a-ad993521a31c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:21.804042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1383/2762] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:21 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:21.810654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:21.810654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:21.810883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:21.811051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:21.820107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:21.821710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:21.832503 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1380/2763] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:22.129375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feebca-2100-4de1-8c82-bfb342154d44 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:22.129375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feebca-2100-4de1-8c82-bfb342154d44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:22.129375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feebca-2100-4de1-8c82-bfb342154d44 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:22.129375 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1384/2764] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:22.132358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:22.139299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:22.155961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a725b-3593-47bd-9275-b5b2942117d1 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:22.173377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:22.174230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:22.174937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:22.182152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:22.182152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:22.182152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:22.182862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1381/2765] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:22 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:22.468018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e641d-911e-4db5-bcef-efb7da6f8462 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:22.468548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e641d-911e-4db5-bcef-efb7da6f8462 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:22.468908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e641d-911e-4db5-bcef-efb7da6f8462 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:22.470395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1385/2766] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:22.475938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:22.490955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:22.501885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1928c-ae3e-4dc4-847d-b45133056a0c tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:22.509123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:22.510013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:22.510295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:22.510568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:22.511935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:22.524916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:22.526721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1382/2767] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:22 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:22.753762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743bfef-c94c-4809-b24f-a5f3691e91bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:22.756357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743bfef-c94c-4809-b24f-a5f3691e91bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:22.756641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743bfef-c94c-4809-b24f-a5f3691e91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:22.788965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c743bfef-c94c-4809-b24f-a5f3691e91bc None None] MFA Rules not processed for user `cf672958a21c4763acd6f4cc82d9d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:22.790173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c743bfef-c94c-4809-b24f-a5f3691e91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:22.851351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:22.897850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1386/2768] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:22.994337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb8ca-c79d-47e8-9f63-f4b6dbdbdc9a tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:23.023049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:23.026023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.026496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.027009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] PATH_INFO: `/v3/users/4afd080c900741648cc11b10e0ac9ea9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.029032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afd080c900741648cc11b10e0ac9ea9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:23.033606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:23.403463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afd080c900741648cc11b10e0ac9ea9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:23.404197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afd080c900741648cc11b10e0ac9ea9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:23.410073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:23.436925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.437472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.437764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.439638 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1387/2769] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:24:23.448719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:24:23.450771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:23.466522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:23.475333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:23.477067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:23.491147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988e78-dfca-45f3-a803-59c779fc8280 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:23.496327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '173d35ba54004b379f6ab67a355e24c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3e681231252454eaf1506b6dfcddcec', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:23.499250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.499250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.499250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.499250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorizing `identity:get_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:23.501356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14aee-9579-4416-b243-30a482f452a6 tempest-QuotasAdminNegativeTest-700405487 tempest-QuotasAdminNegativeTest-700405487-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:23.503229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1388/2770] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:24:23 2022] GET /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 383 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:23.520433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afd080c900741648cc11b10e0ac9ea9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:23.569010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afd080c900741648cc11b10e0ac9ea9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:23.570189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afd080c900741648cc11b10e0ac9ea9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:23.614759 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1383/2771] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:22 2022] DELETE /identity/v3/users/4afd080c900741648cc11b10e0ac9ea9 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:23.619787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.620339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.620831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.666290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:23.670185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:23.798379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1389/2772] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:23.809634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:23.811980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:23.878203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4c216-0adc-42b2-9e95-a012c2ca2ba0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:23.882717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:23.883347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.883650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.883928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.912063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:23.914165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29d998-3af8-4288-816c-cbd506ad12cd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:23.955028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:23.958918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1384/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:23.966166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:23.976410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef141f-f5b5-457f-a6cd-883d66b7cb43 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:23.981311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:23.981961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:23.982242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:23.982517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] PATH_INFO: `/v3/users/cf672958a21c4763acd6f4cc82d9d58d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:23.985194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf672958a21c4763acd6f4cc82d9d58d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:23.987250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:24.299895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf672958a21c4763acd6f4cc82d9d58d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:24.300985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf672958a21c4763acd6f4cc82d9d58d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:24.468233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf672958a21c4763acd6f4cc82d9d58d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:24.483375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf672958a21c4763acd6f4cc82d9d58d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:24.484480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf672958a21c4763acd6f4cc82d9d58d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:24.507958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1390/2774] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:23 2022] DELETE /identity/v3/users/cf672958a21c4763acd6f4cc82d9d58d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:24.509457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:24.509925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:24.510144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:24.535975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:24.537970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:24.610850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1385/2775] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:24.635348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:24.637736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:24.726843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802b85-864e-4d4f-976e-507cd01cafa8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:24.730971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:24.731796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:24.733547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:24.733547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:24.745479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:24.747410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41497e9-1ed8-499c-939d-3231e91af2f4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:24.747906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:24.750849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:24.768905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e6e3f-2380-40af-8c54-4f8f42ae6549 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:24.774858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:24.776180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1391/2776] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:24.777779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:24.781934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:24.781934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] PATH_INFO: `/v3/projects/52bbeecdb50f419da36108b6cb13ff1f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:24.781934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bbeecdb50f419da36108b6cb13ff1f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:24.782488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:24.995242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bbeecdb50f419da36108b6cb13ff1f', 'request_id': 'req-55d9828f-2fde-47bb-a191-3aab6f61e666'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:25.073949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bbeecdb50f419da36108b6cb13ff1f', 'request_id': 'req-55d9828f-2fde-47bb-a191-3aab6f61e666'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:25.089956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bbeecdb50f419da36108b6cb13ff1f', 'request_id': 'req-55d9828f-2fde-47bb-a191-3aab6f61e666'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:25.091881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:25.119998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] The token cache is being invalidate because project 52bbeecdb50f419da36108b6cb13ff1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:25.120755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:25.121899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55d9828f-2fde-47bb-a191-3aab6f61e666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:25.127071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1386/2777] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:24 2022] DELETE /identity/v3/projects/52bbeecdb50f419da36108b6cb13ff1f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:25.134512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.135491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.136003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.163641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:25.166194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:25.173195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:25.286086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1392/2778] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:25.288442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.288787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.289291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.320201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:25.321863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:25.336880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1387/2779] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:25.341320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:25.356282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63efac-0611-44de-8115-36fed3bfb2b3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:25.361841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:25.362802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.363340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.363844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.364915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:25.365467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:25.381767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:25.427938 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1393/2780] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:25.432627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:25.445384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7b49-12ea-4a81-8dda-eed44800f602 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:25.458075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:25.458819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.459101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.459364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.460038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:25.464420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:25.597089 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1388/2781] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:25 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:25.602094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:25.620740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c482-6c00-4b75-a770-8f4f049915fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:25.756306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:25.758222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:25.770206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:25.771060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.771343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.771692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.772682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:25.774838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:25.907645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1394/2782] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:25 2022] POST /identity/v3/users => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:25.912982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:25.938650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9474-8d11-4ad9-a1d5-e893b555aa79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:25.940342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668139d-520a-491d-a91e-25d1b8d8e711 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:25.949094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:25.950126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.950548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:25.951040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.951197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:25.951460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:25.951865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] PATH_INFO: `/v3/projects/3578e366685444ffa499e78199c4c050` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.952119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:25.952959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:25.954319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3578e366685444ffa499e78199c4c050)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:25.955424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:25.958725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:25.982341 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1395/2783] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:25.987717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.007886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de9e2f-34d5-48e5-95f4-89faea2ea067 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.012863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.013495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.013927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.014094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.014796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.016608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.027819 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1396/2784] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:26.040656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.059268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67499-90ca-4840-b0b9-ab57488b7306 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.064925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.069166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.069166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.069166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] PATH_INFO: `/v3/projects/673b9374296045ebb99ac07676f8c060/users/ad9d5fc427de45ef8fd806f3be14ee11/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.085868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673b9374296045ebb99ac07676f8c060, user_id=ad9d5fc427de45ef8fd806f3be14ee11, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.088932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4375-eba5-4293-b0a1-fae5a8062af6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.237244 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1397/2785] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:26 2022] PUT /identity/v3/projects/673b9374296045ebb99ac07676f8c060/users/ad9d5fc427de45ef8fd806f3be14ee11/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:26.249115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3578e366685444ffa499e78199c4c050', 'request_id': 'req-15a31958-09b6-4647-9461-77a913e12ea1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.249809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.250266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.250742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.293292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] MFA Rules not processed for user `ad9d5fc427de45ef8fd806f3be14ee11`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:26.295242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:26.334062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3578e366685444ffa499e78199c4c050', 'request_id': 'req-15a31958-09b6-4647-9461-77a913e12ea1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.347406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3578e366685444ffa499e78199c4c050', 'request_id': 'req-15a31958-09b6-4647-9461-77a913e12ea1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.365749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] The token cache is being invalidate because project 3578e366685444ffa499e78199c4c050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:26.366225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.367303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.372430 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1389/2786] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:25 2022] DELETE /identity/v3/projects/3578e366685444ffa499e78199c4c050 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:26.375827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.378765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:26.482123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1398/2787] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:26.486193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.489933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:26.551029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31958-09b6-4647-9461-77a913e12ea1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.607014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d110bb-afba-46a2-b7b6-ea6b004dc853 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.618747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.619655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.620111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.620597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.621275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.626493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.630125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.631551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.632200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.632788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] PATH_INFO: `/v3/users/173d35ba54004b379f6ab67a355e24c5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.635691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] RBAC: Authorizing `identity:delete_user(user_id=173d35ba54004b379f6ab67a355e24c5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.640757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:26.641723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.691240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:26.729235 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1399/2788] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:26 2022] POST /identity/v3/projects => generated 403 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:26.733809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.825522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a93f9e-e7b0-4ec3-9dc9-ff1fd2ba3a04 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.831004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.831606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.831875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.832156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.832770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.834788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.917067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173d35ba54004b379f6ab67a355e24c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.917809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173d35ba54004b379f6ab67a355e24c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:26.938749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1400/2789] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:26 2022] POST /identity/v3/users => generated 308 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:26.943517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:26.950766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:26.966073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd6591-0479-457e-bd05-d7ef12994abf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:26.974115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:26.974115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:26.974115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:26.974115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:26.974711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:26.976475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:26.998663 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1401/2790] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:27.004146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.015592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1f66-e3f4-4af7-9629-364f4325b79e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.022903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:27.023850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.024208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.024486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] PATH_INFO: `/v3/projects/b30fabcafc7c4c2e931ddd90504754c8/users/5a1eba35f0ca4464b0e51bf6ecb2c24d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.042894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30fabcafc7c4c2e931ddd90504754c8, user_id=5a1eba35f0ca4464b0e51bf6ecb2c24d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:27.046650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:27.049494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173d35ba54004b379f6ab67a355e24c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:27.070766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173d35ba54004b379f6ab67a355e24c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:27.072050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173d35ba54004b379f6ab67a355e24c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:27.095838 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1390/2791] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:26 2022] DELETE /identity/v3/users/173d35ba54004b379f6ab67a355e24c5 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:27.147126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1402/2792] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:27 2022] PUT /identity/v3/projects/b30fabcafc7c4c2e931ddd90504754c8/users/5a1eba35f0ca4464b0e51bf6ecb2c24d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:27.148621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.242093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098d753-e009-4c99-8b0a-b6254c76961e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.318982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:27.319618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.319897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.320284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.321129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:27.334376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c556a2-04b8-4d20-87e4-dbc47b632052 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:27.347832 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1391/2793] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:27.349306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.366478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce501d0-1612-4739-b65e-72c6ef3e2241 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.372437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:27.373498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.373922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.375042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] PATH_INFO: `/v3/projects/b30fabcafc7c4c2e931ddd90504754c8/users/5a1eba35f0ca4464b0e51bf6ecb2c24d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.377957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30fabcafc7c4c2e931ddd90504754c8, user_id=5a1eba35f0ca4464b0e51bf6ecb2c24d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:27.381321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:27.408121 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1403/2794] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:27 2022] PUT /identity/v3/projects/b30fabcafc7c4c2e931ddd90504754c8/users/5a1eba35f0ca4464b0e51bf6ecb2c24d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:27.414641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.414641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.414641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.455402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] MFA Rules not processed for user `5a1eba35f0ca4464b0e51bf6ecb2c24d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:27.457303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:27.555516 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1392/2795] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:27.560238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.571355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd0558-6d90-441b-8de3-b08d6e12cd8c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.577018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eba35f0ca4464b0e51bf6ecb2c24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30fabcafc7c4c2e931ddd90504754c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:27.577826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.578163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.578425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.579168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:27.580564 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:27.580564 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:27.580564 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:27.581069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:27.724289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:27.740732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.742648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:27.746269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1404/2796] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:24:27 2022] POST /identity/v3/roles => generated 239 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:27.747111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.768407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18ba3-85e9-446e-a88c-31ecb2b65da4 tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.774269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eba35f0ca4464b0e51bf6ecb2c24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30fabcafc7c4c2e931ddd90504754c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:27.775086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:27.775326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:27.775695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] PATH_INFO: `/v3/projects/673b9374296045ebb99ac07676f8c060/users/ad9d5fc427de45ef8fd806f3be14ee11/roles/7fdd9ea605494d48a33c03237f00bc7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:27.779570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorizing `identity:create_grant(project_id=673b9374296045ebb99ac07676f8c060, user_id=ad9d5fc427de45ef8fd806f3be14ee11, role_id=7fdd9ea605494d48a33c03237f00bc7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:27.783083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:27.864592 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1405/2797] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:27 2022] PUT /identity/v3/projects/673b9374296045ebb99ac07676f8c060/users/ad9d5fc427de45ef8fd806f3be14ee11/roles/7fdd9ea605494d48a33c03237f00bc7f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:27.871272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:27.877301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd2aa5-9910-4a30-a7a9-ccaed7ff4270 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:27.877744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:27.974056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:28.115078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.115078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.115078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] PATH_INFO: `/v3/projects/f3e681231252454eaf1506b6dfcddcec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.115078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e681231252454eaf1506b6dfcddcec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:28.115078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:28.115561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82015569-f3f7-4457-9b27-2069d46d62ce tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:28.115561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9d5fc427de45ef8fd806f3be14ee11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673b9374296045ebb99ac07676f8c060', 'project_domain_id': 'default', 'roles': ['tempest-test_role-409279263', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:28.115561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.115869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.115869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] PATH_INFO: `/v3/users/ad9d5fc427de45ef8fd806f3be14ee11/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.115869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: Authorizing `identity:create_application_credential(user_id=ad9d5fc427de45ef8fd806f3be14ee11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:28.115869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d15f-ead3-45f7-b061-8d06a6599fb1 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:28.514180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1406/2798] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:24:27 2022] POST /identity/v3/users/ad9d5fc427de45ef8fd806f3be14ee11/application_credentials => generated 658 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:28.519414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.519948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.520320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.529930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e681231252454eaf1506b6dfcddcec', 'request_id': 'req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:28.557062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] MFA Rules not processed for user `ad9d5fc427de45ef8fd806f3be14ee11`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:28.558454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:28.634000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e681231252454eaf1506b6dfcddcec', 'request_id': 'req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:28.640195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e681231252454eaf1506b6dfcddcec', 'request_id': 'req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:28.655256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] The token cache is being invalidate because project f3e681231252454eaf1506b6dfcddcec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:28.661570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:28.661570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:28.661570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84af6bf5-b90c-4135-8f1f-21f2085f1f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:28.662165 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1393/2799] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:27 2022] DELETE /identity/v3/projects/f3e681231252454eaf1506b6dfcddcec => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:28.667804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a91732-9023-4474-b394-368c7ffbd632 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.668090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a91732-9023-4474-b394-368c7ffbd632 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.668365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a91732-9023-4474-b394-368c7ffbd632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.696844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-85a91732-9023-4474-b394-368c7ffbd632 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:28.698228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-85a91732-9023-4474-b394-368c7ffbd632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:28.747272 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1407/2800] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 14:24:28.750398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:28.823890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1394/2801] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:28.826287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.826846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.827301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.847476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d606-5f72-4d4a-9d5c-7f0c93851d0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:28.852443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:28.853647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:28.857231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad9d5fc427de45ef8fd806f3be14ee11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673b9374296045ebb99ac07676f8c060', 'project_domain_id': 'default', 'roles': ['tempest-test_role-409279263', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:28.858137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.858474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.858806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] PATH_INFO: `/v3/users/ad9d5fc427de45ef8fd806f3be14ee11/application_credentials/4a5b2382338646ed8743d69f03785699` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.861175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ad9d5fc427de45ef8fd806f3be14ee11, application_credential_id=4a5b2382338646ed8743d69f03785699)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:28.863378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:28.867450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1395/2802] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:28.871316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:28.881570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fe446-ebe3-4c20-801a-a318792644d7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:28.887152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:28.888115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.888568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.889007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.889841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:28.890310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:28.892305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:28.914934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1396/2803] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:28.920373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:28.928514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6627-da62-4ff8-b139-e436c9d94f8d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:28.937116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:28.938768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:28.939319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:28.939809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:28.940708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:28.943148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.021072 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1408/2804] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:24:28 2022] DELETE /identity/v3/users/ad9d5fc427de45ef8fd806f3be14ee11/application_credentials/4a5b2382338646ed8743d69f03785699 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:29.023901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.025984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:29.055603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1397/2805] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:28 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:29.056592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.208788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0b5b7-71c3-47e8-a58e-328ad75f99c6 tempest-ApplicationCredentialsV3AdminTest-2091301233 tempest-ApplicationCredentialsV3AdminTest-2091301233-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.218037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbfbb-c188-4744-93fe-ad369d0dfa49 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.235998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.237228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.237579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.237915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.238641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.242424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bbe1e-2000-480c-aae9-2e1d74fd5a17 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.302959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eba35f0ca4464b0e51bf6ecb2c24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30fabcafc7c4c2e931ddd90504754c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.303602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.303885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.304161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] PATH_INFO: `/v3/roles/7fdd9ea605494d48a33c03237f00bc7f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.305571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7fdd9ea605494d48a33c03237f00bc7f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.306860 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:29.306860 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:29.306860 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:29.313808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.466267 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1398/2806] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:29 2022] POST /identity/v3/users => generated 295 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:29.467886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962be0-29da-4de5-9549-879bccd43862 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.468365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962be0-29da-4de5-9549-879bccd43862 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.468824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66962be0-29da-4de5-9549-879bccd43862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.493886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-66962be0-29da-4de5-9549-879bccd43862 None None] MFA Rules not processed for user `1bf9e8a3a122438c95ca0705008a816c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:29.493886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66962be0-29da-4de5-9549-879bccd43862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:29.494231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:29.549077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Invalidating the token cache because role 7fdd9ea605494d48a33c03237f00bc7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:29.549807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:29.550255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:29.560105 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1399/2808] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:29.560105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66962be0-29da-4de5-9549-879bccd43862 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.560443 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1409/2808] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:29 2022] DELETE /identity/v3/roles/7fdd9ea605494d48a33c03237f00bc7f => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:29.560443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.560443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:29.562304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66962be0-29da-4de5-9549-879bccd43862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:29.581389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66962be0-29da-4de5-9549-879bccd43862 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.665770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e596e6-f3e1-487b-8dfb-0889773e8cfe tempest-ApplicationCredentialsV3AdminTest-1641223350 tempest-ApplicationCredentialsV3AdminTest-1641223350-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.669911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.669911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.670281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.670661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.670949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.671492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.671619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.671852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.672112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] PATH_INFO: `/v3/users/ad9d5fc427de45ef8fd806f3be14ee11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.673436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9d5fc427de45ef8fd806f3be14ee11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.675469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.675729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.703307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1400/2809] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:29.706300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.727356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad07ca-63a5-4ace-b5b3-f9df2078a7a8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.732205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.732921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.733246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.733525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.734171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.735910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.751388 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1401/2810] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:29.756453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:29.770418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfba92-49ec-4a1a-82d5-e29c4d99a295 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:29.776655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:29.778028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.787985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.787985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] PATH_INFO: `/v3/projects/22bced36eaf547a58dec1a2dd8b2aff1/users/d17bb8de2381411a8b8ed4237782b2ef/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.798920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bced36eaf547a58dec1a2dd8b2aff1, user_id=d17bb8de2381411a8b8ed4237782b2ef, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:29.801955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d20de-d5b1-4381-8da4-02c3590254d4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:29.884735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9d5fc427de45ef8fd806f3be14ee11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:29.885637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9d5fc427de45ef8fd806f3be14ee11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:29.909719 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1402/2811] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:29 2022] PUT /identity/v3/projects/22bced36eaf547a58dec1a2dd8b2aff1/users/d17bb8de2381411a8b8ed4237782b2ef/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:29.921076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:29.921648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:29.922161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:29.954981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] MFA Rules not processed for user `d17bb8de2381411a8b8ed4237782b2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:29.956358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:29.992452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9d5fc427de45ef8fd806f3be14ee11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:30.012253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9d5fc427de45ef8fd806f3be14ee11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:30.012890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8aee6226-e80f-4d74-9507-cc9c43503656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9d5fc427de45ef8fd806f3be14ee11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:30.036295 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1410/2812] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:29 2022] DELETE /identity/v3/users/ad9d5fc427de45ef8fd806f3be14ee11 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:30.037431 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1403/2813] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:30.038602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.038761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.038986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.039186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.039960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:30.067542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:30.069112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:30.126012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eaffc-7cef-4d64-b45e-d727f24479c3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.204987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:30.205793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.206069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.206663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.211532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:30.213330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:30.329804 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1411/2814] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:30.340568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.343164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:30.344848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1404/2815] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:30 2022] POST /identity/v3/projects => generated 391 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:30.351035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.437560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5009f7-b312-4c12-bf37-8aa7b2ef72cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.449026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091e6a-d54a-44da-bd21-959e26b7b435 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.454532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:30.455223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.455477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.455751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.456394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:30.458389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:30.546745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:30.546745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.546745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.546745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.567152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:30.569408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:30.584758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1405/2816] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:30 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:30.587615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.594901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1412/2817] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:30.615292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd975b-f44d-408b-b272-0d64d675cbcf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.627344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:30.628079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.628289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.628496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.629215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:30.631779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:30.641041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:30.654545 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1406/2818] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:30.659904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.671365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba2d5d-391f-47b2-ab71-668a5d7b1a92 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.685291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:30.685978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:30.686259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:30.686658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] PATH_INFO: `/v3/projects/522308fc1a16482eb0a000dcd09f8938/users/152842ed45634d598541f70f08535f62/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:30.728628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] RBAC: Authorizing `identity:create_grant(project_id=522308fc1a16482eb0a000dcd09f8938, user_id=152842ed45634d598541f70f08535f62, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:30.732758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:30.864664 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1413/2819] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:30 2022] PUT /identity/v3/projects/522308fc1a16482eb0a000dcd09f8938/users/152842ed45634d598541f70f08535f62/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:30.868716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:30.882717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797431-57af-48e6-b697-b2219321d63d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:30.974246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:31.014999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:31.016998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:31.017395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:31.017765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:31.019139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:31.023476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ffb01-a6dc-41ee-abbf-d32bf3e88a5c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:31.049012 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1407/2820] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:31.054986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:31.065060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8fc3-a5ef-4072-abca-0a5af155707a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:31.072072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:31.076666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:31.077651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:31.078872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] PATH_INFO: `/v3/projects/522308fc1a16482eb0a000dcd09f8938/users/152842ed45634d598541f70f08535f62/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:31.081978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522308fc1a16482eb0a000dcd09f8938, user_id=152842ed45634d598541f70f08535f62, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:31.093343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:31.132974 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1414/2821] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:31 2022] PUT /identity/v3/projects/522308fc1a16482eb0a000dcd09f8938/users/152842ed45634d598541f70f08535f62/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:31.135574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:31.136605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:31.137049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:31.176446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] MFA Rules not processed for user `152842ed45634d598541f70f08535f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:31.177778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:31.336949 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1408/2822] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:31.345349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:31.360190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:31.462827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead00ea-2607-4274-8038-23be73113ff1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:31.469614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:31.470241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:31.470566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:31.470891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:31.551966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:31.553708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:31.574761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1415/2823] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:31.581969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:31.583473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:31.588968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:31.725725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223bdc1-5f25-4654-b3b2-2dc5f8b994d6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:31.730769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:31.731431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:31.732011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:31.732407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] PATH_INFO: `/v3/projects/673b9374296045ebb99ac07676f8c060` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:31.733539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673b9374296045ebb99ac07676f8c060)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:31.736902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:31.948458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673b9374296045ebb99ac07676f8c060', 'request_id': 'req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.054331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673b9374296045ebb99ac07676f8c060', 'request_id': 'req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.060568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673b9374296045ebb99ac07676f8c060', 'request_id': 'req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.073076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] The token cache is being invalidate because project 673b9374296045ebb99ac07676f8c060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:32.073510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.074329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.076236 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1409/2824] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:31 2022] DELETE /identity/v3/projects/673b9374296045ebb99ac07676f8c060 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:32.081237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:32.094666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f8dc4-c8f9-4deb-969b-ad83cc050fd3 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:32.173029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:32.173748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:32.174114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:32.174452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] PATH_INFO: `/v3/users/5a1eba35f0ca4464b0e51bf6ecb2c24d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:32.175770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1eba35f0ca4464b0e51bf6ecb2c24d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:32.178197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:32.428383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1eba35f0ca4464b0e51bf6ecb2c24d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.429079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1eba35f0ca4464b0e51bf6ecb2c24d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.494343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1eba35f0ca4464b0e51bf6ecb2c24d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.510351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1eba35f0ca4464b0e51bf6ecb2c24d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.511194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1eba35f0ca4464b0e51bf6ecb2c24d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:32.529361 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1416/2825] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:32 2022] DELETE /identity/v3/users/5a1eba35f0ca4464b0e51bf6ecb2c24d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:32.913676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:32.916177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:33.019873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce129df-7fb9-4d26-9ec2-3384ff8e56f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:33.031353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:33.033096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:33.094801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:33.167615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:33.168236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.168492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.168806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.170541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:33.171702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8115a-f0e0-40fe-a9d6-4cc7cb6a50bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:33.177862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:33.178818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.181683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.181683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] PATH_INFO: `/v3/projects/b30fabcafc7c4c2e931ddd90504754c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.182406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30fabcafc7c4c2e931ddd90504754c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:33.184929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:33.263991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:33.265606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04ae6e-62ed-4ef2-9038-dae1b70eb3f5 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:33.281002 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1410/2826] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:33.334840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30fabcafc7c4c2e931ddd90504754c8', 'request_id': 'req-f8596d74-e087-4db7-8a5e-5b6e27c34a14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:33.444400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30fabcafc7c4c2e931ddd90504754c8', 'request_id': 'req-f8596d74-e087-4db7-8a5e-5b6e27c34a14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:33.455957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30fabcafc7c4c2e931ddd90504754c8', 'request_id': 'req-f8596d74-e087-4db7-8a5e-5b6e27c34a14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:33.490751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] The token cache is being invalidate because project b30fabcafc7c4c2e931ddd90504754c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:33.490751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:33.492760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8596d74-e087-4db7-8a5e-5b6e27c34a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:33.495752 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1417/2827] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:33 2022] DELETE /identity/v3/projects/b30fabcafc7c4c2e931ddd90504754c8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:33.501594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774d85-1069-4b78-b2de-b4966032076c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.501883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774d85-1069-4b78-b2de-b4966032076c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.502160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774d85-1069-4b78-b2de-b4966032076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.533137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-94774d85-1069-4b78-b2de-b4966032076c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:33.555734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94774d85-1069-4b78-b2de-b4966032076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:33.649223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1411/2828] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:33.657387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.657666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.657938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.679069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:33.680289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:33.689350 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1418/2829] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:33.693814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774d85-1069-4b78-b2de-b4966032076c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:33.704357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774d85-1069-4b78-b2de-b4966032076c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:33.715180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:33.715812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.716139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.716413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.717077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:33.717380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:33.719106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:33.735035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1412/2830] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:33.737240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:33.746225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150ff94-ba78-4a4e-a835-22d255f90d48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:33.751655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:33.752258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.752532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.752801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.754122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:33.756186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:33.892613 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1419/2831] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:33 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:33.894062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:33.909019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7f73a-9152-48b6-a7e0-c7d8a3fe66d8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:33.985968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:33.986926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:33.987203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:33.987472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:33.988109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:33.990039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.123555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1413/2832] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:33 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:34.128318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.139794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627bc2c-5676-4cb3-9988-d094ef67575f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.144938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.147769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.147769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.147769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.147769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.148424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.162970 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1420/2833] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:34.164402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.177986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c01a6-6d4a-4700-9ca7-bf461cfb7268 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.189599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.190610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.191083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.191485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.192472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.194591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa6524-011c-4215-a43c-8e58b9c74f68 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.216107 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1414/2834] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:34.218853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.229841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab34e2-0da4-4e2a-b1ca-cf650e1b5371 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.235852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.236646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.236953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.237191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] PATH_INFO: `/v3/projects/f958a27475324c58a53ce1767d8919cf/users/ab1044f301a04fdab503c9b083327781/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.256310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f958a27475324c58a53ce1767d8919cf, user_id=ab1044f301a04fdab503c9b083327781, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.260520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.341390 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1421/2835] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:34 2022] PUT /identity/v3/projects/f958a27475324c58a53ce1767d8919cf/users/ab1044f301a04fdab503c9b083327781/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:34.352575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.352862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.353169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.361285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:34.400229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] MFA Rules not processed for user `ab1044f301a04fdab503c9b083327781`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:34.401514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:34.471856 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1415/2836] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:34.478014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.565896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e1d0-e57c-46bf-9098-293c55188468 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.571205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.571922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.572419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.572992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.574829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.577047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.669249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1422/2837] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:34 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:34.678870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.693712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d2224-1203-4285-8d3b-f9d78aaf20ea None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.791143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.791852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.792207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.792568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.793464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.796589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.866841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.872194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:34.892491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1416/2838] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:34 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:34.893139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.911091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73a47-f407-4827-b7d2-5f0a4597ab85 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.916898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.917654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.918010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.918359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.919267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.921035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.931895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1417/2839] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:34.938880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:34.951491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c703b2e-4aea-4bb5-b1a1-168bc94be901 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.957535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.958423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.958762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.959041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] PATH_INFO: `/v3/projects/12091d0cb00f4f2fa5f577bbceae1988/users/01aa651a871342dbb23c0224be010092/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.975988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12091d0cb00f4f2fa5f577bbceae1988, user_id=01aa651a871342dbb23c0224be010092, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:34.979147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:34.980926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072964f-f1ad-4569-bbb3-7d652c557fd8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:34.987539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:34.988152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:34.988497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:34.988772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:34.990595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:35.060915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1418/2840] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:34 2022] PUT /identity/v3/projects/12091d0cb00f4f2fa5f577bbceae1988/users/01aa651a871342dbb23c0224be010092/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:35.073262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.074292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.076153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.094647 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1423/2841] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:35.219935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66c0f6-b367-42ff-abe4-8f59f163a66a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.226779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.227460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.227808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.228148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.228917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.230796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424f04-4995-4e4e-b235-b1f46f92e9ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.245671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1419/2842] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:35.249649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.260455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff8ab-356e-4c93-9514-8883f21448b5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.277740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.283664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.283664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.283664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] PATH_INFO: `/v3/projects/12091d0cb00f4f2fa5f577bbceae1988/users/01aa651a871342dbb23c0224be010092/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.283664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12091d0cb00f4f2fa5f577bbceae1988, user_id=01aa651a871342dbb23c0224be010092, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.284422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.303584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:35.307240 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1424/2843] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:35 2022] PUT /identity/v3/projects/12091d0cb00f4f2fa5f577bbceae1988/users/01aa651a871342dbb23c0224be010092/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:35.308734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.309021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.309293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.339618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] MFA Rules not processed for user `01aa651a871342dbb23c0224be010092`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:35.340922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:35.451727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1420/2844] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:35.455424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.470816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0fdf2-50ff-4cf4-a433-82ac9032d6e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.478719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.479576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.480040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.480504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.481559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.482877 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:35.482877 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:35.482877 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:35.484248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.557667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:35.565000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1425/2845] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:24:35 2022] POST /identity/v3/domains => generated 277 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:35.569214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.595108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad17fed-5feb-462c-ad4a-6f3849f75c4f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.687173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.688332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.688610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.688879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.689627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.691630 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:35.691630 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:35.691630 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:35.693389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.827436 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1421/2846] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:35 2022] POST /identity/v3/groups => generated 280 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:35.827840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.842656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f05e-9934-4189-bc7b-a37b21a0c980 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.849471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.850116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.850398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.850762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.857071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:update_group(group_id=34a1eb7eaf6f495a9eb9bb958fa48509)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.859121 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:35.859121 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:35.859121 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:35.859505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.933463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1426/2847] 10.222.0.13 () {60 vars in 1247 bytes} [Mon Oct 31 14:24:35 2022] PATCH /identity/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509 => generated 293 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:35.940736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.955133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8fba-8acf-41b9-ac07-0da64fcc4b8b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:35.962349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:35.963257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:35.963567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:35.963845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:35.970407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:get_group(group_id=34a1eb7eaf6f495a9eb9bb958fa48509)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:35.981587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:35.981587 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1422/2848] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:35 2022] GET /identity/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:35.984901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:35.995458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d074-4627-4b16-ad47-7ee49ab2838c tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.001090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.010263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.010263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.010263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.010263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:update_group(group_id=34a1eb7eaf6f495a9eb9bb958fa48509)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.010263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:36.092472 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1427/2849] 10.222.0.13 () {60 vars in 1246 bytes} [Mon Oct 31 14:24:35 2022] PATCH /identity/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509 => generated 309 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:36.096779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:36.111038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08ffa-6454-4570-8b38-98680dae295b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.118791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.119690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.120372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.120939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.128535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=34a1eb7eaf6f495a9eb9bb958fa48509)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.129886 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:36.129886 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:36.129886 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:36.131830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:36.303732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:36.307278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1423/2850] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:36 2022] DELETE /identity/v3/groups/34a1eb7eaf6f495a9eb9bb958fa48509 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:36.314225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:36.327119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c78e-2e37-4dc0-9bec-aa994c395fd0 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.398955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.399676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.400207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.400671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.401932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.403474 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:36.403474 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:36.403474 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:36.405260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:36.509273 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1428/2851] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:36 2022] POST /identity/v3/groups => generated 326 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:36.513657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:36.532737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f925-69ba-4759-9787-527ffc850597 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.541072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.542546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.543471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.543822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.545339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.548593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:36.558333 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.server.flask.common [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 14:24:36.576929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:36.634515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1424/2852] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:36 2022] POST /identity/v3/users => generated 323 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:36.638414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:36.648798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e4ef-d485-4c0c-974a-544a103aa350 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.653904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.654885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.655604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.659585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.677622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=0ef9a1a2086a430ea31e4b21a5f8d0f3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.683593 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:36.683593 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:36.683593 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:36.683593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:36.773689 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1429/2853] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:24:36 2022] PUT /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:36.778212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:36.790599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909233-ff7e-45ee-9a6d-9536adbea407 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:36.867209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:36.867958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:36.868245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:36.868523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:36.870235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:36.871308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.017908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.018795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1425/2854] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:36 2022] POST /identity/v3/users => generated 321 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:37.028892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae079511-783f-40f2-9b2c-a6424585e4e8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.034387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.035161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.035490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.036152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.053727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=72bafee086ee4ce9ba96972122f70c22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.055938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.212650 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1430/2855] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:24:37 2022] PUT /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:37.214927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.246322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfbe79-48b3-406d-bd39-965a1e5d2286 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.381946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.381946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.381946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.382796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.382796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.385802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.522976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1426/2856] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:37 2022] POST /identity/v3/users => generated 319 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:37.527010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.554951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07932-c397-4332-bff1-11dc392ae651 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.564122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.565057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.565527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.565797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.583010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=5b44056a01404ecd952c2f749bbb4718)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.585314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.745056 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1431/2857] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:24:37 2022] PUT /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:37.747949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.762959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be41c8-6fcc-4215-b2ba-a35bdda3251e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.823567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.824210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.824570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.824863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.826143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.827509 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:37.827509 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:37.827509 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:37.828824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.848113 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1427/2858] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 14:24:37 2022] GET /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users => generated 1079 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:37.852823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.864250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc8d9-0c1f-47a6-8698-90deca54e325 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.868949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.869711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.869998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.870275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.871954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:37.886267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=0ef9a1a2086a430ea31e4b21a5f8d0f3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.886267 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:37.886267 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:37.886267 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:37.886267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:37.888176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1432/2859] 10.222.0.13 () {58 vars in 1342 bytes} [Mon Oct 31 14:24:37 2022] HEAD /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:37.898913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:37.902766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99fb58-7e35-4574-a638-5905914c6b44 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:37.908570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:37.909264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:37.909543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:37.909820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:37.911651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=0ef9a1a2086a430ea31e4b21a5f8d0f3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:37.913446 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:37.913446 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:37.913446 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:37.914938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:38.070695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:38.185894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:38.196898 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1428/2860] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:24:37 2022] DELETE /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/0ef9a1a2086a430ea31e4b21a5f8d0f3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:38.200716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:38.217955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97f25-d6dc-4cd3-ab5c-1a7acc284f56 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:38.296966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:38.298032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:38.298384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:38.298573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:38.300375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=72bafee086ee4ce9ba96972122f70c22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:38.303056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:38.324456 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1433/2861] 10.222.0.13 () {58 vars in 1342 bytes} [Mon Oct 31 14:24:38 2022] HEAD /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:38.329599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:38.341896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5b01-af7e-4ebc-b31d-e3bfef832225 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:38.348828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:38.349664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:38.349944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:38.350421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:38.352522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=72bafee086ee4ce9ba96972122f70c22)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:38.354656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:38.465054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:38.575096 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1429/2862] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:24:38 2022] DELETE /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/72bafee086ee4ce9ba96972122f70c22 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:38.579160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:38.589167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e4d0-3fd9-4e0c-9fe4-bc3477c90dd1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:38.675955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:38.676640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:38.676936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:38.677201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:38.679087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=5b44056a01404ecd952c2f749bbb4718)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:38.680996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:38.694715 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1434/2863] 10.222.0.13 () {58 vars in 1342 bytes} [Mon Oct 31 14:24:38 2022] HEAD /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:38.699243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:38.710401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842e4b6-f287-441a-9d9e-a189107fe0a8 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:38.723304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:38.723968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:38.724254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:38.724533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:38.726185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948, user_id=5b44056a01404ecd952c2f749bbb4718)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:38.728149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:38.840750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:38.939761 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1430/2864] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:24:38 2022] DELETE /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users/5b44056a01404ecd952c2f749bbb4718 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:38.948139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:38.965277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77759-f60b-4d3d-9a9b-dcad65627117 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:39.031799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:39.032723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:39.032998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:39.033267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:39.034403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:39.035665 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:39.035665 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:39.035665 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:39.036929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:39.055906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1435/2865] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 14:24:38 2022] GET /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948/users => generated 145 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:39.060394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:39.071127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269770-ffdc-426a-b749-d1b90ce623bb tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:39.076370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:39.077097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:39.077451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:39.077791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users/5b44056a01404ecd952c2f749bbb4718` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:39.079589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b44056a01404ecd952c2f749bbb4718)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:39.081729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:39.221336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.222122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.334339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.348530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.349657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b44056a01404ecd952c2f749bbb4718'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.363495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1431/2866] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:39 2022] DELETE /identity/v3/users/5b44056a01404ecd952c2f749bbb4718 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:39.367512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:39.369213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:39.382023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e68504-5def-42a7-aa14-e4a7d72242b3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:39.439402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:39.440024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:39.440300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:39.440571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users/72bafee086ee4ce9ba96972122f70c22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:39.442128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=72bafee086ee4ce9ba96972122f70c22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:39.444343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:39.566004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.566936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.688251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.700996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.701785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bafee086ee4ce9ba96972122f70c22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.720585 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1436/2867] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:39 2022] DELETE /identity/v3/users/72bafee086ee4ce9ba96972122f70c22 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:39.725113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:39.735366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a291-c52a-4042-80c4-466a200a8a0e tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:39.797625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:39.798348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:39.798798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:39.799156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users/0ef9a1a2086a430ea31e4b21a5f8d0f3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:39.800437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ef9a1a2086a430ea31e4b21a5f8d0f3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:39.802691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:39.905165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:39.905827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.008247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.028531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:40.040592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.041282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef9a1a2086a430ea31e4b21a5f8d0f3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.055190 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1432/2868] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:39 2022] DELETE /identity/v3/users/0ef9a1a2086a430ea31e4b21a5f8d0f3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:40.059552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:40.061392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:40.074279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f170d-b305-428a-8d8b-f3b6ae2ff8f1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:40.132411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:40.133043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.133327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.133648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.134836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bf8fe5fc7d3344b68429e82d9bc84948)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:40.135845 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:40.135845 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:40.135845 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:40.137029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:40.180895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:40.182960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:40.184047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:40.273387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4bcf5-3f2e-4629-9e16-ce39b8cc4b0b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:40.278822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:40.280046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.280324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.280598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] PATH_INFO: `/v3/users/d17bb8de2381411a8b8ed4237782b2ef` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.282410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17bb8de2381411a8b8ed4237782b2ef)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:40.284418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:40.378927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1437/2869] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:40 2022] DELETE /identity/v3/groups/bf8fe5fc7d3344b68429e82d9bc84948 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:40.384383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:40.386120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:40.479396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2ff2-6a8b-454c-83f5-aab711cd8642 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:40.484043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:40.485161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.485919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.485919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.486331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:40.488273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:40.635195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1438/2870] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:40 2022] POST /identity/v3/groups => generated 326 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:40.639118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:40.643801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17bb8de2381411a8b8ed4237782b2ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.644733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17bb8de2381411a8b8ed4237782b2ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.649503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4d60-47d0-41dd-99c4-9b9872b74b76 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:40.654131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:40.654809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.655094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.655369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.655998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:40.658447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:40.834882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17bb8de2381411a8b8ed4237782b2ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.841735 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1439/2871] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:40 2022] POST /identity/v3/groups => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:40.847424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:40.849165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:40.857986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17bb8de2381411a8b8ed4237782b2ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.858842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-935e359f-fcd3-4c6c-a4f7-74bc186f7414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17bb8de2381411a8b8ed4237782b2ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:40.866122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0bcd8-e8c6-481b-b438-610346ebb66b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:40.874047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1433/2872] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:40 2022] DELETE /identity/v3/users/d17bb8de2381411a8b8ed4237782b2ef => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:40.878591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.878915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.879530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.883423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:40.889698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:40.889698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:40.889698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:40.889698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:40.889698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:40.920064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:40.921534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:40.992063 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1434/2873] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:41.002473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.004143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:41.014961 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1440/2874] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:40 2022] POST /identity/v3/groups => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:41.019320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.029662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7e31-c01e-483d-a474-fdae8ce6e59a tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.095500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91653619-f76d-4af7-aab3-1a42f2a567ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.100177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.100791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.101112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.101347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.114372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.115090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.120716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.120860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.120860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.120860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.121107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.121386 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:41.121386 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:41.121386 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:41.121386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.131123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1441/2875] 10.222.0.13 () {58 vars in 1125 bytes} [Mon Oct 31 14:24:41 2022] GET /identity/v3/groups => generated 1490 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:41.131307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1435/2876] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:41.136600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.151902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e70ec-cc80-4b16-b106-9e8d183e2183 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.159212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.160387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.160669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.161296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/433e7e3374bd4f948b7a3e285ac0d860` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.169619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=433e7e3374bd4f948b7a3e285ac0d860)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.172504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.381504 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1442/2877] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:41 2022] DELETE /identity/v3/groups/433e7e3374bd4f948b7a3e285ac0d860 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:41.385533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.399439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102e330-688e-470b-b5a6-2b7c10926ba4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.466575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.467337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.467623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.467954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/6dd786b324b3406dbff1787d3d27df41` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.474172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6dd786b324b3406dbff1787d3d27df41)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.476312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.539251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.597805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29224d-0066-491d-95d1-4145192a466d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.601733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.602460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.602769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.603037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.604800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:41.680938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.682341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.707066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1443/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:41.719848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.724920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1436/2879] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:41 2022] DELETE /identity/v3/groups/6dd786b324b3406dbff1787d3d27df41 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:41.726655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.728867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e78e7-a8ca-4795-8ae3-1f9d51fffd95 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.786516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.787311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.787858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.788148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.790573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:41.800820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.802375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.802706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879f40b-2e0b-42f7-a92e-6a703e4594ba tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.812140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1444/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:41.813916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:41.814787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.815332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.815515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:41.815641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.815929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/328a0becc4ca46f8a2c8133d897bbf76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.822071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=328a0becc4ca46f8a2c8133d897bbf76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.824116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.896758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b1e2d-c5ac-4e50-a67e-83a6298603a6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:41.901524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:41.902153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:41.902542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:41.903080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] PATH_INFO: `/v3/projects/22bced36eaf547a58dec1a2dd8b2aff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:41.904097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bced36eaf547a58dec1a2dd8b2aff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:41.907209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:41.982568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1437/2881] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:41 2022] DELETE /identity/v3/groups/328a0becc4ca46f8a2c8133d897bbf76 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:41.988112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.047193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bced36eaf547a58dec1a2dd8b2aff1', 'request_id': 'req-05276a5b-d034-411d-8663-1dd57abdd88a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.062711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1f4d-cff5-4bd3-b1e7-e145a6df236d tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.124501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.125349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.125690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.125866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.126589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.128735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:42.142711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bced36eaf547a58dec1a2dd8b2aff1', 'request_id': 'req-05276a5b-d034-411d-8663-1dd57abdd88a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.148937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bced36eaf547a58dec1a2dd8b2aff1', 'request_id': 'req-05276a5b-d034-411d-8663-1dd57abdd88a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.175133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] The token cache is being invalidate because project 22bced36eaf547a58dec1a2dd8b2aff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:42.175546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.176373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.178406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1445/2882] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:41 2022] DELETE /identity/v3/projects/22bced36eaf547a58dec1a2dd8b2aff1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:42.185039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.186338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:42.193721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:42.251538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1438/2883] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:41 2022] POST /identity/v3/users => generated 323 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:42.253417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.257884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:42.271868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d8ab-95c1-4bf5-8e73-0a9cbefa94db tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.276064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276a5b-d034-411d-8663-1dd57abdd88a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.276421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.277088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.277299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.277569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.278237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.280414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:42.283167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.283957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.284350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.284731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] PATH_INFO: `/v3/users/152842ed45634d598541f70f08535f62` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.286000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152842ed45634d598541f70f08535f62)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.288480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:42.375818 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1439/2884] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:42 2022] POST /identity/v3/groups => generated 327 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:42.379268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.388984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c80e1-ed43-4817-aa2a-8b44ba808b74 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.394478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.395910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.395910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.395910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/10a44df07d3f4a1fb80ed13917c49321/users/fec873024ee24af2bc4a79a8a93e4e87` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.421081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=10a44df07d3f4a1fb80ed13917c49321, user_id=fec873024ee24af2bc4a79a8a93e4e87)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.422170 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:42.422170 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:42.422170 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:42.423356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:42.571403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1440/2885] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:24:42 2022] PUT /identity/v3/groups/10a44df07d3f4a1fb80ed13917c49321/users/fec873024ee24af2bc4a79a8a93e4e87 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:42.575347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.626077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152842ed45634d598541f70f08535f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.626886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152842ed45634d598541f70f08535f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.642146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56c699-c6aa-43cc-b1aa-d746945992c1 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.647649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.647649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.647937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.648277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.648981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.651165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:42.725838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152842ed45634d598541f70f08535f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.740596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152842ed45634d598541f70f08535f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.741297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152842ed45634d598541f70f08535f62'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:42.755692 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1441/2886] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:24:42 2022] POST /identity/v3/groups => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:42.762018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:42.764396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:42.784456 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1446/2887] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:42 2022] DELETE /identity/v3/users/152842ed45634d598541f70f08535f62 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:42.785037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497041-e20d-4d09-a8de-c3b22eae723f tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:42.906889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:42.906889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:42.906889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:42.907446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/c05d13a8988c4fb6996e167f95d05c86/users/fec873024ee24af2bc4a79a8a93e4e87` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:42.913625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c05d13a8988c4fb6996e167f95d05c86, user_id=fec873024ee24af2bc4a79a8a93e4e87)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:42.915949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.037994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1442/2888] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:24:42 2022] PUT /identity/v3/groups/c05d13a8988c4fb6996e167f95d05c86/users/fec873024ee24af2bc4a79a8a93e4e87 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:43.041992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.054548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990e3f-9807-4dc4-9643-1e71ca0ab509 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.137547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.138184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.138463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.138769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users/fec873024ee24af2bc4a79a8a93e4e87/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.139934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=fec873024ee24af2bc4a79a8a93e4e87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.142170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.163283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1447/2889] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 14:24:43 2022] GET /identity/v3/users/fec873024ee24af2bc4a79a8a93e4e87/groups => generated 840 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:43.167600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.178245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a31d45-b93c-4598-bed1-e2e1b86cabc3 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.183161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.183789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.184071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.184559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/c05d13a8988c4fb6996e167f95d05c86` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.185521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c05d13a8988c4fb6996e167f95d05c86)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.193239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.271518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.273907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:43.319927 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1443/2890] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:43 2022] DELETE /identity/v3/groups/c05d13a8988c4fb6996e167f95d05c86 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:43.323795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.372853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc8c5-8794-4f8d-83a5-aca847e8a4ab tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.403264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:43.409626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15250fa-3901-43da-8a56-10d899f67839 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.416018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.416798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.417361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.418064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/groups/10a44df07d3f4a1fb80ed13917c49321` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.419736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_group(group_id=10a44df07d3f4a1fb80ed13917c49321)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.423156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.454452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.455153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.455693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.460614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] PATH_INFO: `/v3/projects/522308fc1a16482eb0a000dcd09f8938` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.460614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=522308fc1a16482eb0a000dcd09f8938)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.460614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.567359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522308fc1a16482eb0a000dcd09f8938', 'request_id': 'req-160ea38f-a13d-4b84-8cc8-f041b3bd316a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.570647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1444/2891] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:24:43 2022] DELETE /identity/v3/groups/10a44df07d3f4a1fb80ed13917c49321 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:43.574884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.663143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc5ee-d043-474f-8fca-1de067305d5b tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.670539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.671368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.672372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.672648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/users/fec873024ee24af2bc4a79a8a93e4e87` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.673946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fec873024ee24af2bc4a79a8a93e4e87)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.676010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.679492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522308fc1a16482eb0a000dcd09f8938', 'request_id': 'req-160ea38f-a13d-4b84-8cc8-f041b3bd316a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.691327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522308fc1a16482eb0a000dcd09f8938', 'request_id': 'req-160ea38f-a13d-4b84-8cc8-f041b3bd316a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.708013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] The token cache is being invalidate because project 522308fc1a16482eb0a000dcd09f8938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:43.708657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.715953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-160ea38f-a13d-4b84-8cc8-f041b3bd316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.715953 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1448/2892] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:43 2022] DELETE /identity/v3/projects/522308fc1a16482eb0a000dcd09f8938 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:43.720527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5aed-3e6c-48b1-a12c-650845ed9075 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.721122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5aed-3e6c-48b1-a12c-650845ed9075 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.721398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5aed-3e6c-48b1-a12c-650845ed9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.744115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7cea5aed-3e6c-48b1-a12c-650845ed9075 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:43.745388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7cea5aed-3e6c-48b1-a12c-650845ed9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:43.822781 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1449/2893] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:43.831332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.831797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.836109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:43.836265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.840278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec873024ee24af2bc4a79a8a93e4e87'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.841068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec873024ee24af2bc4a79a8a93e4e87'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.856522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:43.857708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:43.868106 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1450/2894] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:43.875972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.892109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cfa9f-bc49-4114-8a77-9a10bdc7f321 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.899729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.901546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.901903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.902907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.903652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:43.909854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.909854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.926129 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1451/2895] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:43.927162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.935872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec873024ee24af2bc4a79a8a93e4e87'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.944539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc4f-225e-486b-b21b-771ce5fe3bf3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:43.951025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec873024ee24af2bc4a79a8a93e4e87'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.952049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec873024ee24af2bc4a79a8a93e4e87'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:43.952779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:43.953640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:43.954004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:43.954351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:43.956341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:43.960325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:43.969396 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1445/2896] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:43 2022] DELETE /identity/v3/users/fec873024ee24af2bc4a79a8a93e4e87 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:43.976158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:43.978112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.051013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e90b-d555-45e3-a21d-a907200eaeb4 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.056952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.057811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.058277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.058890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/domains/7fb862f2a3ac4177a23f98959a4655a5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.060360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7fb862f2a3ac4177a23f98959a4655a5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.062758 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:44.062758 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:44.062758 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:44.064006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.088461 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1452/2897] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:43 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:44.092231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.094953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.095734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.197704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815a1f-cc87-4423-b5ee-f709e474405c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.208300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.209309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.211763 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1446/2898] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:24:43 2022] PATCH /identity/v3/domains/7fb862f2a3ac4177a23f98959a4655a5 => generated 278 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:44.216249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.218179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.304402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.306281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.306941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.307382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.308398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.310595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.349360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c9c88-00fc-46a8-83c7-b921713c9144 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.356469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01aa651a871342dbb23c0224be010092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12091d0cb00f4f2fa5f577bbceae1988', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.358805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.359719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.360148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] PATH_INFO: `/v3/domains/7fb862f2a3ac4177a23f98959a4655a5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.386232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7fb862f2a3ac4177a23f98959a4655a5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.387663 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:44.387663 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:44.387663 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:44.389118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.419832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.426696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.447893 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1453/2899] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:44 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:44.449788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.456292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.480255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ffb5-1179-48ec-8ea1-98708b35814e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.488201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.489574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.490126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.490561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.492225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.494138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.511139 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1454/2900] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:44.512979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.530121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108d382-c208-4a9d-9b36-3118dcc5caad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.537260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.538362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.538714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.538965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.539633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.541262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.571937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1455/2901] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:44.573190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.585312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9c534-ed6c-4d38-8b3d-7df95fe0bdfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.596980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.663970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.666254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.666254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.666254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] PATH_INFO: `/v3/projects/bf06c5c1d8be48a081f00abee2c6d38e/users/c3e1daec3443449b871a1d15b9cccb21/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.687328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf06c5c1d8be48a081f00abee2c6d38e, user_id=c3e1daec3443449b871a1d15b9cccb21, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.690843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940e618-4a5d-4a5e-b840-860090b36e1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.742584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.749165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.763329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] The token cache is being invalidate because project 7fb862f2a3ac4177a23f98959a4655a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:44.763623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.764279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.781976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.783430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.784025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7fb862f2a3ac4177a23f98959a4655a5', 'request_id': 'req-d2ee69e8-229f-4499-84d4-e49d5d8b9920'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:44.797113 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1447/2902] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:24:44 2022] DELETE /identity/v3/domains/7fb862f2a3ac4177a23f98959a4655a5 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:44.798031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.799512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.826342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee69e8-229f-4499-84d4-e49d5d8b9920 tempest-GroupsV3TestJSON-1275558626 tempest-GroupsV3TestJSON-1275558626-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.826598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1456/2903] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:44 2022] PUT /identity/v3/projects/bf06c5c1d8be48a081f00abee2c6d38e/users/c3e1daec3443449b871a1d15b9cccb21/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:44.835839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.836147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.836378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.874135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:44.876657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.883363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.886144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.886476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.886806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] PATH_INFO: `/v3/users/ab1044f301a04fdab503c9b083327781` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.888074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1044f301a04fdab503c9b083327781)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.890065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:44.965379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1457/2904] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:44.966382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:44.967843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:44.981672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b2f34-e75d-4c95-891c-03abf29f89bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:44.987074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:44.987781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:44.988310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:44.988649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:44.989407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:44.991627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.116246 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1458/2905] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:44 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:45.117305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.179367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7e4f5-b3c1-4d29-b64d-de0f50f55593 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.184338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.185077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.185437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.185766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.186448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.188586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.236790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1044f301a04fdab503c9b083327781'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:45.237846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1044f301a04fdab503c9b083327781'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:45.309339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1459/2906] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:45 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:45.313909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.315821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:45.330982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3a68-670b-4c16-bc8c-afd0f25e3c55 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.337831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.338596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.339132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.339502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.340803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.342726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.355692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1044f301a04fdab503c9b083327781'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:45.358055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1460/2907] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:45.362840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.371895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1044f301a04fdab503c9b083327781'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:45.372612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d66263f4-5c8a-4593-a39a-970e94bdfd57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1044f301a04fdab503c9b083327781'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:45.374741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c28220-159e-465b-80fb-89ad4b4f7465 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.380913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.385566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.385566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.385566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] PATH_INFO: `/v3/projects/77cfa96e5ba743a9a28f703aac375414/users/bc28d8e8a2544aa9a43a037f55693954/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.388807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1448/2908] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:44 2022] DELETE /identity/v3/users/ab1044f301a04fdab503c9b083327781 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:45.393501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.393853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.394116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.402019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cfa96e5ba743a9a28f703aac375414, user_id=bc28d8e8a2544aa9a43a037f55693954, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.406756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.415956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:45.417186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:45.496142 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1449/2909] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:45.506398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.508122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:45.534594 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1461/2910] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:45 2022] PUT /identity/v3/projects/77cfa96e5ba743a9a28f703aac375414/users/bc28d8e8a2544aa9a43a037f55693954/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:45.539027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.551997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:45.626832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca7654-a2b8-4c5d-8021-65fedde1a783 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.653011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3470d6-6ef0-4669-bd5e-eee94678e415 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.671358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.672084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.672318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.672589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.673346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.675523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.695162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1462/2911] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:45.695613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:45.712311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b7c76-1a6f-47bf-aceb-5c7256fa8b5e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:45.714278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.721673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.721673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.721673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.727109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.729311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:45.729644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94cf4e-bfb4-4abf-91a3-ae46df78637d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.730269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.730633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.730982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] PATH_INFO: `/v3/projects/77cfa96e5ba743a9a28f703aac375414/users/bc28d8e8a2544aa9a43a037f55693954/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.733369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cfa96e5ba743a9a28f703aac375414, user_id=bc28d8e8a2544aa9a43a037f55693954, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:45.736760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189810-33b9-468a-acf7-10b65a3b878f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:45.750108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1463/2912] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:45 2022] PUT /identity/v3/projects/77cfa96e5ba743a9a28f703aac375414/users/bc28d8e8a2544aa9a43a037f55693954/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:45.761533 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1450/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:45.768405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.768690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.772155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.816571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] MFA Rules not processed for user `bc28d8e8a2544aa9a43a037f55693954`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:45.818294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:45.910968 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1464/2914] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:45.924052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:45.924358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:45.924603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:45.968547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:45.974756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:46.089276 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1451/2915] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:46.114447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:46.116092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:46.256814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d12a0-b7df-4c68-9067-027ab86b9a47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:46.283836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:46.285348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:46.285763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:46.285913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:46.289354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:46.306567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:46.309064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:46.323205 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1465/2916] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:46.357063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:46.423134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:46.621490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:46.623256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:46.746418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ca145-ff9e-44cb-9965-d6b60efec30d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:46.759720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:46.760588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:46.761077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:46.761348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] PATH_INFO: `/v3/projects/f958a27475324c58a53ce1767d8919cf` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:46.763004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f958a27475324c58a53ce1767d8919cf)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:46.765046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:46.910426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f958a27475324c58a53ce1767d8919cf', 'request_id': 'req-1111c123-e424-4507-8d8c-6d53bd775418'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.006870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f958a27475324c58a53ce1767d8919cf', 'request_id': 'req-1111c123-e424-4507-8d8c-6d53bd775418'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.016421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f958a27475324c58a53ce1767d8919cf', 'request_id': 'req-1111c123-e424-4507-8d8c-6d53bd775418'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.040215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] The token cache is being invalidate because project f958a27475324c58a53ce1767d8919cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:47.041432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.042770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.048879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1452/2917] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:46 2022] DELETE /identity/v3/projects/f958a27475324c58a53ce1767d8919cf => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:47.050849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:47.064812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ef6cc-cfa3-4182-bb5d-7893e7a983e9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:47.174796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:47.175552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:47.175949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:47.176225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] PATH_INFO: `/v3/users/01aa651a871342dbb23c0224be010092` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:47.177411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01aa651a871342dbb23c0224be010092)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:47.179644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:47.610634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01aa651a871342dbb23c0224be010092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.611549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01aa651a871342dbb23c0224be010092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.752706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01aa651a871342dbb23c0224be010092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.772716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01aa651a871342dbb23c0224be010092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.773687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01aa651a871342dbb23c0224be010092'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:47.799879 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1466/2918] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:47 2022] DELETE /identity/v3/users/01aa651a871342dbb23c0224be010092 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:47.877411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:47.881033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:48.020389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111c123-e424-4507-8d8c-6d53bd775418 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:48.102415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:48.102415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:48.103003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:48.103791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:48.106227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:48.122941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:48.125355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c31eca-0364-44b6-9f78-af0bc004859c service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:48.149509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1453/2919] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:48.730081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:48.799034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:48.811270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:48.962498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:48.995370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966b99-47b8-4dbe-9727-d5409d13dfa0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:49.004009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:49.006398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:49.006398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:49.006398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] PATH_INFO: `/v3/projects/12091d0cb00f4f2fa5f577bbceae1988` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:49.007690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12091d0cb00f4f2fa5f577bbceae1988)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:49.010268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:49.259506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12091d0cb00f4f2fa5f577bbceae1988', 'request_id': 'req-5b8fc27c-b184-415d-8ba8-549f71b38165'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:49.371390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12091d0cb00f4f2fa5f577bbceae1988', 'request_id': 'req-5b8fc27c-b184-415d-8ba8-549f71b38165'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:49.382343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12091d0cb00f4f2fa5f577bbceae1988', 'request_id': 'req-5b8fc27c-b184-415d-8ba8-549f71b38165'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:49.414422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] The token cache is being invalidate because project 12091d0cb00f4f2fa5f577bbceae1988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:49.414422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:49.415201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b8fc27c-b184-415d-8ba8-549f71b38165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:49.419523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1467/2920] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:48 2022] DELETE /identity/v3/projects/12091d0cb00f4f2fa5f577bbceae1988 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:49.424843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:49.425352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:49.425463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:49.477334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:49.481601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:49.751508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1454/2921] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:49.759355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:49.759682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:49.759960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:49.782834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:49.784579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:49.794101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1468/2922] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:49.798532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:49.809510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b309-a04e-4b3b-9ecc-30ea8a066157 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:49.813687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:49.814483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:49.814968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:49.815421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:49.816455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:49.816973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:49.819039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:49.833742 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1455/2923] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:49.838951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:49.848699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8539c-9a72-4e25-a170-6ec1f3446265 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:49.853589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:49.854715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:49.855308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:49.855583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:49.856226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:49.858134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:49.996050 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1469/2924] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:49 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:49.996984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:50.015711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc517d0-42a0-4b2c-89f2-14ebb9385ac3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:50.063565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:50.065925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:50.114536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:50.115252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.115599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.116057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.116742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:50.118817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:50.163045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec13201-64c3-468e-8bf5-35b7e85e11ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:50.169063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:50.169893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.170175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.170446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.172844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:50.185824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:50.187600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:50.199099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1470/2925] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:24:50.419311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1456/2926] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:49 2022] POST /identity/v3/users => generated 285 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:50.423272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:50.458994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24bb-7ebc-4a4f-a453-b2890b2fd87d service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:50.465323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:50.466153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.466651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.467087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.467892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:50.470238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:50.495259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1471/2927] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:50.498853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:50.513148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985cbd7-a52c-472c-b26d-1a5baa44ea92 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:50.524570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:50.537901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.538754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.539184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.540018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:50.544120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca920b3-a893-4c6f-bcb0-f2a716d96896 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:50.568204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1457/2928] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:50.570590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:50.598030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9986b7-99db-415c-97ad-c199212c754a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:50.607051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:50.609028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.610575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.612583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] PATH_INFO: `/v3/projects/b5e4243eddcb46d59d0de6354a5c60c3/users/464468d6687240deb548eb1c3ce45739/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.648955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e4243eddcb46d59d0de6354a5c60c3, user_id=464468d6687240deb548eb1c3ce45739, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:50.652925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:50.829099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1472/2929] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:50 2022] PUT /identity/v3/projects/b5e4243eddcb46d59d0de6354a5c60c3/users/464468d6687240deb548eb1c3ce45739/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:50.838559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:50.838883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:50.839152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:50.888555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] MFA Rules not processed for user `464468d6687240deb548eb1c3ce45739`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:50.889771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:51.066473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1458/2930] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:51.067726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:51.175848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0aedc-ddad-430e-a346-3646ae45c2a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:51.181456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:51.182232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:51.182590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:51.182924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:51.184124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:51.187037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:51.426564 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1473/2931] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:51 2022] POST /identity/v3/projects => generated 367 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:51.430293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:51.445062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0983-e07f-448c-a66d-c7f10b2ed434 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:51.507238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:51.507973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:51.508165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:51.508433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:51.509079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:51.511047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:51.528967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:51.642458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1459/2932] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:51 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:51.646369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:51.658941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a6ea-3217-4e83-a6f3-70878891fc3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:51.665329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:51.666004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:51.666435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:51.666756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:51.667408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:51.669190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:51.691998 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1474/2933] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:51.692704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:51.720161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ba6dd-056e-44ba-a338-091ecd413a1f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:51.727501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:51.728302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:51.728678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:51.729049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] PATH_INFO: `/v3/projects/a79858de45b443a99c2ce9c4e9ff161e/users/dae3c1ee32a543d1a7e3d2a21b77b0ba/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:51.746381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79858de45b443a99c2ce9c4e9ff161e, user_id=dae3c1ee32a543d1a7e3d2a21b77b0ba, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:51.751134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:51.988187 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1460/2934] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:51 2022] PUT /identity/v3/projects/a79858de45b443a99c2ce9c4e9ff161e/users/dae3c1ee32a543d1a7e3d2a21b77b0ba/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:51.992142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.004106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f79a-d963-439b-b6c8-dc72a9419c72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.066453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.067516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.067979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.068853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.069793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.071845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a8d02-bc02-42e7-8557-94e1cd20e83f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:52.094662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1475/2935] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:24:52.099943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.108766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:52.117967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe675-0d87-4e35-9861-c7872560ada1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.134152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.135432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.136264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.136819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] PATH_INFO: `/v3/projects/a79858de45b443a99c2ce9c4e9ff161e/users/dae3c1ee32a543d1a7e3d2a21b77b0ba/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.141785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79858de45b443a99c2ce9c4e9ff161e, user_id=dae3c1ee32a543d1a7e3d2a21b77b0ba, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.147503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:52.168316 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1461/2936] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:52 2022] PUT /identity/v3/projects/a79858de45b443a99c2ce9c4e9ff161e/users/dae3c1ee32a543d1a7e3d2a21b77b0ba/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:24:52.181911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.181911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.181911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.211594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] MFA Rules not processed for user `dae3c1ee32a543d1a7e3d2a21b77b0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:52.212907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:52.298478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1476/2937] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:52.304004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.329813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b57ef-c589-42d6-9982-76a5ca2cd1f4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.334628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.335380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.335729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.336072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.337087 n-d-863055-2 devstack@keystone.service[82163]: WARNING oslo_log.versionutils [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:52.337658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.339029 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:52.339029 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:52.339029 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:52.340187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:52.569882 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1462/2938] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:24:52 2022] POST /identity/v3/policies => generated 229 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:52.573903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.585035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20507-3e14-41ed-a201-3aea004f358f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.599368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.600136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.600523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.600903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/70c2f2893f354f6f85d924ad0cab5318` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.601951 n-d-863055-2 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:52.602571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=70c2f2893f354f6f85d924ad0cab5318)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.604669 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:52.604669 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:52.604669 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:52.606176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:52.796999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1477/2939] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:24:52 2022] PATCH /identity/v3/policies/70c2f2893f354f6f85d924ad0cab5318 => generated 236 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:52.800973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.824473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84707b94-f907-4952-8352-6c35cfde6c96 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.832524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.833549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.834041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.834579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/70c2f2893f354f6f85d924ad0cab5318` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.835752 n-d-863055-2 devstack@keystone.service[82163]: WARNING oslo_log.versionutils [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:52.836630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=70c2f2893f354f6f85d924ad0cab5318)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.838927 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:52.838927 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:52.838927 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:52.840707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:52.853624 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1463/2940] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:24:52 2022] GET /identity/v3/policies/70c2f2893f354f6f85d924ad0cab5318 => generated 236 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:52.858085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:52.872720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffd112-e678-4f33-bb53-6d0b90f7f067 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:52.880137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:52.880793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:52.881092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:52.881356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/70c2f2893f354f6f85d924ad0cab5318` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:52.882475 n-d-863055-2 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:52.883067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=70c2f2893f354f6f85d924ad0cab5318)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:52.884400 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:52.884400 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:52.884400 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:52.885286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.088517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1478/2941] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:52 2022] DELETE /identity/v3/policies/70c2f2893f354f6f85d924ad0cab5318 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:53.095103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.110954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017239a6-3bf7-4acc-a8d6-9b677625ef80 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.122361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.124812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.124812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.124812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.125559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.127416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.229493 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1464/2942] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:24:53 2022] POST /identity/v3/policies => generated 229 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:53.234461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.245266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8b61-23f6-4775-8f41-b38b24a74bf1 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.253703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.254450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.254829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.255168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.256311 n-d-863055-2 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:53.257030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.259129 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:53.259129 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:53.259129 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:53.267027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.401957 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1479/2943] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:24:53 2022] POST /identity/v3/policies => generated 230 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:53.407018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.421611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1ca9e-2606-4c1f-8496-e0281ed7144e tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.429476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.430397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.431552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.432156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.433525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.435694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.579664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:53.597241 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1465/2944] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:24:53 2022] POST /identity/v3/policies => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:24:53.600071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.628579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e56e-75a3-47c3-82b9-3c50789faa66 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.643997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.644755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.645143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.645514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.647962 n-d-863055-2 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:53.649051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.653131 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:53.653131 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:24:53.653131 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:24:53.656437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.681344 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1480/2945] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:24:53 2022] GET /identity/v3/policies => generated 764 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:24:53.685495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.701626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb080c-b01f-4635-b201-efd0ff6b1a86 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.726573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.727269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.727556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.727832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/2a5cb0be4293467e99d4d52f3671b632` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.728615 n-d-863055-2 devstack@keystone.service[82163]: WARNING oslo_log.versionutils [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 31 14:24:53.729175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2a5cb0be4293467e99d4d52f3671b632)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.730422 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:24:53.730422 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:24:53.730422 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:24:53.731490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:53.891719 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1466/2946] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:53 2022] DELETE /identity/v3/policies/2a5cb0be4293467e99d4d52f3671b632 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:53.893253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:53.913767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496f40f-dbad-4a59-9907-2afa35049bb7 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:53.930086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:53.930797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:53.931081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:53.931463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/7494c11922524f1da43c0df310e00271` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:53.951969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7494c11922524f1da43c0df310e00271)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:53.961722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:54.077871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1481/2947] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:53 2022] DELETE /identity/v3/policies/7494c11922524f1da43c0df310e00271 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:54.082246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:54.098148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57329942-7464-487c-b3cc-1a0097b4ee0a tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:54.109321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae3c1ee32a543d1a7e3d2a21b77b0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a79858de45b443a99c2ce9c4e9ff161e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:54.110072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:54.110413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:54.110813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] PATH_INFO: `/v3/policies/e88417a9143d44918f8c8388a76af673` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:54.111889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e88417a9143d44918f8c8388a76af673)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:54.121418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398b5d-c804-45ea-898a-78527879bda6 tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:54.302847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:54.303873 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1467/2948] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:54 2022] DELETE /identity/v3/policies/e88417a9143d44918f8c8388a76af673 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:54.386951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623165-261e-4621-9943-9bf6c0cf1fee tempest-PoliciesTestJSON-348188658 tempest-PoliciesTestJSON-348188658-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:54.392824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:54.393882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:54.394340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:54.394815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] PATH_INFO: `/v3/users/464468d6687240deb548eb1c3ce45739` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:54.396282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=464468d6687240deb548eb1c3ce45739)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:54.398578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:54.681609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464468d6687240deb548eb1c3ce45739'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:54.682320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464468d6687240deb548eb1c3ce45739'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:54.753267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464468d6687240deb548eb1c3ce45739'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:54.784486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464468d6687240deb548eb1c3ce45739'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:54.785871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464468d6687240deb548eb1c3ce45739'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:54.839826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:54.840725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:54.841407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:54.845976 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1482/2949] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:54 2022] DELETE /identity/v3/users/464468d6687240deb548eb1c3ce45739 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:54.868938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:54.870718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:54.963290 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1468/2950] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:54.973686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:54.975496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:55.095748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b183c-2333-451d-b763-e54e59ec0dbe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:55.100773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:55.101463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:55.101866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:55.102190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:55.118731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:55.123088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:55.146015 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1483/2951] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:24:55.240018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:55.774121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:55.784829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:55.818417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520802a-e255-4838-86bc-0860ff25e446 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:55.841798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:55.844751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:55.845039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:55.846350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] PATH_INFO: `/v3/projects/b5e4243eddcb46d59d0de6354a5c60c3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:55.847384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e4243eddcb46d59d0de6354a5c60c3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:55.850373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:56.045561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e4243eddcb46d59d0de6354a5c60c3', 'request_id': 'req-bbb0c1df-86f9-43c3-be19-56531269f8d4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.147697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e4243eddcb46d59d0de6354a5c60c3', 'request_id': 'req-bbb0c1df-86f9-43c3-be19-56531269f8d4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.153809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e4243eddcb46d59d0de6354a5c60c3', 'request_id': 'req-bbb0c1df-86f9-43c3-be19-56531269f8d4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.166453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] The token cache is being invalidate because project b5e4243eddcb46d59d0de6354a5c60c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:56.166889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.167541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.172907 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1469/2952] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:55 2022] DELETE /identity/v3/projects/b5e4243eddcb46d59d0de6354a5c60c3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:56.174201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:56.184181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c31b-8990-4a28-b782-674af852b5f2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:56.242127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:56.242810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:56.243089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:56.243424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] PATH_INFO: `/v3/users/dae3c1ee32a543d1a7e3d2a21b77b0ba` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:56.244526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae3c1ee32a543d1a7e3d2a21b77b0ba)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:56.246639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:56.522080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae3c1ee32a543d1a7e3d2a21b77b0ba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.522693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae3c1ee32a543d1a7e3d2a21b77b0ba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.619100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae3c1ee32a543d1a7e3d2a21b77b0ba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.633238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae3c1ee32a543d1a7e3d2a21b77b0ba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.633927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24b4e765-e6ac-4f22-8342-c54afddaf6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae3c1ee32a543d1a7e3d2a21b77b0ba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:56.645641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:56.658112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1484/2953] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:24:56 2022] DELETE /identity/v3/users/dae3c1ee32a543d1a7e3d2a21b77b0ba => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:57.065768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:57.423629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:57.425260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:57.450595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c1df-86f9-43c3-be19-56531269f8d4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:57.555159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:57.556272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:57.556887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:57.557993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] PATH_INFO: `/v3/projects/a79858de45b443a99c2ce9c4e9ff161e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:57.559623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79858de45b443a99c2ce9c4e9ff161e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:57.563012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:57.748298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79858de45b443a99c2ce9c4e9ff161e', 'request_id': 'req-367683f3-41f8-420e-86d1-61be57fe5641'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:57.952504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79858de45b443a99c2ce9c4e9ff161e', 'request_id': 'req-367683f3-41f8-420e-86d1-61be57fe5641'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:57.956197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79858de45b443a99c2ce9c4e9ff161e', 'request_id': 'req-367683f3-41f8-420e-86d1-61be57fe5641'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:57.981147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] The token cache is being invalidate because project a79858de45b443a99c2ce9c4e9ff161e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:24:57.981492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:57.982423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-367683f3-41f8-420e-86d1-61be57fe5641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:24:57.988678 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1470/2954] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:24:57 2022] DELETE /identity/v3/projects/a79858de45b443a99c2ce9c4e9ff161e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:57.994722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:57.998861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:57.998861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.047111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:58.050682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:58.141806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1485/2955] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:58.149340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.149913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.149913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.193277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:58.194921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:58.210989 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1471/2956] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:24:58.215684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.227319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbf1e-edb1-43e9-8761-e4ff7281aaa2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.240777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.241435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.241719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.241992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.242794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:24:58.242999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.245012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:58.262854 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1486/2957] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:24:58.267759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.277027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8b6d-c796-40af-9055-a84b3b8b842f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.282328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.282957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.283322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.283696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.284341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.291150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:58.428934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1472/2958] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:58 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:58.433390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.447921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5c55-2402-486d-a166-0da5501502a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.512364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.512974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.513249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.513593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.514207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.519497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:58.672510 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1487/2959] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:58 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:58.674082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.687200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dc008-85aa-4c23-a422-c152eb67e021 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.692794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.694351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.694787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.695162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.695916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.697724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:58.712124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1473/2960] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:58.716272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.732632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a287-1f90-4ca5-ade1-3b8c6f0ad0e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.738879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.739406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.740162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.740413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.741380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.744005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d7bd-10e2-4642-9b76-551aa17080d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:58.759570 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1488/2961] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:24:58.763863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:58.777334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce719-376a-4b7d-bea0-9dd632ee9e42 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:58.783911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:58.785112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:58.785112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:58.785513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] PATH_INFO: `/v3/projects/cbfc8a616f944956be5cde38edafe338/users/7013842f7a3a4256a74aa8e8f1ed73c1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:58.807567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfc8a616f944956be5cde38edafe338, user_id=7013842f7a3a4256a74aa8e8f1ed73c1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:58.810861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:59.160970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:59.161629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1474/2962] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:24:58 2022] PUT /identity/v3/projects/cbfc8a616f944956be5cde38edafe338/users/7013842f7a3a4256a74aa8e8f1ed73c1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:24:59.162023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:59.162023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:59.224793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] MFA Rules not processed for user `7013842f7a3a4256a74aa8e8f1ed73c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:24:59.229026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:24:59.421886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1489/2963] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:24:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:24:59.426890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:59.529117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a2-5b6a-451b-bc23-2c36b4a8a380 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:59.562801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:59.562801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:59.562801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:59.562801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:59.564125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:59.564125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:59.682181 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1475/2964] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:24:59 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:59.686986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:59.713922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65332fe-72bf-4f30-8679-692526ea6529 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:24:59.781849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:24:59.856510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:24:59.880832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:24:59.880832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:24:59.880832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:24:59.880832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:24:59.880832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:24:59.975531 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1490/2965] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:24:59 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:24:59.976777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:24:59.992851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2b3ef-b317-4606-a380-c6ce2609b40e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.001056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.001689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.001974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.002236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.002995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.004841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.020630 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1476/2966] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:00.021979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:00.034689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccbf36-c32e-4aa8-b9d7-03a68a67870c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.051050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.052218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.052738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.053126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] PATH_INFO: `/v3/projects/df35a61ce62442e9b762f9ea05b19e17/users/62e7c2e5db874c58bdfcf4c38383c454/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.074816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df35a61ce62442e9b762f9ea05b19e17, user_id=62e7c2e5db874c58bdfcf4c38383c454, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.085754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.192721 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1491/2967] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:00 2022] PUT /identity/v3/projects/df35a61ce62442e9b762f9ea05b19e17/users/62e7c2e5db874c58bdfcf4c38383c454/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:00.196889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:00.213880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180885d-5387-4c8d-88e7-d1af194ebc04 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.260313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:00.310715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.312146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.312522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.312893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.313655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.315953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9db9b7-47cf-4d57-b0e3-ff9a7257256d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.328030 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1477/2968] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:00.333484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:00.347488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fa20-fce3-457f-960a-8efc92167bdb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.353845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.355290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.355290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.355290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] PATH_INFO: `/v3/projects/df35a61ce62442e9b762f9ea05b19e17/users/62e7c2e5db874c58bdfcf4c38383c454/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.357683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df35a61ce62442e9b762f9ea05b19e17, user_id=62e7c2e5db874c58bdfcf4c38383c454, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.361464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.382812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1492/2969] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:00 2022] PUT /identity/v3/projects/df35a61ce62442e9b762f9ea05b19e17/users/62e7c2e5db874c58bdfcf4c38383c454/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:00.461127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.461518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.461799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.492491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] MFA Rules not processed for user `62e7c2e5db874c58bdfcf4c38383c454`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:00.497621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:00.578602 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1478/2970] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:00.583646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:00.593924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afa63-16c5-49be-bfb2-08321425c822 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.598807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.599441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.599915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.600053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.601053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.603058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.725359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1493/2971] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:00 2022] POST /identity/v3/projects => generated 360 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:00.729978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:00.741941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327daf94-50b5-4cfc-bac4-2b7a8e8f7666 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:00.830019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:00.830855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:00.831246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:00.831659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:00.832520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:00.837511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:00.994885 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1479/2972] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:00 2022] POST /identity/v3/users => generated 413 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:00.999901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:01.011439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02540a4-0c58-4961-86e0-cc065207791c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:01.016980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:01.017842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:01.018197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:01.018407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/users/b8ecac5d80b94d81867f8fc4d651f75d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:01.057159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_user(user_id=b8ecac5d80b94d81867f8fc4d651f75d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:01.057159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:01.058368 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1494/2973] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:25:00 2022] GET /identity/v3/users/b8ecac5d80b94d81867f8fc4d651f75d => generated 413 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:01.062911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:01.073800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163ad9-7d80-46c1-a298-1b3642420f23 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:01.079895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:01.080536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:01.080819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:01.081094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/users/b8ecac5d80b94d81867f8fc4d651f75d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:01.082244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b8ecac5d80b94d81867f8fc4d651f75d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:01.084431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:01.199438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ecac5d80b94d81867f8fc4d651f75d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.200204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ecac5d80b94d81867f8fc4d651f75d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.317708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ecac5d80b94d81867f8fc4d651f75d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.336545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ecac5d80b94d81867f8fc4d651f75d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.337382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ecac5d80b94d81867f8fc4d651f75d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.363729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1480/2974] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:01 2022] DELETE /identity/v3/users/b8ecac5d80b94d81867f8fc4d651f75d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:01.368044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:01.369991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:01.383457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459861-6900-47a6-a308-015ffb0fb10a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:01.442956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:01.448743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:01.448743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:01.448743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/4910fd2bd2d5489c9895446b0f29b55e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:01.448743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4910fd2bd2d5489c9895446b0f29b55e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:01.448743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:01.603419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4910fd2bd2d5489c9895446b0f29b55e', 'request_id': 'req-53e65f5f-501e-45ff-b341-efc52e3e8fe4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.747817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4910fd2bd2d5489c9895446b0f29b55e', 'request_id': 'req-53e65f5f-501e-45ff-b341-efc52e3e8fe4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.755024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4910fd2bd2d5489c9895446b0f29b55e', 'request_id': 'req-53e65f5f-501e-45ff-b341-efc52e3e8fe4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.767137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 4910fd2bd2d5489c9895446b0f29b55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:01.767531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.768285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:01.769822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1495/2975] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:01 2022] DELETE /identity/v3/projects/4910fd2bd2d5489c9895446b0f29b55e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:01.774865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:01.785144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e50f6d-00e5-4b44-b752-0aa3620cdea4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:01.853449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:01.854381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:01.854963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:01.855412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:01.856320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:01.858296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:01.935062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1481/2976] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:01 2022] POST /identity/v3/projects => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:01.945200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:01.946753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:01.960971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e65f5f-501e-45ff-b341-efc52e3e8fe4 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:02.018886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:02.019415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:02.019691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:02.019959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:02.020646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:02.020945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:02.022887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:02.041827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1496/2977] 10.222.0.13 () {58 vars in 1160 bytes} [Mon Oct 31 14:25:01 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:02.047091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:02.058144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180428c-9d3e-49aa-8909-03e6fa10cc50 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:02.063624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:02.064302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:02.064669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:02.065017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:02.065704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:02.067451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:02.085373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1482/2978] 10.222.0.13 () {58 vars in 1128 bytes} [Mon Oct 31 14:25:02 2022] GET /identity/v3/domains => generated 828 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:02.089835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:02.100969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e44070-6c16-40fc-9ead-442e218361c3 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:02.108836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:02.109510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:02.109791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:02.110067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/cf478fe21fd34a34b43b037b70f4645b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:02.111466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_project(project_id=cf478fe21fd34a34b43b037b70f4645b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:02.112477 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:25:02.112477 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:25:02.112477 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:25:02.113471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:02.127981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.128706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.329139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:02.340564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.341199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.344407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1497/2979] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:25:02 2022] PATCH /identity/v3/projects/cf478fe21fd34a34b43b037b70f4645b => generated 361 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:02.348684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:02.354139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:02.366729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ceb1-daf7-415f-b2f3-44a5c8c0b761 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:02.436207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:02.439151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:02.439549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:02.439898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/cf478fe21fd34a34b43b037b70f4645b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:02.451910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf478fe21fd34a34b43b037b70f4645b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:02.453737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:02.480383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.484401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.665511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.773403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.780147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.792486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project cf478fe21fd34a34b43b037b70f4645b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:02.792846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.793576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.802582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.803374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.804000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cf478fe21fd34a34b43b037b70f4645b', 'request_id': 'req-5c6e5470-efbc-4810-9cc1-b7ead071a639'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:02.813608 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1483/2980] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:02 2022] DELETE /identity/v3/projects/cf478fe21fd34a34b43b037b70f4645b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:02.818709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:02.830018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de475da-5f04-4d45-9460-1cd03df5ef2a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:02.914159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:02.914794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:02.915078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:02.915506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:02.915983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:02.917840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:03.082472 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1498/2981] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:02 2022] POST /identity/v3/projects => generated 359 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:03.086794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:03.088277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:03.111664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e5470-efbc-4810-9cc1-b7ead071a639 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:03.205816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:03.206715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:03.207119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:03.207498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/f8296c64bc154d1cbc777ae435475b48` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:03.210131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8296c64bc154d1cbc777ae435475b48)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:03.213291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:03.219396 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1484/2982] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:03 2022] GET /identity/v3/projects/f8296c64bc154d1cbc777ae435475b48 => generated 359 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:03.223258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:03.235991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f462187-342c-44e3-b0c7-7fe7164c49d8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:03.245157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:03.245157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:03.245157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:03.245475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/f8296c64bc154d1cbc777ae435475b48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:03.246753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8296c64bc154d1cbc777ae435475b48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:03.251157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:03.431568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8296c64bc154d1cbc777ae435475b48', 'request_id': 'req-ee86b7a0-7c51-4599-bb46-57fa75e58683'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:03.488360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8296c64bc154d1cbc777ae435475b48', 'request_id': 'req-ee86b7a0-7c51-4599-bb46-57fa75e58683'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:03.497204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8296c64bc154d1cbc777ae435475b48', 'request_id': 'req-ee86b7a0-7c51-4599-bb46-57fa75e58683'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:03.511604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project f8296c64bc154d1cbc777ae435475b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:03.519581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:03.519581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:03.519581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1499/2983] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:03 2022] DELETE /identity/v3/projects/f8296c64bc154d1cbc777ae435475b48 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:03.520858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:03.522848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:03.537248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee195c54-5fe0-4923-8459-2f82797fb5da tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:03.626259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:03.627806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:03.627806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:03.628138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:03.628961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:03.644415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:03.828426 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1485/2984] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:03 2022] POST /identity/v3/projects => generated 359 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:03.830235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:03.850811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86b7a0-7c51-4599-bb46-57fa75e58683 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:03.960057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:03.960683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:03.960903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:03.961531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/ccc9cb12994f45e09e5333c3ad62abf7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:03.963696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=ccc9cb12994f45e09e5333c3ad62abf7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:03.966491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:03.970051 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1500/2985] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:03 2022] GET /identity/v3/projects/ccc9cb12994f45e09e5333c3ad62abf7 => generated 359 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:03.974427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:03.993422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de3914-9fd4-4bf5-a57c-f45d20c3aa5a tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:04.007262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:04.008328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:04.008591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:04.011667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/ccc9cb12994f45e09e5333c3ad62abf7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:04.015855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ccc9cb12994f45e09e5333c3ad62abf7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:04.018027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:04.265666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc9cb12994f45e09e5333c3ad62abf7', 'request_id': 'req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:04.359987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc9cb12994f45e09e5333c3ad62abf7', 'request_id': 'req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:04.364349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:04.365531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:04.369934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc9cb12994f45e09e5333c3ad62abf7', 'request_id': 'req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:04.393471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project ccc9cb12994f45e09e5333c3ad62abf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:04.394302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:04.395284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:04.397510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1486/2986] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:03 2022] DELETE /identity/v3/projects/ccc9cb12994f45e09e5333c3ad62abf7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:04.403839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:04.410023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:04.479943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb087b2-b464-4fea-a6e7-6b7012fe4732 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:04.542191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:04.555464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c631e-27ee-4f4e-9aea-ed06c0ec122c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:04.563605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:04.564469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:04.565172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:04.565621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:04.566491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:04.566700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:04.567129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:04.567412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:04.567688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:04.569434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:04.569631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:04.653578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:04.655704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:04.668281 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1501/2987] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:25:04.697892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:04.699709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1487/2988] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:25:04 2022] POST /identity/v3/projects => generated 348 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:04.717440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38e89-112a-4038-a7ee-a60381312f92 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:04.789675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:04.790419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:04.790811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:04.791153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/d11f9b2a89b9478b81c54c4830f915b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:04.792398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=d11f9b2a89b9478b81c54c4830f915b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:04.794745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:04.797096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1502/2989] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:04 2022] GET /identity/v3/projects/d11f9b2a89b9478b81c54c4830f915b7 => generated 348 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:04.801510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:04.815821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c669-0503-4c7f-9320-79e8f2eb6da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:04.821173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:04.821822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:04.822101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:04.822371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/d11f9b2a89b9478b81c54c4830f915b7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:04.824054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d11f9b2a89b9478b81c54c4830f915b7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:04.826373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:04.896587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:05.002139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11f9b2a89b9478b81c54c4830f915b7', 'request_id': 'req-7fcf0322-c748-497f-9ad1-af282c00381d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:05.093731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11f9b2a89b9478b81c54c4830f915b7', 'request_id': 'req-7fcf0322-c748-497f-9ad1-af282c00381d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:05.123684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11f9b2a89b9478b81c54c4830f915b7', 'request_id': 'req-7fcf0322-c748-497f-9ad1-af282c00381d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:05.148430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project d11f9b2a89b9478b81c54c4830f915b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:05.151032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:05.151636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:05.153516 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1488/2990] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:04 2022] DELETE /identity/v3/projects/d11f9b2a89b9478b81c54c4830f915b7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:05.159494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:05.161756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:05.179191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b4623-9b2a-40bc-9dee-a98ba953f637 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:05.245188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:05.245850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.246160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.246403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.247093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:05.248714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc692c-b3c1-4621-b003-71677cf98f9c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:05.366265 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1503/2991] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:25:05 2022] POST /identity/v3/domains => generated 276 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:05.371980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:05.378398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.378710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.378978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.392428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf0322-c748-497f-9ad1-af282c00381d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:05.437488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:05.439574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:05.504891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:05.505519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.505783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.506155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.506825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:05.509396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:05.581013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1504/2992] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:25:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:05.607454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:05.609154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:05.700839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1489/2993] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:05 2022] POST /identity/v3/projects => generated 404 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:05.702100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:05.714251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f833b-9753-4f9f-8b47-120ef5ff87ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:05.846388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:05.847435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.847888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.848224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.877966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510751-6b8d-46b9-a3f5-8b33085a0151 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:05.886492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:05.887594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.888050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.890687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/954643116fe54294ac550d850b8b5a21` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.890687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=954643116fe54294ac550d850b8b5a21)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:05.892769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df578-9d92-4859-8001-8f3e9f1d2a3f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:05.899697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1490/2994] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:05 2022] GET /identity/v3/projects/954643116fe54294ac550d850b8b5a21 => generated 404 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:05.902114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:05.902114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:05.903404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:05.937074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] MFA Rules not processed for user `1bf9e8a3a122438c95ca0705008a816c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:05.939068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:05.966380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:05.968857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:05.999633 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1505/2995] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:06.002280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:06.014209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dfdb6-97d8-48de-9104-7229fa68303b service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:06.019517 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1491/2996] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:06.023977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:06.024626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:06.024932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:06.025237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/954643116fe54294ac550d850b8b5a21` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:06.026420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=954643116fe54294ac550d850b8b5a21)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:06.028371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:06.221736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954643116fe54294ac550d850b8b5a21', 'request_id': 'req-ae6c4252-eb11-4124-8631-2f92155125a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.412383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954643116fe54294ac550d850b8b5a21', 'request_id': 'req-ae6c4252-eb11-4124-8631-2f92155125a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.418166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954643116fe54294ac550d850b8b5a21', 'request_id': 'req-ae6c4252-eb11-4124-8631-2f92155125a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.443244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 954643116fe54294ac550d850b8b5a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:06.443555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.445343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae6c4252-eb11-4124-8631-2f92155125a1 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.452515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:06.453087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1506/2997] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:05 2022] DELETE /identity/v3/projects/954643116fe54294ac550d850b8b5a21 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:06.469371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25de9a-9a0b-4488-a2b4-7967011ee4e5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:06.607494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:06.607623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:06.607811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:06.636334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:06.638746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:06.638746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:06.638746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:06.643346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f4b8ba80d7ff4b42802309a9940f24e2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:06.644907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:06.648148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:06.653285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:06.699434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.700945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.779801 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1507/2998] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:06.827064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.828704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:06.831757 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1492/2999] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:25:06 2022] PATCH /identity/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2 => generated 277 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:06.836907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:06.839437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:06.870867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39510edd-0270-47fc-b595-a0997681ac7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:06.893805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:06.951514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:06.952027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:06.953124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:06.953577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:06.971152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f4b8ba80d7ff4b42802309a9940f24e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:06.973286 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:25:06.973286 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:25:06.973286 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:25:06.974847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:07.024350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.033660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.215839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.345530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.356798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.387367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project f4b8ba80d7ff4b42802309a9940f24e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:07.387939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.388711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.415958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.417122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.418035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f4b8ba80d7ff4b42802309a9940f24e2', 'request_id': 'req-35a38a4e-4a7f-497f-8f41-9579d639a6b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:07.463308 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1508/3000] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:06 2022] DELETE /identity/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:07.470158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:07.470158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:07.485094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90be1ee-909d-4f45-85f8-fcf96172bd39 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:07.590491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:07.591235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:07.591727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:07.592251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:07.593601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:07.594874 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:25:07.594874 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:25:07.594874 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:25:07.596178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:07.645316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:07.731450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1493/3001] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:25:07 2022] POST /identity/v3/domains => generated 276 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:07.734946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:07.737276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:07.769989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38a4e-4a7f-497f-8f41-9579d639a6b7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:07.865370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:07.865923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:07.866167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:07.866443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:07.867314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:07.869547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:08.024849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1509/3002] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:07 2022] POST /identity/v3/projects => generated 410 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:08.028827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:08.049208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbb6a3-8329-44c2-8ad2-18721a71091f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:08.115590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:08.116230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:08.116513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:08.116822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:08.117426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:08.119408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:08.231922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1494/3003] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:08 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:08.237615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:08.257721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18345e07-a182-4f2f-92c3-d68e347b3da2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:08.340513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:08.340513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:08.340513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:08.340927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/71fb981b2a754ab3a96da12e9b1fc306` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:08.340927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=71fb981b2a754ab3a96da12e9b1fc306)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:08.340927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:08.596972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fb981b2a754ab3a96da12e9b1fc306', 'request_id': 'req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:08.721274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fb981b2a754ab3a96da12e9b1fc306', 'request_id': 'req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:08.745805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fb981b2a754ab3a96da12e9b1fc306', 'request_id': 'req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:08.776586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 71fb981b2a754ab3a96da12e9b1fc306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:08.777953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:08.778886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:08.781641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1510/3004] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:08 2022] DELETE /identity/v3/projects/71fb981b2a754ab3a96da12e9b1fc306 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:08.785693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:08.788007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:08.805829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c04dd-174f-4592-a2f6-c1cacc2ca4d9 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:08.898592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:08.899389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:08.900057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:08.900487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/11f6c47cf34d49dbafb3f5a1fcaf9c41` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:08.901871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11f6c47cf34d49dbafb3f5a1fcaf9c41)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:08.904076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:09.070367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f6c47cf34d49dbafb3f5a1fcaf9c41', 'request_id': 'req-9af300b5-b98e-4503-a926-5ea481712d46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.167358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f6c47cf34d49dbafb3f5a1fcaf9c41', 'request_id': 'req-9af300b5-b98e-4503-a926-5ea481712d46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.177173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f6c47cf34d49dbafb3f5a1fcaf9c41', 'request_id': 'req-9af300b5-b98e-4503-a926-5ea481712d46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.201405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 11f6c47cf34d49dbafb3f5a1fcaf9c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:09.202114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.203746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.206094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1495/3005] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:08 2022] DELETE /identity/v3/projects/11f6c47cf34d49dbafb3f5a1fcaf9c41 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:09.210792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:09.225497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4c0fc-67e0-4f90-96c2-9ec21b25fc61 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:09.376784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:09.378251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:09.378825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:09.379247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/33069313bb9b4134b0d983ae0ca38913` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:09.380608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=33069313bb9b4134b0d983ae0ca38913)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:09.381699 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:25:09.381699 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:25:09.381699 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:25:09.383242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:09.408207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.409258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.615683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.616461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9be2c83f-79d4-4e06-b4f2-9f351fdc673f tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.624287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1511/3006] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:25:09 2022] PATCH /identity/v3/domains/33069313bb9b4134b0d983ae0ca38913 => generated 277 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:09.626041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:09.627818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:09.642239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af300b5-b98e-4503-a926-5ea481712d46 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:09.750942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:09.752006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:09.752683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:09.753136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/33069313bb9b4134b0d983ae0ca38913` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:09.777451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=33069313bb9b4134b0d983ae0ca38913)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:09.783005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:09.850418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.859630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '33069313bb9b4134b0d983ae0ca38913'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:09.866303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:09.866667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:09.869265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:09.919049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:09.920323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:09.995869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1512/3007] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:25:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:10.012324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:10.015556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:10.041722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.122794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.135431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.181059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 33069313bb9b4134b0d983ae0ca38913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:10.181059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.186190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.206186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:10.216037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.216876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.217590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '33069313bb9b4134b0d983ae0ca38913', 'request_id': 'req-ee5e88c8-c092-4233-a188-bfc6fa337bfa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:10.222179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b3eb0-dc26-488d-a064-de2bbaae5a7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:10.233373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1496/3008] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:09 2022] DELETE /identity/v3/domains/33069313bb9b4134b0d983ae0ca38913 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:10.244053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:10.260047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:10.384156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e88c8-c092-4233-a188-bfc6fa337bfa tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:10.392399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:10.393097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:10.393444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:10.393781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:10.395154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:10.403522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:10.408376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:10.409245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:10.409924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:10.410417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:10.413626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:10.501770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:10.503554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:10.521029 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1513/3009] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:10.677548 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1497/3010] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:10 2022] POST /identity/v3/projects => generated 377 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:10.683019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:10.741158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078272a8-f048-44db-9c60-d6c04b5c42b2 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:11.016624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:11.017332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:11.017617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:11.018020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/4c4ca503707d491688a9cb3874c3e001` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:11.021014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=4c4ca503707d491688a9cb3874c3e001)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:11.027961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:11.040123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1514/3011] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:10 2022] GET /identity/v3/projects/4c4ca503707d491688a9cb3874c3e001 => generated 377 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:11.041659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:11.068245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba200-6566-4bf2-8efe-c6ed099b02d7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:11.097915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:11.102263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:11.103946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:11.108313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:11.112272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:11.129087 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:25:11.129087 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:25:11.129087 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:25:11.129087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:11.158448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:11.225960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1498/3012] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:25:11 2022] GET /identity/v3/projects => generated 7705 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:11.226544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:11.256241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98991a-acbc-4bdc-8b88-db81ec1769d5 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:11.291435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:11.292668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:11.295082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:11.295630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/4c4ca503707d491688a9cb3874c3e001` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:11.306236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c4ca503707d491688a9cb3874c3e001)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:11.314258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:11.679001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4ca503707d491688a9cb3874c3e001', 'request_id': 'req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:11.773224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4ca503707d491688a9cb3874c3e001', 'request_id': 'req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:11.783995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4ca503707d491688a9cb3874c3e001', 'request_id': 'req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:11.821298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 4c4ca503707d491688a9cb3874c3e001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:11.828371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:11.832179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:11.844716 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1515/3013] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:11 2022] DELETE /identity/v3/projects/4c4ca503707d491688a9cb3874c3e001 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:11.847525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:11.848530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:11.899522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840b3e-5bf9-48c5-b02b-cea5a68ef034 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:12.091748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:12.093805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:12.094110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:12.094428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:12.095835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:12.098578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:12.280203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1499/3014] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:25:11 2022] POST /identity/v3/projects => generated 345 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:12.281918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:12.306063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7288f29-4ac0-4daa-a0b0-02ec6b2b2af2 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:12.466339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:12.468986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:12.469529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:12.470023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/906ec79a77b74aacad43bba68c8642c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:12.472557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_project(project_id=906ec79a77b74aacad43bba68c8642c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:12.475327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:12.598697 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1516/3015] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:25:12 2022] PATCH /identity/v3/projects/906ec79a77b74aacad43bba68c8642c2 => generated 360 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:12.603560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:12.616398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774accf-8523-4382-a127-2b91db547ab8 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:12.657638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:12.658758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:12.659324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:12.659832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/906ec79a77b74aacad43bba68c8642c2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:12.746768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=906ec79a77b74aacad43bba68c8642c2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:12.757272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:12.760059 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1500/3016] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:12 2022] GET /identity/v3/projects/906ec79a77b74aacad43bba68c8642c2 => generated 347 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:12.764386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:12.795523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60466c-611b-4489-bd95-6c3d0c1b6cbd tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:12.832371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:12.870303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:12.877766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:12.879160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/906ec79a77b74aacad43bba68c8642c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:12.889536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=906ec79a77b74aacad43bba68c8642c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:12.909731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:13.183155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906ec79a77b74aacad43bba68c8642c2', 'request_id': 'req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:13.228280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:13.273796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906ec79a77b74aacad43bba68c8642c2', 'request_id': 'req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:13.285063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906ec79a77b74aacad43bba68c8642c2', 'request_id': 'req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:13.323889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 906ec79a77b74aacad43bba68c8642c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:13.327052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:13.330541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:13.335867 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1517/3017] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:12 2022] DELETE /identity/v3/projects/906ec79a77b74aacad43bba68c8642c2 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:13.348029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:13.354718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:13.378460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa00eb-cfd9-48b6-9e83-259cd8fa0eb7 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:13.544349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:13.547824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:13.547824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:13.547824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:13.547824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:13.549422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:13.713648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:13.725457 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1501/3018] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:13 2022] POST /identity/v3/projects => generated 359 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:13.726023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:13.744523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c7da6-9b3f-4442-bcfe-2bc6d3d7d357 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:13.941060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:13.941980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:13.943680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:13.944036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/654dab3deeb64ef5914744cb462c695a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:13.947871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_project(project_id=654dab3deeb64ef5914744cb462c695a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:13.950432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:14.257081 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1518/3019] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:25:13 2022] PATCH /identity/v3/projects/654dab3deeb64ef5914744cb462c695a => generated 371 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:25:14.260311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:14.288832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296367-928d-4e36-bbfc-7597c559fb43 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:14.319293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:14.322660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:14.323090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:14.323407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/654dab3deeb64ef5914744cb462c695a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:14.396578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=654dab3deeb64ef5914744cb462c695a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:14.404530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:14.409781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:14.423055 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1502/3020] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:14 2022] GET /identity/v3/projects/654dab3deeb64ef5914744cb462c695a => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:14.427403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:14.444868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1822c32-3edd-4fd5-9d25-8dc25951fa3d tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:14.460236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:14.460830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:14.461110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:14.461384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/654dab3deeb64ef5914744cb462c695a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:14.463601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=654dab3deeb64ef5914744cb462c695a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:14.467999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:14.670643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654dab3deeb64ef5914744cb462c695a', 'request_id': 'req-4d6dc691-0961-4c62-9c5c-030c95dbf369'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:14.790025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654dab3deeb64ef5914744cb462c695a', 'request_id': 'req-4d6dc691-0961-4c62-9c5c-030c95dbf369'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:14.804920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654dab3deeb64ef5914744cb462c695a', 'request_id': 'req-4d6dc691-0961-4c62-9c5c-030c95dbf369'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:14.834425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 654dab3deeb64ef5914744cb462c695a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:14.834915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:14.835718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:14.846538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1519/3021] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:14 2022] DELETE /identity/v3/projects/654dab3deeb64ef5914744cb462c695a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:14.847298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:14.849420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:14.879179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b567-e903-4066-a096-485e7f5c010c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:15.013757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:15.014356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:15.015246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:15.015524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:15.017476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:15.023668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:15.030916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:15.209178 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1503/3022] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:14 2022] POST /identity/v3/projects => generated 354 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:15.213592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:15.226235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc691-0961-4c62-9c5c-030c95dbf369 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:15.450812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:15.451499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:15.455047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:15.455384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/037415fd5ef64654880ef5e84eb3b0b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:15.461160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:update_project(project_id=037415fd5ef64654880ef5e84eb3b0b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:15.470610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:15.606567 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1520/3023] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:25:15 2022] PATCH /identity/v3/projects/037415fd5ef64654880ef5e84eb3b0b1 => generated 367 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:15.611771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:15.625324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eeac0-d4ce-41f0-9d6a-74774a4121bf tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:15.653983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:15.659794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:15.659794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:15.659794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/037415fd5ef64654880ef5e84eb3b0b1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:15.717352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:get_project(project_id=037415fd5ef64654880ef5e84eb3b0b1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:15.727740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:15.739779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:15.754524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1504/3024] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:25:15 2022] GET /identity/v3/projects/037415fd5ef64654880ef5e84eb3b0b1 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:15.754863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:15.758476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667c642-98c8-4465-9f48-7db4e98f906c tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:15.777471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:15.781108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:15.785003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:15.788075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/projects/037415fd5ef64654880ef5e84eb3b0b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:15.794450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorizing `identity:delete_project(project_id=037415fd5ef64654880ef5e84eb3b0b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:15.820205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:15.888064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:16.146333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037415fd5ef64654880ef5e84eb3b0b1', 'request_id': 'req-cd15200f-139d-4794-b11b-89418016a720'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:16.245834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037415fd5ef64654880ef5e84eb3b0b1', 'request_id': 'req-cd15200f-139d-4794-b11b-89418016a720'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:16.309034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037415fd5ef64654880ef5e84eb3b0b1', 'request_id': 'req-cd15200f-139d-4794-b11b-89418016a720'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:16.340210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] The token cache is being invalidate because project 037415fd5ef64654880ef5e84eb3b0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:16.340650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:16.341585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:16.360654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:16.363590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:16.369849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1521/3025] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:15 2022] DELETE /identity/v3/projects/037415fd5ef64654880ef5e84eb3b0b1 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:16.412356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f107-192f-4f09-95d4-1713807f9959 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:16.590039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:16.702398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:16.722544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:16.723406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:16.725316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/33069313bb9b4134b0d983ae0ca38913` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:16.744458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Could not find domain: 33069313bb9b4134b0d983ae0ca38913.: keystone.exception.DomainNotFound: Could not find domain: 33069313bb9b4134b0d983ae0ca38913. Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 33069313bb9b4134b0d983ae0ca38913. Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:25:16.756836 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:25:16.758356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 33069313bb9b4134b0d983ae0ca38913. Oct 31 14:25:16.759582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:25:16.766419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1505/3026] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:25:16 2022] PATCH /identity/v3/domains/33069313bb9b4134b0d983ae0ca38913 => generated 112 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:25:16.767661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:16.789672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15200f-139d-4794-b11b-89418016a720 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:16.799936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e7c2e5db874c58bdfcf4c38383c454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df35a61ce62442e9b762f9ea05b19e17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:16.800959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:16.802855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:16.803413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] PATH_INFO: `/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:16.817892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e0f0d91f-8c59-4d4f-a1f8-2d50621864d0 tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Could not find domain: f4b8ba80d7ff4b42802309a9940f24e2.: keystone.exception.DomainNotFound: Could not find domain: f4b8ba80d7ff4b42802309a9940f24e2. Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f4b8ba80d7ff4b42802309a9940f24e2. Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:25:16.851108 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:25:16.852365 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f4b8ba80d7ff4b42802309a9940f24e2. Oct 31 14:25:16.853543 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:25:16.862374 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1522/3027] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:25:16 2022] PATCH /identity/v3/domains/f4b8ba80d7ff4b42802309a9940f24e2 => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:25:16.870409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:16.872995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:17.187179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5bb3b-5eec-45ae-bf5b-5bbee3ae31af tempest-ProjectsTestJSON-1328958292 tempest-ProjectsTestJSON-1328958292-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:17.199501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:17.202606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:17.202606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:17.202979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] PATH_INFO: `/v3/users/7013842f7a3a4256a74aa8e8f1ed73c1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:17.205731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7013842f7a3a4256a74aa8e8f1ed73c1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:17.211557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:17.500629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:17.516276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7013842f7a3a4256a74aa8e8f1ed73c1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:17.521901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:17.522919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7013842f7a3a4256a74aa8e8f1ed73c1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:17.608303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7013842f7a3a4256a74aa8e8f1ed73c1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:17.651424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7013842f7a3a4256a74aa8e8f1ed73c1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:17.656967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7013842f7a3a4256a74aa8e8f1ed73c1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:17.753604 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1506/3028] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:16 2022] DELETE /identity/v3/users/7013842f7a3a4256a74aa8e8f1ed73c1 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:17.755952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:17.756481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:17.757036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:17.807683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:17.810296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:18.140849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1523/3029] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:18.220000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:18.251467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:18.619077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:18.786317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:18.788178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:18.990933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f26a-80da-47f3-a2fb-f2ac9e9a185c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:19.004261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:19.008081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:19.008081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:19.008081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:19.033314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:19.035454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:19.069665 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1507/3030] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:25:19.207652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:20.622376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:21.007234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:21.329769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:21.331423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:21.350532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f85eaf-b8f1-420f-9bcf-a7c5f11ace44 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:21.362716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:21.363433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:21.363718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:21.363992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] PATH_INFO: `/v3/projects/cbfc8a616f944956be5cde38edafe338` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:21.366747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfc8a616f944956be5cde38edafe338)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:21.371630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:21.981530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfc8a616f944956be5cde38edafe338', 'request_id': 'req-70df65cb-35eb-4162-bfe7-a36c9d09122a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.136198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfc8a616f944956be5cde38edafe338', 'request_id': 'req-70df65cb-35eb-4162-bfe7-a36c9d09122a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.152798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfc8a616f944956be5cde38edafe338', 'request_id': 'req-70df65cb-35eb-4162-bfe7-a36c9d09122a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.193527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] The token cache is being invalidate because project cbfc8a616f944956be5cde38edafe338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:22.197608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.202684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.207490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1524/3031] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:21 2022] DELETE /identity/v3/projects/cbfc8a616f944956be5cde38edafe338 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:22.211591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:22.224253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101774-0438-490f-a30c-1328bcd789d2 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:22.356477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:22.357339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:22.357788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:22.359050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] PATH_INFO: `/v3/users/62e7c2e5db874c58bdfcf4c38383c454` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:22.360642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e7c2e5db874c58bdfcf4c38383c454)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:22.363043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:22.653674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e7c2e5db874c58bdfcf4c38383c454'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.654405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e7c2e5db874c58bdfcf4c38383c454'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.864460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e7c2e5db874c58bdfcf4c38383c454'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.887719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e7c2e5db874c58bdfcf4c38383c454'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.890514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a042d54-8113-4bc8-b6de-b037f90b9fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e7c2e5db874c58bdfcf4c38383c454'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:22.905259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:22.917622 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1508/3032] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:22 2022] DELETE /identity/v3/users/62e7c2e5db874c58bdfcf4c38383c454 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:23.222525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:23.756227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:24.094183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:24.096179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:24.131221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df65cb-35eb-4162-bfe7-a36c9d09122a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:24.218954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:24.322843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:24.322843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:24.322843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:24.322843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] PATH_INFO: `/v3/projects/df35a61ce62442e9b762f9ea05b19e17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:24.323633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df35a61ce62442e9b762f9ea05b19e17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:24.325512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:24.609378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df35a61ce62442e9b762f9ea05b19e17', 'request_id': 'req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:24.738739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df35a61ce62442e9b762f9ea05b19e17', 'request_id': 'req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:24.752706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df35a61ce62442e9b762f9ea05b19e17', 'request_id': 'req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:24.839806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] The token cache is being invalidate because project df35a61ce62442e9b762f9ea05b19e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:24.846650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:24.849697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:24.856095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bce476a9-2dfb-494a-96a9-531f9fd0cbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:24.860641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1525/3033] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:24 2022] DELETE /identity/v3/projects/df35a61ce62442e9b762f9ea05b19e17 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:24.866766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:24.870227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:24.870227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:24.917682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:24.919348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:25.082250 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1509/3034] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:25.089615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:25.090077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:25.090527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:25.133586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:25.135585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:25.157620 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1526/3035] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:25.160474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:25.175568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94652-a895-40be-bcf6-8138b259591e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:25.191553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:25.193658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:25.195700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:25.196232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:25.197269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:25.199907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:25.209697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:25.232234 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1510/3036] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:25.255742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:25.274793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a57f6-d07d-4fd4-aa48-af82c15adcd5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:25.296096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:25.297596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:25.298804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:25.300233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:25.305667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:25.310263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:25.499561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1527/3037] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:25 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:25.501353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:25.519957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8492-c2c6-46cb-ba1d-9ec1bc414f66 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:25.763762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:25.766487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:25.767491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:25.768658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:25.770463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:25.775136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:25.890560 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1511/3038] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:25 2022] POST /identity/v3/users => generated 285 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:25.896264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:25.913097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc0c9f-3483-4944-9719-6a153df2278b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:25.939034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:25.939743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:25.940107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:25.940439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:25.941331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:25.943113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:25.979670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1528/3039] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:25.983741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:25.995284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336bd-d248-499a-80f3-da564ffb6eeb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.003352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.004371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.004852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.005312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.006161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:26.008064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3845b6-f0b4-4eb3-8bc6-b59a078d4214 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:26.035723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1512/3040] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:26.038300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:26.052569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e67e0-5bcb-46ee-9350-c181eb6dd2c0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.074056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.074769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.075047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.075323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] PATH_INFO: `/v3/projects/de0620c87b0840c2a9c807a6d207dc13/users/1261fd658fb443a5a26ec911f094bc6a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.101925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0620c87b0840c2a9c807a6d207dc13, user_id=1261fd658fb443a5a26ec911f094bc6a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:26.105191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:26.142271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:26.198955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1529/3041] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:26 2022] PUT /identity/v3/projects/de0620c87b0840c2a9c807a6d207dc13/users/1261fd658fb443a5a26ec911f094bc6a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:26.202288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0290d38-6cca-4037-8248-335483d016ef None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.202288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0290d38-6cca-4037-8248-335483d016ef None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.203157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0290d38-6cca-4037-8248-335483d016ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.261653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c0290d38-6cca-4037-8248-335483d016ef None None] MFA Rules not processed for user `1261fd658fb443a5a26ec911f094bc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:26.261653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c0290d38-6cca-4037-8248-335483d016ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:26.386668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1513/3042] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:26.392419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:26.407763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebfa2-014b-4acb-a97e-f80d9eca71ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.416006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1261fd658fb443a5a26ec911f094bc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de0620c87b0840c2a9c807a6d207dc13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.416974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.417205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.417481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.427758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0290d38-6cca-4037-8248-335483d016ef None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:26.439424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0290d38-6cca-4037-8248-335483d016ef None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.441830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:26.442449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1530/3043] 10.222.0.13 () {58 vars in 1104 bytes} [Mon Oct 31 14:25:26 2022] GET /identity/v3 => generated 255 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:26.446735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c163df-bbbc-4785-b439-09a65d751f46 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1261fd658fb443a5a26ec911f094bc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de0620c87b0840c2a9c807a6d207dc13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.451462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c163df-bbbc-4785-b439-09a65d751f46 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.451462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c163df-bbbc-4785-b439-09a65d751f46 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.451462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c163df-bbbc-4785-b439-09a65d751f46 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] PATH_INFO: `/v3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.451462 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1514/3044] 10.222.0.13 () {58 vars in 1104 bytes} [Mon Oct 31 14:25:26 2022] GET /identity/v3 => generated 255 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:26.457664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:26.471800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72a866-ae77-4587-81cb-3c389837175a tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.484592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3f4b-d213-44cb-8c11-596c0e3e14a7 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1261fd658fb443a5a26ec911f094bc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de0620c87b0840c2a9c807a6d207dc13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.485212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3f4b-d213-44cb-8c11-596c0e3e14a7 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.485499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3f4b-d213-44cb-8c11-596c0e3e14a7 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.485775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3f4b-d213-44cb-8c11-596c0e3e14a7 tempest-TestApiDiscovery-1279782961 tempest-TestApiDiscovery-1279782961-project] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.487542 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1531/3045] 10.222.0.13 () {58 vars in 1104 bytes} [Mon Oct 31 14:25:26 2022] GET /identity/v3 => generated 255 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:26.495085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5076-04b0-42f1-85e7-f966cabdb60d None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.495377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5076-04b0-42f1-85e7-f966cabdb60d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.496429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5076-04b0-42f1-85e7-f966cabdb60d None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.500851 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1515/3046] 10.222.0.13 () {56 vars in 895 bytes} [Mon Oct 31 14:25:26 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:25:26.523155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadc93-ce0b-4e25-8106-01fff05a0d47 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.523597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadc93-ce0b-4e25-8106-01fff05a0d47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.525906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edadc93-ce0b-4e25-8106-01fff05a0d47 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.536107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1532/3047] 10.222.0.13 () {56 vars in 895 bytes} [Mon Oct 31 14:25:26 2022] GET /identity/ => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:25:26.542864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5076-04b0-42f1-85e7-f966cabdb60d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:26.740602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5076-04b0-42f1-85e7-f966cabdb60d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:26.747288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:26.748222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:26.749259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:26.749702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] PATH_INFO: `/v3/users/1261fd658fb443a5a26ec911f094bc6a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:26.751150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1261fd658fb443a5a26ec911f094bc6a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:26.754275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:26.886860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:26.997567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1261fd658fb443a5a26ec911f094bc6a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:27.000805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1261fd658fb443a5a26ec911f094bc6a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:27.062477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:27.109842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1261fd658fb443a5a26ec911f094bc6a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:27.134670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1261fd658fb443a5a26ec911f094bc6a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:27.135497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1261fd658fb443a5a26ec911f094bc6a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:27.151618 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1516/3048] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:26 2022] DELETE /identity/v3/users/1261fd658fb443a5a26ec911f094bc6a => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:27.156887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:27.157261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:27.157538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:27.178204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:27.179800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:27.269370 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1533/3049] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:27.276078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:27.277650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:27.361386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5daf1-927f-4a15-963e-d1b42a03f43e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:27.366143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:27.366827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:27.367121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:27.367359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:27.380213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:27.381878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a89b7-a1b1-438d-a339-cc0546981a67 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:27.402828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1517/3050] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:27.427454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:27.475909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:27.941788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:28.079921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:29.091436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:29.094814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:29.118867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64227f-891e-4947-a0da-db4a7622cde5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:29.129943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:29.131566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:29.131851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:29.132959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] PATH_INFO: `/v3/projects/de0620c87b0840c2a9c807a6d207dc13` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:29.134840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0620c87b0840c2a9c807a6d207dc13)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:29.142090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:29.188667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:29.328075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:29.339086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0620c87b0840c2a9c807a6d207dc13', 'request_id': 'req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:29.464665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0620c87b0840c2a9c807a6d207dc13', 'request_id': 'req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:29.476283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0620c87b0840c2a9c807a6d207dc13', 'request_id': 'req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:29.500733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] The token cache is being invalidate because project de0620c87b0840c2a9c807a6d207dc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:29.509492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:29.509492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f4fa03f-49ae-42d5-8ca3-17f6ea003bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:29.509492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1534/3051] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:29 2022] DELETE /identity/v3/projects/de0620c87b0840c2a9c807a6d207dc13 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:29.511388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:29.512314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:29.512596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:29.571660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:29.572918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:29.744913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1518/3052] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:29.754379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:29.754684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:29.755039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:29.855615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:29.857818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:29.881629 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1535/3053] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:29.885987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:29.896552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03711-626e-4b3b-805a-7c78975884ad None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:29.923761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:29.923761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:29.923761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:29.923761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:29.924237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:29.924237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:29.924237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:29.949885 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1519/3054] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:29.954699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:29.966780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bf0f4-cfdf-43e4-9c26-7ad5e3204b5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:29.984211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:29.988348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:29.988800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:29.989070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:29.992081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:29.998031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:30.269947 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1536/3055] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:29 2022] POST /identity/v3/projects => generated 379 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:30.273973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:30.284689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad52ec-eb04-4705-9840-439b70dd19a3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:30.475738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:30.479189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:30.479671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:30.481186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:30.482184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:30.488004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:30.595752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1520/3056] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:30 2022] POST /identity/v3/users => generated 290 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:30.596434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:30.596801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:30.616345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eea76-3f8a-475e-9380-b05646fcb567 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:30.621723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:30.623476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:30.626242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:30.626656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:30.627845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:30.636942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:30.668984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1537/3057] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:30.669631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:30.690094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555bd34-071d-4dee-b288-fd0520699f69 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:30.724101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:30.725728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:30.726470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:30.726579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:30.728845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:30.733993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ff18c-bbe4-46ae-87f5-ca2a97a030aa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:30.775855 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1521/3058] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:30.777330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:30.804594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e895e-9b3d-4a94-820b-7718cc1a97c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:30.815692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:30.822450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:30.823441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:30.825879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] PATH_INFO: `/v3/projects/0e103d5c7b3d4aec9c9e43611345ede3/users/4a5d9daf4a5946f2bbaacc78b17df250/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:30.879696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e103d5c7b3d4aec9c9e43611345ede3, user_id=4a5d9daf4a5946f2bbaacc78b17df250, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:30.887082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:30.999911 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1538/3059] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:30 2022] PUT /identity/v3/projects/0e103d5c7b3d4aec9c9e43611345ede3/users/4a5d9daf4a5946f2bbaacc78b17df250/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:31.010223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:31.010693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:31.011191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:31.089214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] MFA Rules not processed for user `4a5d9daf4a5946f2bbaacc78b17df250`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:31.094226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:31.328302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1522/3060] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:31.333078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:31.352641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea59-96ec-446b-920e-1a27061c5198 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:31.393299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a5d9daf4a5946f2bbaacc78b17df250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e103d5c7b3d4aec9c9e43611345ede3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:31.393299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:31.399625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:31.400007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:31.403832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:31.410851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d28fa-b9b7-4254-837d-6f6f8ffaf3ec tempest-DefaultDomainTestJSON-1487130944 tempest-DefaultDomainTestJSON-1487130944-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:31.416353 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1539/3061] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Oct 31 14:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:31.419722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:31.661667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0af94-67f5-4e36-8748-7e0b02756e04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:31.687966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:31.688552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:31.688833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:31.689104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] PATH_INFO: `/v3/users/4a5d9daf4a5946f2bbaacc78b17df250` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:31.695454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5d9daf4a5946f2bbaacc78b17df250)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:31.699685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:32.019727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5d9daf4a5946f2bbaacc78b17df250'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:32.020722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5d9daf4a5946f2bbaacc78b17df250'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:32.093669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:32.113036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5d9daf4a5946f2bbaacc78b17df250'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:32.146685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5d9daf4a5946f2bbaacc78b17df250'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:32.149351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5d9daf4a5946f2bbaacc78b17df250'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:32.186752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1523/3062] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:31 2022] DELETE /identity/v3/users/4a5d9daf4a5946f2bbaacc78b17df250 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:32.191039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:32.191453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:32.191799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:32.230445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:32.234024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:32.458293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:32.459011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1540/3063] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:32.460444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:32.610643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31d7cd-b170-461d-80ee-1d53f4d64863 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:32.622604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:32.624569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:32.625596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:32.627077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:32.651480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:32.658125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d85abb-cd7f-41cb-ba02-d37eeceedb25 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:32.690233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1524/3064] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:32.965738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:33.449631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:33.451445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:33.492595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568921d-44ec-4770-8ef8-d1d7dc70c37a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:33.508694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:33.509502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:33.509895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:33.510388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] PATH_INFO: `/v3/projects/0e103d5c7b3d4aec9c9e43611345ede3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:33.511799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e103d5c7b3d4aec9c9e43611345ede3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:33.514407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:33.728778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e103d5c7b3d4aec9c9e43611345ede3', 'request_id': 'req-66c41cff-7470-4b94-915e-28b675907e76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:33.818523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e103d5c7b3d4aec9c9e43611345ede3', 'request_id': 'req-66c41cff-7470-4b94-915e-28b675907e76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:33.825437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e103d5c7b3d4aec9c9e43611345ede3', 'request_id': 'req-66c41cff-7470-4b94-915e-28b675907e76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:33.856695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] The token cache is being invalidate because project 0e103d5c7b3d4aec9c9e43611345ede3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:33.858605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:33.859391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66c41cff-7470-4b94-915e-28b675907e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:33.869525 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1541/3065] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:33 2022] DELETE /identity/v3/projects/0e103d5c7b3d4aec9c9e43611345ede3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:33.870964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:33.871455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:33.871571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:33.919100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:33.920862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:33.958884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:34.064733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:34.172721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1525/3066] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:34.180848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:34.181147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:34.181487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:34.244435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:34.245613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:34.282697 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1542/3067] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:34.283320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:34.305083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6cacc-e3a5-40b7-99e9-ca48c35a2826 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:34.337551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:34.339772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:34.350738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:34.350738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:34.350738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:34.350738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:34.350738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:34.361259 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1526/3068] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:25:34.365581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:34.381323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b61d7-ef9e-41f0-b5f0-0ec4bdaab64b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:34.405615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:34.406246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:34.407410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:34.408625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:34.411793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:34.426034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:34.455934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:34.590930 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1543/3069] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:34 2022] POST /identity/v3/projects => generated 389 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:34.595616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:34.616699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1403f2-f4ae-4da0-ac12-1209128b034c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:34.704380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:34.867297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:34.867490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:34.870372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:34.870883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:34.871633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:34.877757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:35.035228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1527/3070] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:34 2022] POST /identity/v3/users => generated 301 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:35.040047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:35.055269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b33c-8648-40ca-aa7b-a77cde846842 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:35.072666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:35.077130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:35.077683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:35.078113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:35.079104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:35.081612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:35.118400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:35.119460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1544/3071] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:35.134651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd0df-eb70-41a0-8e4e-8b43f83b8af8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:35.148751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:35.150497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:35.153398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:35.155381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] PATH_INFO: `/v3/projects/6603d08ad6dd45dea307bce5b6507f27/users/f4094debd0174f2583befa6aec4e8806/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:35.193729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6603d08ad6dd45dea307bce5b6507f27, user_id=f4094debd0174f2583befa6aec4e8806, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:35.201767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:35.208417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:35.312455 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1528/3072] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:35 2022] PUT /identity/v3/projects/6603d08ad6dd45dea307bce5b6507f27/users/f4094debd0174f2583befa6aec4e8806/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:35.317346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:35.330991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f053-a9c9-445d-b42b-767450d168c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:35.361272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:35.468825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:35.469929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:35.470430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:35.470965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:35.471856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:35.473668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b989-bbb2-4f87-985c-d5ce02e49181 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:35.507306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1545/3073] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:35.511365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:35.528569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d438ae-0ce1-40d0-9603-c6285326185a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:35.543098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:35.543943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:35.544323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:35.544698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] PATH_INFO: `/v3/projects/6603d08ad6dd45dea307bce5b6507f27/users/f4094debd0174f2583befa6aec4e8806/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:35.551358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6603d08ad6dd45dea307bce5b6507f27, user_id=f4094debd0174f2583befa6aec4e8806, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:35.554223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:35.578040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1529/3074] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:35 2022] PUT /identity/v3/projects/6603d08ad6dd45dea307bce5b6507f27/users/f4094debd0174f2583befa6aec4e8806/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:35.589859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083769-2390-404c-a297-41079434f67e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:35.590525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083769-2390-404c-a297-41079434f67e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:35.591047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03083769-2390-404c-a297-41079434f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:35.650175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:35.663932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03083769-2390-404c-a297-41079434f67e None None] MFA Rules not processed for user `f4094debd0174f2583befa6aec4e8806`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:35.665467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03083769-2390-404c-a297-41079434f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:35.843671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1546/3075] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:35.846929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:36.032357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:36.076147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ef265-b603-442f-b816-ee0a018d2f8c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:36.099146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:36.099693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.107332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.108187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:36.108880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:36.111943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:36.253182 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1530/3076] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:35 2022] POST /identity/v3/projects => generated 393 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:36.257342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03083769-2390-404c-a297-41079434f67e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:36.275031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03083769-2390-404c-a297-41079434f67e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:36.287989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:36.408523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:36.409195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.409474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.409891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:36.410369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:36.412413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:36.576812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1547/3077] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:36 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:36.580732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:36.599516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135cb25-a26d-4183-a91e-b68b275452a3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:36.628767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:36.629980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.630493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.631062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:36.632245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:36.635451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:36.664552 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1531/3078] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:36.669652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:36.687215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ba35-f533-4bc5-b083-44d0caa11d81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:36.692937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:36.693870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.694368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.694905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:36.695919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:36.698464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b99f17-499a-44cd-bb8a-b3e2cb7ba085 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:36.736892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1548/3079] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:36.739913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:36.757924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c88666-fcb9-420b-9a25-3274fb528c39 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:36.780335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:36.788327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.789023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.789023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] PATH_INFO: `/v3/projects/18fcadf6dc124110b48bf5b8a9b3c64b/users/10872c2efbf242e486457f153620e88c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:36.829972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fcadf6dc124110b48bf5b8a9b3c64b, user_id=10872c2efbf242e486457f153620e88c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:36.834679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:36.953358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1532/3080] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:36 2022] PUT /identity/v3/projects/18fcadf6dc124110b48bf5b8a9b3c64b/users/10872c2efbf242e486457f153620e88c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:36.963713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae9e1-05ac-4bc3-8605-bb021cbd32cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:36.964198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae9e1-05ac-4bc3-8605-bb021cbd32cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:36.964618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae9e1-05ac-4bc3-8605-bb021cbd32cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:37.128304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c1ae9e1-05ac-4bc3-8605-bb021cbd32cf None None] MFA Rules not processed for user `10872c2efbf242e486457f153620e88c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:37.136063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c1ae9e1-05ac-4bc3-8605-bb021cbd32cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:37.292924 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1549/3081] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:37.295787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:37.295787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:37.401053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4fa2-c8a3-41c2-9e28-ad410b5a4ee6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:37.410441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:37.412273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:37.412273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:37.412273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:37.606285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:37.607232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:37.639945 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1533/3082] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:40.274043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cbc6-394b-465e-9937-163322a68593 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:40.274667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cbc6-394b-465e-9937-163322a68593 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:40.274667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cbc6-394b-465e-9937-163322a68593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:40.306476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5858cbc6-394b-465e-9937-163322a68593 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:40.309056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5858cbc6-394b-465e-9937-163322a68593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:40.465411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1550/3083] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:40.467162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:40.468569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:40.628314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:40.703985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9c14-5ff8-498e-a23e-848cb5e2fcce service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:40.719444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:40.720043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:40.720322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:40.720593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:40.747948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:40.749695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98d91b-d9a4-4e92-b7af-4e334c6cbeaf service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:40.778383 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1534/3084] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:25:41.418156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858cbc6-394b-465e-9937-163322a68593 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:41.455747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:41.528018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858cbc6-394b-465e-9937-163322a68593 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:41.534269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:41.535287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:41.535972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:41.536507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] PATH_INFO: `/v3/users/f4094debd0174f2583befa6aec4e8806` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:41.538292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4094debd0174f2583befa6aec4e8806)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:41.540623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:41.894675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4094debd0174f2583befa6aec4e8806'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:41.897699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4094debd0174f2583befa6aec4e8806'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.004014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4094debd0174f2583befa6aec4e8806'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.019932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4094debd0174f2583befa6aec4e8806'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.020783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4094debd0174f2583befa6aec4e8806'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.056252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1551/3085] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:41 2022] DELETE /identity/v3/users/f4094debd0174f2583befa6aec4e8806 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:42.060990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:42.061532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:42.061532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:42.074498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:42.079115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:42.100071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:42.100071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:42.208204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1535/3086] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:42.218667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:42.220514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:42.230308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426f27-a972-49f5-b675-1bbac1e7c0e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:42.237664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:42.238692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:42.239209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:42.239439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] PATH_INFO: `/v3/users/362815f4862e42b5babc7248ab09aa84` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:42.241007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362815f4862e42b5babc7248ab09aa84)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:42.243682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:42.308332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683a18b-8a98-4c44-8275-19788a4af615 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:42.317531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:42.319005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:42.319005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:42.319005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:42.332030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:42.333618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f1d8-ddf6-4828-95fc-c7e34e7f6049 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:42.361624 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1536/3087] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:42.485550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362815f4862e42b5babc7248ab09aa84'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.486917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362815f4862e42b5babc7248ab09aa84'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.591223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:42.595230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362815f4862e42b5babc7248ab09aa84'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.619364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362815f4862e42b5babc7248ab09aa84'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.620805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362815f4862e42b5babc7248ab09aa84'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:42.647500 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1552/3088] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:42 2022] DELETE /identity/v3/users/362815f4862e42b5babc7248ab09aa84 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:42.821348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:42.821996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:42.822492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:42.844572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:42.846073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:42.930673 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1537/3089] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:42.973451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:42.975015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:42.988071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:42.996787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:43.067853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:43.127597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cfb1-cd7b-428c-9713-cbd182aeb927 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:43.133139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:43.134047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:43.134330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:43.134602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] PATH_INFO: `/v3/projects/6603d08ad6dd45dea307bce5b6507f27` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:43.135772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6603d08ad6dd45dea307bce5b6507f27)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:43.137959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:43.140824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf373fc-3153-46bb-a98b-ddd7929647db None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:43.146852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:43.147673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:43.148215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:43.149295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] PATH_INFO: `/v3/projects/f7be95d8d24a4ae6aea721ea528dc4f1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:43.151383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7be95d8d24a4ae6aea721ea528dc4f1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:43.153424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:43.281766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6603d08ad6dd45dea307bce5b6507f27', 'request_id': 'req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.306474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7be95d8d24a4ae6aea721ea528dc4f1', 'request_id': 'req-ab4eb9e6-164c-449c-b982-3841e9b2ff45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.407317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6603d08ad6dd45dea307bce5b6507f27', 'request_id': 'req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.417345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6603d08ad6dd45dea307bce5b6507f27', 'request_id': 'req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.437824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] The token cache is being invalidate because project 6603d08ad6dd45dea307bce5b6507f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:43.438407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.439482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.448339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1553/3090] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:42 2022] DELETE /identity/v3/projects/6603d08ad6dd45dea307bce5b6507f27 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:43.453026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:43.454909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:43.475965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7be95d8d24a4ae6aea721ea528dc4f1', 'request_id': 'req-ab4eb9e6-164c-449c-b982-3841e9b2ff45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.485367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7be95d8d24a4ae6aea721ea528dc4f1', 'request_id': 'req-ab4eb9e6-164c-449c-b982-3841e9b2ff45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.504703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] The token cache is being invalidate because project f7be95d8d24a4ae6aea721ea528dc4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:43.506406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.506406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.508854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1538/3091] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:42 2022] DELETE /identity/v3/projects/f7be95d8d24a4ae6aea721ea528dc4f1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:43.513045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:43.515415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:43.567149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257757-29c7-4eb9-9ad5-8d354a4d1f27 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:43.640452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4eb9e6-164c-449c-b982-3841e9b2ff45 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:43.646443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:43.647382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:43.647855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:43.648406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] PATH_INFO: `/v3/users/33362a8885944015801ad18a3885bc17` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:43.649867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33362a8885944015801ad18a3885bc17)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:43.655429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:43.692903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:43.695669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:43.695669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:43.695669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] PATH_INFO: `/v3/users/10872c2efbf242e486457f153620e88c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:43.695669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10872c2efbf242e486457f153620e88c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:43.697233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:43.924768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33362a8885944015801ad18a3885bc17'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.925594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33362a8885944015801ad18a3885bc17'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.952282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10872c2efbf242e486457f153620e88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.952998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10872c2efbf242e486457f153620e88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.992581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33362a8885944015801ad18a3885bc17'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:43.996382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:44.017015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33362a8885944015801ad18a3885bc17'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.017736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96bd7579-e856-488b-b2f4-40737c8bfe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33362a8885944015801ad18a3885bc17'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.036355 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1539/3092] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:43 2022] DELETE /identity/v3/users/33362a8885944015801ad18a3885bc17 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:44.050241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:44.078131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10872c2efbf242e486457f153620e88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.096347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10872c2efbf242e486457f153620e88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.098833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10872c2efbf242e486457f153620e88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.129079 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1554/3093] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:43 2022] DELETE /identity/v3/users/10872c2efbf242e486457f153620e88c => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:44.461007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:44.461528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:44.461644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:44.495859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:44.505999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:44.510712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:44.512306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:44.619938 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1540/3094] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:44.653599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c10-672d-4b07-b5be-b1669258f2a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:44.659197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:44.659923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:44.660417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:44.660780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] PATH_INFO: `/v3/projects/646c7cfdde1045a5b69bdd69a57609aa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:44.662016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=646c7cfdde1045a5b69bdd69a57609aa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:44.664368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:44.858712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:44.860348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:44.867454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646c7cfdde1045a5b69bdd69a57609aa', 'request_id': 'req-5448675a-1f9a-43f7-b344-f2e31cc8d98c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.883816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f661fb-d4ab-4a6f-ab0a-063fbe9739a2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:44.945471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646c7cfdde1045a5b69bdd69a57609aa', 'request_id': 'req-5448675a-1f9a-43f7-b344-f2e31cc8d98c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:44.977095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646c7cfdde1045a5b69bdd69a57609aa', 'request_id': 'req-5448675a-1f9a-43f7-b344-f2e31cc8d98c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.010359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.011263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.011713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.012177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] PATH_INFO: `/v3/projects/18fcadf6dc124110b48bf5b8a9b3c64b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.016212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fcadf6dc124110b48bf5b8a9b3c64b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.018431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.033462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] The token cache is being invalidate because project 646c7cfdde1045a5b69bdd69a57609aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:45.034570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.038725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5448675a-1f9a-43f7-b344-f2e31cc8d98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.046498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1555/3095] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:44 2022] DELETE /identity/v3/projects/646c7cfdde1045a5b69bdd69a57609aa => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:45.048470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a219b-2053-4219-8bf6-f9dddc667650 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.049273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a219b-2053-4219-8bf6-f9dddc667650 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.049650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a219b-2053-4219-8bf6-f9dddc667650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.085597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f37a219b-2053-4219-8bf6-f9dddc667650 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:45.087212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f37a219b-2053-4219-8bf6-f9dddc667650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:45.105596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1556/3096] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:45.108393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.108932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.109484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.158268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:45.160625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:45.172375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fcadf6dc124110b48bf5b8a9b3c64b', 'request_id': 'req-7307cabe-2722-493d-86b5-82ce93adde0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.259413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1557/3097] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:45.266733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.281880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fcadf6dc124110b48bf5b8a9b3c64b', 'request_id': 'req-7307cabe-2722-493d-86b5-82ce93adde0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.291089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fcadf6dc124110b48bf5b8a9b3c64b', 'request_id': 'req-7307cabe-2722-493d-86b5-82ce93adde0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.297978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa42e2-8e58-463c-aabb-eebe55d528fa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.305319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.306368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.306848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.307264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.308245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:45.309321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.312135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.318881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] The token cache is being invalidate because project 18fcadf6dc124110b48bf5b8a9b3c64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:45.320645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.321444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7307cabe-2722-493d-86b5-82ce93adde0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:45.327371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1541/3098] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:44 2022] DELETE /identity/v3/projects/18fcadf6dc124110b48bf5b8a9b3c64b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:45.332750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939304fa-f601-4d86-8421-6a032c0c5718 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.333160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939304fa-f601-4d86-8421-6a032c0c5718 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.333625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939304fa-f601-4d86-8421-6a032c0c5718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.336168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1558/3099] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:45.344298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.344298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:45.371451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5a7b-25af-45ab-bae3-46ddea3030f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.373437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-939304fa-f601-4d86-8421-6a032c0c5718 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:45.376388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-939304fa-f601-4d86-8421-6a032c0c5718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:45.384677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.392347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.392347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.392347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.392347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.398142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.403362 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1542/3100] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:45.412549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.413407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.413934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.470306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:45.471625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:45.485948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1543/3101] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:45.490501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.502485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12aed3-ffb5-49ca-8b36-1377a0b0561e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.510036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.511108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.511554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.511990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.515459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:45.516025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.517869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.527670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:45.541065 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1544/3102] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:45.542499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.555307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbad0f8-bd48-472e-beb0-cb9ac480f0bc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.561584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.562412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.562904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.563363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.564179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.566857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.616984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1559/3103] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:45.620847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.667070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:45.687441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1545/3104] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:45.700303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:45.766560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9f938-648a-4aad-837d-a85cf751f08d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.882400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0646b-edf7-46d2-89a0-ba130ce8e01d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:45.889633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.890687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.891105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.891410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.892223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.894936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:45.897038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:45.897212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:45.897421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:45.897703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:45.898570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:45.900735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.048593 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1560/3105] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/users => generated 289 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:46.051531 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1546/3106] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:45 2022] POST /identity/v3/users => generated 299 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:46.052785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.055319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.069446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763c1d-2c70-48d0-ada2-f877cd4de884 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.078931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.078931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.078931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.078931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.079360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.080569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.094547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c5ad-def9-4f66-a3b3-2f68ea8d0c83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.103647 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1561/3107] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:46.105857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.125993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c63cb9-1ca7-4efc-bdb5-55eafcda1e36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.136392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.139019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.139673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.139985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.140314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.140974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.141376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.142605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.142809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.143252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.148060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.166564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.171007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1562/3108] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:46.186518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.198279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af2542-1fef-4444-858d-d5d8a57d0dcc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.207731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.208197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1547/3109] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:46.208433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.208715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.208993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] PATH_INFO: `/v3/projects/c374c352e1aa4b6bbf50fc5ba00cd47f/users/65107df4a0bb4534b96de32681efbfa5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.210147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.252420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b37a9-7856-4f9a-b2a4-5df8bdfcbe91 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.253900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c374c352e1aa4b6bbf50fc5ba00cd47f, user_id=65107df4a0bb4534b96de32681efbfa5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.256624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9b52-014a-4357-afa3-62fba8324198 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.267289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.268297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.268794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.269238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] PATH_INFO: `/v3/projects/0a460af3df0344cd8b3820dcba4df0ff/users/c2503349f200487f9753eec3b1dde1bc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.295257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a460af3df0344cd8b3820dcba4df0ff, user_id=c2503349f200487f9753eec3b1dde1bc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.298434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.391700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1563/3110] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:46 2022] PUT /identity/v3/projects/c374c352e1aa4b6bbf50fc5ba00cd47f/users/65107df4a0bb4534b96de32681efbfa5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:46.408738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.408738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.408738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.443615 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1548/3111] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:46 2022] PUT /identity/v3/projects/0a460af3df0344cd8b3820dcba4df0ff/users/c2503349f200487f9753eec3b1dde1bc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:46.448018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.481704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] MFA Rules not processed for user `65107df4a0bb4534b96de32681efbfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:46.483942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:46.612984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c399-0285-4c2c-aaf9-f62caef51ad5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.639468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.641178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.641407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.644032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.645111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.647666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.671815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1549/3112] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:46.679841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.680883 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1564/3113] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:46.693992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8574752-5f78-489d-874f-af4365c5dc04 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:46.698049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:46.698800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.699321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.699610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] PATH_INFO: `/v3/projects/0a460af3df0344cd8b3820dcba4df0ff/users/c2503349f200487f9753eec3b1dde1bc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.702327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a460af3df0344cd8b3820dcba4df0ff, user_id=c2503349f200487f9753eec3b1dde1bc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:46.705210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7358-0de6-4d70-9014-04663304b7b8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:46.724750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.726307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:46.738510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1550/3114] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:46 2022] PUT /identity/v3/projects/0a460af3df0344cd8b3820dcba4df0ff/users/c2503349f200487f9753eec3b1dde1bc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:46.740252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:46.740789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:46.745943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:46.801295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:46.805651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] MFA Rules not processed for user `c2503349f200487f9753eec3b1dde1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:46.807115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:46.865575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:46.937692 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1551/3115] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:25:46.942194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:46.965625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc701ee-9cdd-4e93-833a-2084c7a18cb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.081471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb7f5-3dc0-4e5b-a8dd-5b72c5f578b7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.090803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.091528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.092351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.095555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.095555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.112033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.137054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.138060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.138610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.139207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.247306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.258938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.272242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1565/3116] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:25:47.281515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:47.291650 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1552/3117] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:46 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:47.295360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:47.315071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf850a1-6a08-42c0-bb26-597336218b99 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.436280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.437469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.437975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.438516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.439441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.442017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.531004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:47.582134 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1566/3118] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:47 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:25:47.583108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:47.605578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47049ae-3c2e-401d-9670-934d8a012310 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.621704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.622539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.624001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.624558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.626457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.629488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.658032 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1553/3119] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:47.661825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:47.678384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9685b48-ce86-40c5-879b-d4f23dd6a688 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.690829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.691500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.691718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.691993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.692642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.694261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7276e-d0aa-450a-a1d0-bd84622940b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.733851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1567/3120] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:47.734713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:47.765582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca364d-d125-438f-9394-42f75c936b0a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:47.779774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:47.780452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.780819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.781098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] PATH_INFO: `/v3/projects/feb9db1aceb040b09b018e2115182a79/users/8449919d9325438d987d68736d612a57/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.799582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9db1aceb040b09b018e2115182a79, user_id=8449919d9325438d987d68736d612a57, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:47.812202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ab3f-524e-4dc2-9efe-a1da2e4ca670 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:47.882354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.888612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.889170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:47.954713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1554/3121] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:47 2022] PUT /identity/v3/projects/feb9db1aceb040b09b018e2115182a79/users/8449919d9325438d987d68736d612a57/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:47.956017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:47.959618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:47.964891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:47.965172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:47.965689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:48.066399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] MFA Rules not processed for user `8449919d9325438d987d68736d612a57`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:48.068244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:48.117253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1568/3122] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:25:48.143348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:48.147953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:48.220083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:48.390666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1555/3123] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:25:48.424650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:48.436087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:48.533112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc7e70-649d-4ec9-ad7a-835345ad8764 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:48.559731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:48.560999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:48.561275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:48.561543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:48.585439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88293cf0-df47-4769-b298-c95ce01577ee None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:48.589777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:48.590807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:48.591060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:48.592129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:48.592701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:48.601010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbad146-fb1c-478a-9b57-a6ea09e11af2 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:48.623363 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1569/3124] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:48.781345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:48.783128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:48.820300 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1556/3125] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:49.124935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:49.126122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:49.126636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:49.186987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] MFA Rules not processed for user `65107df4a0bb4534b96de32681efbfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:49.188576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:49.296642 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1570/3126] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:49.549480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:49.551347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:49.778243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5551-00cb-49a8-8813-5c14f308d555 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:49.790229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:49.791102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:49.791488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:49.791860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:49.795104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:49.825278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:49.850754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:49.852428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:49.971064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:49.972889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52a538-999e-4110-8ddd-1267a87d8be3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:50.020219 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1557/3127] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:50.022638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495aa30-5f60-4463-a42b-1f29c34e04f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:50.048672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:50.049605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:50.052553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:50.053356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] PATH_INFO: `/v3/users/c2503349f200487f9753eec3b1dde1bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:50.061852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2503349f200487f9753eec3b1dde1bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:50.064484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:50.409311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2503349f200487f9753eec3b1dde1bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:50.411443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2503349f200487f9753eec3b1dde1bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:50.530026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2503349f200487f9753eec3b1dde1bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:50.574210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2503349f200487f9753eec3b1dde1bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:50.576851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22acdbe5-04ef-4786-8a7d-f683c6f5eb69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2503349f200487f9753eec3b1dde1bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:50.649171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1571/3128] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:49 2022] DELETE /identity/v3/users/c2503349f200487f9753eec3b1dde1bc => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:50.652388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:50.652669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:50.652945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:50.681277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:50.682159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:50.682553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:50.705426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:50.707412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:50.766124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:50.768890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:50.862025 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1558/3129] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:50.878476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:50.883858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:50.921107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1572/3130] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:25:50.974766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:50.974766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:51.083040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52052-7fb0-469f-be01-5753a30fa420 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:51.095354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:51.096195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:51.097801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:51.098260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:51.125788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:51.130212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:51.158536 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1559/3131] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:25:51.161696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8b61f-b7f7-4a48-82f1-4e9c509176f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:51.174102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:51.174788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:51.175504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:51.175796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:51.201191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:51.204490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91102e60-b73c-4817-9ede-f99b0174d89f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:51.236375 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1573/3132] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:51.715991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:51.719636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:51.782675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c861a-81b0-4f73-8b2a-80f0b727d8b8 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:51.806558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:51.806558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:51.806558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:51.806558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] PATH_INFO: `/v3/users/65107df4a0bb4534b96de32681efbfa5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:51.811365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65107df4a0bb4534b96de32681efbfa5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:51.813488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:51.821740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:52.127806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65107df4a0bb4534b96de32681efbfa5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:52.129115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65107df4a0bb4534b96de32681efbfa5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:52.224743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65107df4a0bb4534b96de32681efbfa5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:52.232152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:52.245973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65107df4a0bb4534b96de32681efbfa5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:52.251598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65107df4a0bb4534b96de32681efbfa5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:52.285812 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1560/3133] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:51 2022] DELETE /identity/v3/users/65107df4a0bb4534b96de32681efbfa5 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:52.288999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:52.288999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:52.288999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:52.326280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:52.330499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:52.512385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1574/3134] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:25:52.571550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:52.578066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:52.722263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8e4df-ddfd-4258-8995-fa05d23a8c2f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:52.733342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:52.734061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:52.734411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:52.734789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:52.767805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:52.769379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:52.805065 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1561/3135] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:53.890685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:53.892263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:53.917073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4618a-120a-4b1e-ad17-7f61dfb892a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:53.939544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:53.940522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:53.940985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:53.945778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] PATH_INFO: `/v3/projects/c374c352e1aa4b6bbf50fc5ba00cd47f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:53.953778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c374c352e1aa4b6bbf50fc5ba00cd47f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:53.958732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:54.095377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:54.098771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:54.118094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2596-e47c-4941-8910-60ebc5100e8a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:54.147953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c374c352e1aa4b6bbf50fc5ba00cd47f', 'request_id': 'req-bc2fbb21-559d-4f52-920a-658966920b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.260928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c374c352e1aa4b6bbf50fc5ba00cd47f', 'request_id': 'req-bc2fbb21-559d-4f52-920a-658966920b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.269615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c374c352e1aa4b6bbf50fc5ba00cd47f', 'request_id': 'req-bc2fbb21-559d-4f52-920a-658966920b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.273500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:54.277501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.279306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.279806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] PATH_INFO: `/v3/projects/0a460af3df0344cd8b3820dcba4df0ff` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.281605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a460af3df0344cd8b3820dcba4df0ff)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:54.288182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:54.293040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] The token cache is being invalidate because project c374c352e1aa4b6bbf50fc5ba00cd47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:54.295010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.297497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc2fbb21-559d-4f52-920a-658966920b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.302425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1575/3136] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:53 2022] DELETE /identity/v3/projects/c374c352e1aa4b6bbf50fc5ba00cd47f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:54.313479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f4f4-87c0-44d2-8064-1d1556a43d17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.314175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f4f4-87c0-44d2-8064-1d1556a43d17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.315844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05f4f4-87c0-44d2-8064-1d1556a43d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.399427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cb05f4f4-87c0-44d2-8064-1d1556a43d17 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:54.405374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb05f4f4-87c0-44d2-8064-1d1556a43d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:54.421499 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1576/3137] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:54.432109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.433351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.435563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.484635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:54.490927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:54.517366 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1577/3138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:54.520847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:54.546057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a460af3df0344cd8b3820dcba4df0ff', 'request_id': 'req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.547748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1747026-9066-436c-966f-5253b3d1f259 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:54.617904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:54.624072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a460af3df0344cd8b3820dcba4df0ff', 'request_id': 'req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.631446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a460af3df0344cd8b3820dcba4df0ff', 'request_id': 'req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.654282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:54.655355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.655933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] The token cache is being invalidate because project 0a460af3df0344cd8b3820dcba4df0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:54.656294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.656524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.657011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.657422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.658180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:54.658690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:54.660619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:54.664443 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1562/3139] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:54 2022] DELETE /identity/v3/projects/0a460af3df0344cd8b3820dcba4df0ff => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:25:54.668906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:54.676366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:54.680213 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1578/3140] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:54.685298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:54.691337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:54.695233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895836-a3e8-4bed-97bf-8c8d84a9e8f9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:54.726652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:54.727166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.727448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.730489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] PATH_INFO: `/v3/users/8449919d9325438d987d68736d612a57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.742951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8449919d9325438d987d68736d612a57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:54.746351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d45386-2de7-4808-80c6-6321a8271511 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:54.746515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:54.756989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:54.757154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:54.758930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:54.759338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:54.759783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:54.760596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:54.764132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:54.884492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1579/3141] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:54 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:54.891950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:54.979903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8449919d9325438d987d68736d612a57'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:54.980597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8449919d9325438d987d68736d612a57'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:55.065502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c39941-b7a5-4ae5-bd17-ecdbcc3aa690 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:55.081089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:55.081843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:55.082642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:55.083023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:55.083845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:55.090034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:55.097638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8449919d9325438d987d68736d612a57'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:55.126149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8449919d9325438d987d68736d612a57'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:55.128427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8449919d9325438d987d68736d612a57'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:55.174695 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1563/3142] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:54 2022] DELETE /identity/v3/users/8449919d9325438d987d68736d612a57 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:55.264715 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1580/3143] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:54 2022] POST /identity/v3/users => generated 290 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:55.265372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:55.267904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:55.463113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac62d-2f36-47a9-9777-bdfb54d7b8bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:55.487469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:55.488109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:55.488385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:55.488655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:55.489313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:55.491012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:55.532135 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1564/3144] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:55.535764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:55.550002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693319a-d561-4fd1-a4d7-09f3d2292023 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:55.563060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:55.564106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:55.564608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:55.565311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:55.566213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:55.570327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ecf42-91db-4b7d-81a5-ca5d69e7a2aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:55.597314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1581/3145] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:55.601728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:55.612681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c75d8-0b52-4c7c-a55f-31892d654b8e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:55.641028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:55.641586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:55.641901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:55.642204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] PATH_INFO: `/v3/projects/53ea67e3be6e46b081ed8d7f34d6d4d4/users/cf9ce3308e0a48d9ad53674df0efed86/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:55.686350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ea67e3be6e46b081ed8d7f34d6d4d4, user_id=cf9ce3308e0a48d9ad53674df0efed86, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:55.689066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:55.788463 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1565/3146] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:55 2022] PUT /identity/v3/projects/53ea67e3be6e46b081ed8d7f34d6d4d4/users/cf9ce3308e0a48d9ad53674df0efed86/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:55.802637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:55.803510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:55.804032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:55.907247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] MFA Rules not processed for user `cf9ce3308e0a48d9ad53674df0efed86`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:55.908498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:56.219274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1582/3147] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:56.236574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:56.239183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:56.480023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb0f1-563e-4ce8-a734-e8a169bb6142 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:56.496555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:56.497242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:56.497525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:56.497814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:56.522934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:56.524409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d0f81-ff22-4bbe-8117-7620d0c1c137 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:56.529110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:56.569481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1566/3148] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:25:56.877351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:56.878988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:56.924678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:56.997981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:56.998369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.000734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.332434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8f356-c7fb-4cb4-87af-60eb1445bef4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:57.334824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:57.334824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:57.336794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:57.336794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:57.336794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.336794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] PATH_INFO: `/v3/projects/feb9db1aceb040b09b018e2115182a79` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.339008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb9db1aceb040b09b018e2115182a79)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:57.339008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:57.339247 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1567/3149] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:57.339247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:57.339247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:57.402919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9cece-3081-4ad0-8138-4334ebf41395 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:57.449279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:57.449986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:57.450881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.451850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.467354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:57.471576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1264fd-79be-462b-bc23-5b30ef303015 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:57.508143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb9db1aceb040b09b018e2115182a79', 'request_id': 'req-5a5465e6-2843-46df-a2c8-cbe70287bb5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:57.508863 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1568/3150] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:25:57.696024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb9db1aceb040b09b018e2115182a79', 'request_id': 'req-5a5465e6-2843-46df-a2c8-cbe70287bb5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:57.714289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb9db1aceb040b09b018e2115182a79', 'request_id': 'req-5a5465e6-2843-46df-a2c8-cbe70287bb5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:57.754040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] The token cache is being invalidate because project feb9db1aceb040b09b018e2115182a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:25:57.754249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:57.756156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a5465e6-2843-46df-a2c8-cbe70287bb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:57.758359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1583/3151] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:25:56 2022] DELETE /identity/v3/projects/feb9db1aceb040b09b018e2115182a79 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:57.764107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:57.764603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.765056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.798168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:57.801643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:57.904226 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1569/3152] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:57.913090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:57.913656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.913939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.946865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:57.948139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:57.968036 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1584/3153] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:57.973148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:57.987067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4dbfd-9620-4b46-a36f-ac1f1233f098 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:57.992870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:57.993644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:57.994129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:57.994946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:57.997928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:25:57.998402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.000379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.035509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1570/3154] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:25:58.040406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:58.052470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2c8ae-f9cc-48c1-8a4e-9b5e823ac815 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:58.059133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:58.060695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.061114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.061551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.062490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.065131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.183622 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1585/3155] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:25:58 2022] POST /identity/v3/projects => generated 359 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:58.187997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:58.206732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094d06c-ed17-425e-9c08-93dc59ae9646 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:58.268263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:58.327652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:58.328538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.329018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.329482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.330347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.333223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.441713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1571/3156] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:25:58 2022] POST /identity/v3/users => generated 280 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:25:58.446819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:58.469829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0105a8-55bc-462e-8c36-021b67d5c720 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:58.475601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:58.476617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.477120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.478520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.479532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.482585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.496460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1586/3157] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:25:58.500796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:58.537082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f3e7-85c8-4e4d-aa07-d9733584a712 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:58.558408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:58.559084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.559367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.559666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.560339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.563229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675352-5236-4a4b-8d7f-5e561a7bdbdf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.598369 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1572/3158] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:25:58.602738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:58.619068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96059dd1-2e42-42e1-9ee3-10fd99a76819 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:58.636832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:58.643781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.645083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.647053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] PATH_INFO: `/v3/projects/ffd5def11d06401f8ae3f888feef9911/users/2687757636dc426f875367077faf9f19/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.688003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd5def11d06401f8ae3f888feef9911, user_id=2687757636dc426f875367077faf9f19, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:58.691577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:58.771740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1587/3159] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:25:58 2022] PUT /identity/v3/projects/ffd5def11d06401f8ae3f888feef9911/users/2687757636dc426f875367077faf9f19/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:58.773612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa693-931e-409b-9564-5e9c5a0684d8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:58.773902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa693-931e-409b-9564-5e9c5a0684d8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:58.774179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa693-931e-409b-9564-5e9c5a0684d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:58.838708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ddfaa693-931e-409b-9564-5e9c5a0684d8 None None] MFA Rules not processed for user `2687757636dc426f875367077faf9f19`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:58.845436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ddfaa693-931e-409b-9564-5e9c5a0684d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:59.009357 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1573/3160] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:59.042179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:59.131826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:25:59.167351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3a5a-9509-4262-8d8f-a8d610efda61 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:25:59.178473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:25:59.179258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:59.182411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:59.182872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] PATH_INFO: `/v3/users/2687757636dc426f875367077faf9f19` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:59.184589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2687757636dc426f875367077faf9f19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:25:59.188509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:25:59.448042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2687757636dc426f875367077faf9f19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:59.448042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2687757636dc426f875367077faf9f19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:59.537601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2687757636dc426f875367077faf9f19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:59.569310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2687757636dc426f875367077faf9f19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:59.570144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2687757636dc426f875367077faf9f19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:25:59.605520 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1588/3161] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:25:59 2022] DELETE /identity/v3/users/2687757636dc426f875367077faf9f19 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:25:59.611197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:25:59.611586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:25:59.611867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:25:59.696280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:25:59.700884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:25:59.844117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1574/3162] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:25:59.960832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:25:59.962795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:00.128011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b99f-ea09-478a-9016-49de648a8489 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:00.132996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:00.133627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:00.133904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:00.134173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:00.171853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:00.187391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320572f4-6864-4d03-be74-5dc10026fb7f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:00.225335 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1589/3163] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:01.965468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:01.967045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:01.984089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4da42-ba6e-4f7a-86fc-b34266c9a40b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:02.002156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:02.002855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:02.003136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:02.003409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] PATH_INFO: `/v3/projects/ffd5def11d06401f8ae3f888feef9911` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:02.004703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd5def11d06401f8ae3f888feef9911)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:02.022281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:02.126774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:02.265514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd5def11d06401f8ae3f888feef9911', 'request_id': 'req-8ac93bd6-50cf-4df5-a676-681707a9782a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:02.369496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd5def11d06401f8ae3f888feef9911', 'request_id': 'req-8ac93bd6-50cf-4df5-a676-681707a9782a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:02.379236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd5def11d06401f8ae3f888feef9911', 'request_id': 'req-8ac93bd6-50cf-4df5-a676-681707a9782a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:02.415691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] The token cache is being invalidate because project ffd5def11d06401f8ae3f888feef9911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:02.419386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:02.419386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8ac93bd6-50cf-4df5-a676-681707a9782a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:02.420875 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1575/3164] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:01 2022] DELETE /identity/v3/projects/ffd5def11d06401f8ae3f888feef9911 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:02.425491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:02.426027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:02.426027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:02.503771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:02.505241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:02.637107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1590/3165] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:02.647465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:02.647909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:02.648330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:02.682260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:02.683039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:02.703543 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1576/3166] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:02.707923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:02.726176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11dc61-1dfa-4338-b310-d4b82e9eaeb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:02.749792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:02.751141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:02.751141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:02.751284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:02.751873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:02.752180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:02.753807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:02.755572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:02.779914 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1591/3167] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:02.784199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:02.797765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:02.798727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104d49-f5c8-4559-b032-991665f3ff60 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:02.802037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:02.810421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:02.813920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:02.814396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:02.815144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:02.816056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:02.819862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.005156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1577/3168] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:02 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:03.010732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:03.101503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c052-44a8-48af-bb29-9aa0c06af725 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.258876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a547b-2ca4-4ff5-b335-9204c92325f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.268061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.268798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.269116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.269340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.275041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:03.285609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.287331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.288041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.288448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.289244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.292576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.297325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.300114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.325305 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1592/3169] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:03.328187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:03.339710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:03.375533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83d16-8feb-4127-a3b5-556cdb521803 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.385672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.397721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.399314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.400258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] PATH_INFO: `/v3/users/1bf9e8a3a122438c95ca0705008a816c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.409394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1578/3170] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:03 2022] POST /identity/v3/users => generated 281 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:03.411641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf9e8a3a122438c95ca0705008a816c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.416361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:03.421659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.484472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ca1c8-e464-4b49-8195-a9aa7ac5013a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.495578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.496560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.497047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.497495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.498298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.500546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.515242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1579/3171] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:03.519897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:03.537162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b54aa6-360c-414d-a834-9feae8cfa520 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.544763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.545352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.545681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.546525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.547875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.550663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.570691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1580/3172] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:03.574665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:03.600609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d99c-88d9-40e2-b5c0-f8dff0f0fe07 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:03.616104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:03.617176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.617689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.618599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] PATH_INFO: `/v3/projects/60fe1f4e4d784f9b9ace066861b72dec/users/41a310afce70406682173eb169e062bd/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.679418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fe1f4e4d784f9b9ace066861b72dec, user_id=41a310afce70406682173eb169e062bd, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:03.688355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb248c-f5e1-4fd4-b7b9-a81c450b0c08 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:03.712137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf9e8a3a122438c95ca0705008a816c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:03.714444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf9e8a3a122438c95ca0705008a816c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:03.832651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf9e8a3a122438c95ca0705008a816c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:03.847470 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1581/3173] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:03 2022] PUT /identity/v3/projects/60fe1f4e4d784f9b9ace066861b72dec/users/41a310afce70406682173eb169e062bd/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:26:03.852299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf9e8a3a122438c95ca0705008a816c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:03.853243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf9e8a3a122438c95ca0705008a816c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:03.861923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:03.864108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:03.864470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:03.901003 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1593/3174] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:03 2022] DELETE /identity/v3/users/1bf9e8a3a122438c95ca0705008a816c => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:03.919636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] MFA Rules not processed for user `41a310afce70406682173eb169e062bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:03.921573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:03.942806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:04.008698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1582/3175] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:04.086569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:04.105192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:04.107724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:04.217337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b7b07-f419-4979-a747-74c2c52e7697 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:04.239595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:04.240287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:04.240569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:04.240844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:04.271389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:04.271389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d47d3b-0f52-4f9e-ac31-163fec71e4de service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:04.297330 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1594/3176] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:05.177050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:05.178498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:05.338480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f361-ebc9-4216-8a70-b11ef5a71802 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:05.345457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:05.347601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:05.348151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:05.348715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] PATH_INFO: `/v3/projects/f8329b7a996b44ac8064754f3d3228ec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:05.350927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8329b7a996b44ac8064754f3d3228ec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:05.353487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:05.514923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8329b7a996b44ac8064754f3d3228ec', 'request_id': 'req-a3228098-a923-43de-909c-b35353bfa23f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:05.628806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8329b7a996b44ac8064754f3d3228ec', 'request_id': 'req-a3228098-a923-43de-909c-b35353bfa23f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:05.646857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8329b7a996b44ac8064754f3d3228ec', 'request_id': 'req-a3228098-a923-43de-909c-b35353bfa23f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:05.673074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] The token cache is being invalidate because project f8329b7a996b44ac8064754f3d3228ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:05.673532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:05.674489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3228098-a923-43de-909c-b35353bfa23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:05.676878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1583/3177] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:05 2022] DELETE /identity/v3/projects/f8329b7a996b44ac8064754f3d3228ec => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:05.682177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:05.682921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:05.683215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:05.742882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:05.750335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:05.992873 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1595/3178] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:05.999317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:05.999881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.000402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.056493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:06.063083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:06.103896 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1584/3179] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:06.111479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.129065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ecde9-2e30-4452-924b-1ca6ad56cbb8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.146835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.147509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.147950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.148357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.149184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:06.149635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.151561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.179656 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1596/3180] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:06.185023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.196093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a409d-8f9d-4af6-8a9d-863db089375b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.205181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.206059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.206500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.206773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.207606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.211135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.348510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1585/3181] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:06 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:06.353060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.365262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6a65e-48a0-4673-b98b-d1d178646924 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.508922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.509538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.509821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.510100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.510770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.513259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.679028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.686272 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1597/3182] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:06 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:06.696070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6e0fa-3be9-4ff4-9776-27c61b8c7a44 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.703942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.704717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.705070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.705415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.706189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.708444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.729867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.740657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1586/3183] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:06.746930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fd393-7349-4ec4-a23f-eea5428e227c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.754029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.755097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.755527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.755979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.757679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.759652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc677e4-a0fe-4d34-afee-cd15d892e200 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.793221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:06.804161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1598/3184] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:06.810964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59949-7c78-49f9-9823-9a86b3aa93ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:06.817438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:06.818374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.818891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.819348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] PATH_INFO: `/v3/projects/712f361be07a4d97b5de472a451b24c1/users/bc7d6aaa7ee145c1ad8a4aa9c551832a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:06.839135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:06.849566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f361be07a4d97b5de472a451b24c1, user_id=bc7d6aaa7ee145c1ad8a4aa9c551832a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:06.852219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:06.959348 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1587/3185] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:06 2022] PUT /identity/v3/projects/712f361be07a4d97b5de472a451b24c1/users/bc7d6aaa7ee145c1ad8a4aa9c551832a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:06.972744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869c39-7203-4984-8ef6-06538ee39b3f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:06.973029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869c39-7203-4984-8ef6-06538ee39b3f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:06.973305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869c39-7203-4984-8ef6-06538ee39b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:07.001629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:07.042756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b869c39-7203-4984-8ef6-06538ee39b3f None None] MFA Rules not processed for user `bc7d6aaa7ee145c1ad8a4aa9c551832a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:07.044200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b869c39-7203-4984-8ef6-06538ee39b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:07.229697 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1599/3186] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:07.267839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:07.270254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:07.310119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:07.310742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:07.311086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:07.349010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:07.350288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:07.453034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590aeb-27bf-4c90-9c95-cda747bc0018 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:07.473895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:07.474845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:07.475294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:07.475757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:07.494068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:07.498649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:07.504933 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1600/3187] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:07.517473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1588/3188] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:07.548041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:07.550309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:07.770933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a8ad0-7029-4f0e-a2da-73e2f47bb1fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:07.787423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:07.788967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:07.792100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:07.792463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:07.814513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:07.819069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9b29b-5bbd-4976-937e-82f1a2e84bb4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:07.841201 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1601/3189] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:08.385741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:08.387589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:08.511604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c20e86-c9f0-44c4-ae96-e8d196cb7ef9 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:08.521325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:08.522368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:08.523315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:08.523808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] PATH_INFO: `/v3/users/cf9ce3308e0a48d9ad53674df0efed86` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:08.525083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9ce3308e0a48d9ad53674df0efed86)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:08.530724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:08.857684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9ce3308e0a48d9ad53674df0efed86'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:08.858457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9ce3308e0a48d9ad53674df0efed86'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:08.965421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9ce3308e0a48d9ad53674df0efed86'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:08.991856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:08.999697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9ce3308e0a48d9ad53674df0efed86'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:09.000539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9ce3308e0a48d9ad53674df0efed86'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:09.021792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:09.022319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:09.022319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:09.030767 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1589/3190] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:08 2022] DELETE /identity/v3/users/cf9ce3308e0a48d9ad53674df0efed86 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:09.072242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:09.076538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:09.137147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:09.238904 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1602/3191] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:09.275579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:09.280368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:09.462531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d032e11-13bd-4888-ae1d-e26b94b8eb29 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:09.471617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:09.472949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:09.475155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:09.475504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:09.487142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:09.488756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0a536-0e72-45e5-b091-125a0e02cfcc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:09.502289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1590/3192] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:10.575129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:10.577269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:10.598016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a8e6b-4f37-454c-b2cb-e7eb693dda5b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:10.612825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:10.614060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:10.614550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:10.615073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] PATH_INFO: `/v3/users/bc7d6aaa7ee145c1ad8a4aa9c551832a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:10.616436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7d6aaa7ee145c1ad8a4aa9c551832a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:10.618739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:10.873564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7d6aaa7ee145c1ad8a4aa9c551832a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:10.876560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7d6aaa7ee145c1ad8a4aa9c551832a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:10.980928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7d6aaa7ee145c1ad8a4aa9c551832a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:10.999262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7d6aaa7ee145c1ad8a4aa9c551832a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.002324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7d6aaa7ee145c1ad8a4aa9c551832a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.038654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1603/3193] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:10 2022] DELETE /identity/v3/users/bc7d6aaa7ee145c1ad8a4aa9c551832a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:11.040280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.040736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.041081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.078425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:11.084139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.141742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:11.143226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.229374 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1591/3194] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:11.269955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920d338-3309-4d29-9ef8-074d2154823b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:11.276027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:11.277155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.277599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.278288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] PATH_INFO: `/v3/projects/53ea67e3be6e46b081ed8d7f34d6d4d4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.280628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ea67e3be6e46b081ed8d7f34d6d4d4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:11.281963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:11.307306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:11.309720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.431866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffda06-58dd-4ecb-8646-7a65ef548ce0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:11.443091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:11.469436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ea67e3be6e46b081ed8d7f34d6d4d4', 'request_id': 'req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.543070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:11.549118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:11.550124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.550760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.551248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.578108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ea67e3be6e46b081ed8d7f34d6d4d4', 'request_id': 'req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.587661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ea67e3be6e46b081ed8d7f34d6d4d4', 'request_id': 'req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.615508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] The token cache is being invalidate because project 53ea67e3be6e46b081ed8d7f34d6d4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:11.615899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.616617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5bed0a5-e7bb-4976-8ea3-26952c8a14a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:11.623212 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1604/3195] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:11 2022] DELETE /identity/v3/projects/53ea67e3be6e46b081ed8d7f34d6d4d4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:26:11.624948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.625407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.625850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.643615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:11.648279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27e2d-a3ef-478c-8ff4-f9262bfe776c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:11.672183 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1592/3196] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:11.680818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:11.682796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.716649 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1605/3197] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:11.735511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.735811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.736209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.771289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:11.772504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.789677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:11.790505 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1593/3198] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:11.800593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cad89-6c3e-4fad-b278-cf93a36d0ceb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:11.806051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:11.806769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.807051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.807323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.807968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:11.808434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:11.810298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:11.825665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1606/3199] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:26:11.831829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:11.844930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2510f-ee4d-40a1-ad82-3b58473679b6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:11.851211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:11.852049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.852396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.852737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.853375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:11.855570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:11.865896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:11.867938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:11.905986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3145-4833-4d32-a0db-14c4dbc48c9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:11.920877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:11.923594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:11.924110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:11.924532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] PATH_INFO: `/v3/users/fe26fb07ae1043d883ac18853296764a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:11.926204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe26fb07ae1043d883ac18853296764a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:11.929083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:12.039281 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1594/3200] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:12.041735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:12.165526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe26fb07ae1043d883ac18853296764a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:12.167039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38311-d5e1-4627-8cba-6b26c4ea4a09 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:12.167468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe26fb07ae1043d883ac18853296764a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:12.173869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:12.174201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:12.174484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:12.176025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:12.177632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:12.182566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:12.252973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe26fb07ae1043d883ac18853296764a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:12.277884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe26fb07ae1043d883ac18853296764a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:12.279288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe26fb07ae1043d883ac18853296764a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:12.304923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1595/3201] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:12 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:12.308642 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1607/3202] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:11 2022] DELETE /identity/v3/users/fe26fb07ae1043d883ac18853296764a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:12.310914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:12.315149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:12.351363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6882c57-f403-4914-a5c7-37d8b621858f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:12.435822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:12.444339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:12.445327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:12.445867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:12.446374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:12.447598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:12.450697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:12.506205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1596/3203] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:12.509661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:12.524220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc528bc-4303-4657-9107-d0ffcde12572 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:12.532828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:12.534833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:12.536187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:12.539299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:12.540402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:12.545152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec201cb-e60d-4e5e-84dd-838e1e055dc1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:12.570100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1608/3204] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:12.575421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:12.589812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af320e2-17f8-4a84-913b-ea83e1f6da8f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:12.599355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:12.600278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:12.600722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:12.601001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] PATH_INFO: `/v3/projects/4529b4f769d441429232f1fcb31da4ae/users/3e535628dda941ba8fa2df9c86c5431b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:12.620870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4529b4f769d441429232f1fcb31da4ae, user_id=3e535628dda941ba8fa2df9c86c5431b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:12.623810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:12.714490 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1597/3205] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:12 2022] PUT /identity/v3/projects/4529b4f769d441429232f1fcb31da4ae/users/3e535628dda941ba8fa2df9c86c5431b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:12.728636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:12.729497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:12.730372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:12.795130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] MFA Rules not processed for user `3e535628dda941ba8fa2df9c86c5431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:12.796783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:12.887926 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1609/3206] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:12.915700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:12.917741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:13.047152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0b164-3c6c-4bcd-b3cb-02dbfb3f0031 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:13.072030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:13.072748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:13.073088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:13.073367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:13.093885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:13.095058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:13.118653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1598/3207] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:13.630104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:13.631743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:13.641413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:13.673790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:13.675286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:13.796762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa0286-0b7d-4001-b5ff-df2fcf97ed04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:13.804294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:13.805448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:13.805895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:13.806309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] PATH_INFO: `/v3/projects/712f361be07a4d97b5de472a451b24c1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:13.807664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712f361be07a4d97b5de472a451b24c1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:13.819961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:13.844666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aee68-d124-4ded-a826-582ad53f18bc service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:13.861876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:13.863083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:13.863083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:13.863300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] PATH_INFO: `/v3/projects/443ef5cf6a7d45f0b6321cecfad998d2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:13.872418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=443ef5cf6a7d45f0b6321cecfad998d2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:13.872418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:13.951969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712f361be07a4d97b5de472a451b24c1', 'request_id': 'req-201ed146-e451-4c40-b1e1-d62282f2c619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.066314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443ef5cf6a7d45f0b6321cecfad998d2', 'request_id': 'req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.075240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712f361be07a4d97b5de472a451b24c1', 'request_id': 'req-201ed146-e451-4c40-b1e1-d62282f2c619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.085246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712f361be07a4d97b5de472a451b24c1', 'request_id': 'req-201ed146-e451-4c40-b1e1-d62282f2c619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.107627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] The token cache is being invalidate because project 712f361be07a4d97b5de472a451b24c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:14.108212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.111367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-201ed146-e451-4c40-b1e1-d62282f2c619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.113950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1610/3208] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:13 2022] DELETE /identity/v3/projects/712f361be07a4d97b5de472a451b24c1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:14.119591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2378-dd8c-4341-a2c3-dac58392d230 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.120498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2378-dd8c-4341-a2c3-dac58392d230 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.120960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c2378-dd8c-4341-a2c3-dac58392d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.180001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be6c2378-dd8c-4341-a2c3-dac58392d230 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:14.181868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be6c2378-dd8c-4341-a2c3-dac58392d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.212027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443ef5cf6a7d45f0b6321cecfad998d2', 'request_id': 'req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.226002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443ef5cf6a7d45f0b6321cecfad998d2', 'request_id': 'req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.248954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] The token cache is being invalidate because project 443ef5cf6a7d45f0b6321cecfad998d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:14.248954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.251255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-373c6a8d-e59d-4566-b714-3d2dc3a0f14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:14.262533 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1599/3209] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:13 2022] DELETE /identity/v3/projects/443ef5cf6a7d45f0b6321cecfad998d2 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:26:14.264212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddd39-017f-4d37-b069-5feac2831945 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.264499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddd39-017f-4d37-b069-5feac2831945 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.264774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddd39-017f-4d37-b069-5feac2831945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.288689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:14.342388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e6ddd39-017f-4d37-b069-5feac2831945 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:14.352581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e6ddd39-017f-4d37-b069-5feac2831945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.441323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1611/3210] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:14.448780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.449302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.449768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.500947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1600/3211] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:14.508716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a4290-d5d0-4aeb-91d8-b13c0dfbf1fd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.509187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a4290-d5d0-4aeb-91d8-b13c0dfbf1fd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.509617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a4290-d5d0-4aeb-91d8-b13c0dfbf1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.517977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:14.521349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.550052 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1612/3212] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:14.551921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:14.575295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8790e8-3e15-420b-8845-e8e272b86611 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:14.577734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6b3a4290-d5d0-4aeb-91d8-b13c0dfbf1fd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:14.579031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6b3a4290-d5d0-4aeb-91d8-b13c0dfbf1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.586871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:14.587736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.588155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.591808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.592697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:14.594395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:14.604309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1601/3213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:14.605826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.606374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.606521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.608464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:14.640598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1613/3214] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:14.641715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:14.648379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:14.653550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.669134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365e43a-a287-494b-afbd-39ac0cd7fcd6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:14.711650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d431-c350-4545-acbe-45736805420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:14.715646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d431-c350-4545-acbe-45736805420e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.716139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d431-c350-4545-acbe-45736805420e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.719493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d431-c350-4545-acbe-45736805420e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.720388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d431-c350-4545-acbe-45736805420e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:14.722072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d431-c350-4545-acbe-45736805420e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:14.726807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d431-c350-4545-acbe-45736805420e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:14.744633 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1614/3215] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:14.745651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d431-c350-4545-acbe-45736805420e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:14.757352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d431-c350-4545-acbe-45736805420e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:14.765569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:14.766530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.767075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.767604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.768484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:14.770795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:14.796730 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1602/3216] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:14.803173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:14.816404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70044339-fd94-4416-9a76-7ff04ba1b7f2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:14.821507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:14.823055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:14.823516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:14.823931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:14.825453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:14.827711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:14.930845 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1615/3217] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:14.931263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:14.933174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:14.941527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1603/3218] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:14.942736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.045524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88f430-3a9c-4a6d-b2b3-8edaf4cc948c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.053376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.054457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.054945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.055092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa4afa-4c27-4626-a055-7d53dd05c14d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.055684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.056776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.060019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44c6db-4a98-47e0-880b-9a43fd362880 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.148683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d813c-867b-43c3-8254-2859e407672e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.149455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d813c-867b-43c3-8254-2859e407672e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.149720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d813c-867b-43c3-8254-2859e407672e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.149994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d813c-867b-43c3-8254-2859e407672e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.171983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1604/3219] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:14 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:15.173914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.174346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.176713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.237948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:15.239550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:15.308555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d813c-867b-43c3-8254-2859e407672e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.310608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d813c-867b-43c3-8254-2859e407672e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.321694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1616/3220] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:15.322348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d813c-867b-43c3-8254-2859e407672e service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.334529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d813c-867b-43c3-8254-2859e407672e service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.339649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.340871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.341216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.341613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.342326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.344283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.358911 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1605/3221] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:15.359907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.375758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312c4f5-e47a-4881-bf9c-413535b6ef5b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.381371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.382181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.382837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.382837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.383673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.385210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.397266 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1606/3222] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:15.402267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.416006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a279b-88ae-4b99-bd54-7bbf08586fed admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.422309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.423437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.423437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.423621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.436344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.439563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.453112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1617/3223] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:15 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:15.453112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.457174 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1607/3224] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:15.458349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.465728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ba1b4-fc8c-4531-a585-1a788583e6d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.476067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d23a-26b4-474b-afe1-5ffde7b64c26 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.482679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.483289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.483566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.483831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.484465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.486073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.504020 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1608/3225] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:15.505049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.513959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.515355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.517840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.519582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.524075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffd518-4fd8-411b-98ef-572c9ef8c4a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.524206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.531709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.565186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.567096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.569282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.570459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.573478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.576012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.594720 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1618/3226] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:15.595230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1609/3227] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:15.596757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.601958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:15.624632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d2f5-bd70-4adb-9c4f-a20662dc1609 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.645702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5583d8-97d3-4259-a96c-a7f4ccaa0d6b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:15.647939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.652881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.653419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.654398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:15.654919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] PATH_INFO: `/v3/projects/0a884faf44f643a8aad30311a24dbec0/users/665c53f7214245a083bcabeb29eaa8e0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.664963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.665978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.666429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] PATH_INFO: `/v3/projects/03151c271b6146db9209e77400373d00/users/e6d7be3d9d524d0aa383ff1b36d9e695/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.695688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03151c271b6146db9209e77400373d00, user_id=e6d7be3d9d524d0aa383ff1b36d9e695, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.700147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d70e8-d82a-43fc-a91e-294f15307f4d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.736409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a884faf44f643a8aad30311a24dbec0, user_id=665c53f7214245a083bcabeb29eaa8e0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:15.740693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaaaf1-6be5-402b-a54d-3a5a93e49150 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:15.789444 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1610/3228] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:15 2022] PUT /identity/v3/projects/03151c271b6146db9209e77400373d00/users/e6d7be3d9d524d0aa383ff1b36d9e695/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:15.801134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.801424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.801805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.872922 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1619/3229] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:15 2022] PUT /identity/v3/projects/0a884faf44f643a8aad30311a24dbec0/users/665c53f7214245a083bcabeb29eaa8e0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:15.875585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:15.875867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:15.876206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:15.892897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:15.904537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] MFA Rules not processed for user `e6d7be3d9d524d0aa383ff1b36d9e695`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:15.908251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:15.946344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:15.951682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:16.151237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1620/3230] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:16.151237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:16.171427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1611/3231] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:16.183002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:16.213999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:16.216337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:16.220048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34caa5a-1ffd-4f27-bbc4-1fb6b85dfe49 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:16.226772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:16.239205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:16.239739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:16.240066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:16.242435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] PATH_INFO: `/v3/users/f39fdca40d9b4035a56b79e13b375b4f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:16.246061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39fdca40d9b4035a56b79e13b375b4f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:16.253073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:16.417166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a288d15-d943-4bd5-8490-d70cd3d502d4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:16.435175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:16.435895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:16.437448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:16.437953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:16.454603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:16.456906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:16.476424 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1612/3232] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:16.479186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:16.481627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:16.638023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39fdca40d9b4035a56b79e13b375b4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:16.639094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf798c-e323-4eac-889b-acb78b38dd17 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:16.640095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39fdca40d9b4035a56b79e13b375b4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:16.650369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:16.651059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:16.651333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:16.651602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:16.653955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:16.666250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:16.668193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:16.687210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1613/3233] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:16.763816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39fdca40d9b4035a56b79e13b375b4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:16.811609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39fdca40d9b4035a56b79e13b375b4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:16.824589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3de533cd-3b64-4e54-8aed-5fb03c433de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39fdca40d9b4035a56b79e13b375b4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:16.846568 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1621/3234] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:16 2022] DELETE /identity/v3/users/f39fdca40d9b4035a56b79e13b375b4f => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:17.456082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:17.463691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:17.532989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35221ec5-906d-4e85-b95e-7602c9c9b8c1 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:17.642097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:17.643219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:17.650882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:17.651349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] PATH_INFO: `/v3/projects/23c727ce3707474d9cd8cbcd2d854526` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:17.652896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c727ce3707474d9cd8cbcd2d854526)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:17.664087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:17.918958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:17.918958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:17.918958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:17.945835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c727ce3707474d9cd8cbcd2d854526', 'request_id': 'req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.046674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:18.051221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:18.153069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c727ce3707474d9cd8cbcd2d854526', 'request_id': 'req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.161784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c727ce3707474d9cd8cbcd2d854526', 'request_id': 'req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.218229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] The token cache is being invalidate because project 23c727ce3707474d9cd8cbcd2d854526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:18.218528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.225029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.230310 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1614/3235] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:17 2022] DELETE /identity/v3/projects/23c727ce3707474d9cd8cbcd2d854526 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:18.239210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:18.247275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:18.352614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:18.389469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1622/3236] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 14:26:18.404564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:18.409008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:18.480236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f47e2-75bd-42c4-ad7f-2eb5bbb50191 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:18.488091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:18.488912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:18.489339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:18.489790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] PATH_INFO: `/v3/users/e6d7be3d9d524d0aa383ff1b36d9e695` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:18.491310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d7be3d9d524d0aa383ff1b36d9e695)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:18.493743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:18.581489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79026f-0282-4fae-accf-73b9684e1ce6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:18.587162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:18.588184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:18.588651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:18.589102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] PATH_INFO: `/v3/users/af9f49caadab4b9fb768056518420524` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:18.590882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9f49caadab4b9fb768056518420524)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:18.593087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:18.732572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:18.753412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d7be3d9d524d0aa383ff1b36d9e695'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.755241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d7be3d9d524d0aa383ff1b36d9e695'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.812043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9f49caadab4b9fb768056518420524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.813472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9f49caadab4b9fb768056518420524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.858060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d7be3d9d524d0aa383ff1b36d9e695'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.878200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d7be3d9d524d0aa383ff1b36d9e695'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.879578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d7be3d9d524d0aa383ff1b36d9e695'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:18.912113 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1615/3237] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:18 2022] DELETE /identity/v3/users/e6d7be3d9d524d0aa383ff1b36d9e695 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:18.914114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:18.915877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:18.974897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9f49caadab4b9fb768056518420524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:19.019811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f92c-7742-4814-8bf5-2e13ddc8226f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:19.020339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9f49caadab4b9fb768056518420524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:19.025649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87e71e1f-ccfb-4361-8f9c-0b87e88d7403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9f49caadab4b9fb768056518420524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:19.027885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:19.029053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:19.029876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:19.030350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:19.034841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:19.093777 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1623/3238] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:18 2022] DELETE /identity/v3/users/af9f49caadab4b9fb768056518420524 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:19.099512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:19.102872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:19.104456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:19.114197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:19.116050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:19.133845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1616/3239] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:19.237131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:19.237131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:19.396311 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1624/3240] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:19.447271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:19.449022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:19.634226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cd51f-49c8-46ef-8fd8-6e6bcec14081 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:19.817237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:19.842434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:19.847166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:19.847453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:19.850122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:19.877706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:19.881381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:19.937720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1617/3241] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:19.949929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:19.952662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:19.992189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952141b-ed1a-4228-894c-c3436d75f7ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:19.997391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeff500-7b44-4d90-a499-0804c96adc72 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:20.003066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:20.005130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.006225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.007251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.013533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:20.014852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:20.015632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.017447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.017876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] PATH_INFO: `/v3/projects/952f3ce772294049a0b616569a41a49e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.019911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=952f3ce772294049a0b616569a41a49e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:20.026719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:20.053027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:20.059588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dcacb-7c7f-4a98-888d-a420641b18c5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:20.109109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1625/3242] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:26:20.247780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952f3ce772294049a0b616569a41a49e', 'request_id': 'req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:20.387625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952f3ce772294049a0b616569a41a49e', 'request_id': 'req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:20.395844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:20.402185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952f3ce772294049a0b616569a41a49e', 'request_id': 'req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:20.429505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] The token cache is being invalidate because project 952f3ce772294049a0b616569a41a49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:20.430158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:20.431864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ef0d1344-3362-4d3c-b29b-42029fd3d5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:20.437943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1618/3243] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:19 2022] DELETE /identity/v3/projects/952f3ce772294049a0b616569a41a49e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:20.444455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.445153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.445504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.487336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:20.488474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:20.649234 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1626/3244] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:20.657815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.658308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.658388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.694215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:20.695497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:20.723966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1619/3245] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:20.724086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:20.744735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863491e-366c-457b-a0ef-446a6962a182 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:20.756323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:20.757236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.758172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.760796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.768986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:20.769300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:20.773937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:20.781642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:20.800587 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1627/3246] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:20.804801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:20.816299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba46f4-d6c2-423c-bcfc-ae491bc57c10 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:20.828106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:20.830429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:20.831764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:20.832189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:20.834951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:20.837232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:20.992150 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1620/3247] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:20 2022] POST /identity/v3/projects => generated 395 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:20.992471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:21.014421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971305-e9c5-4001-9077-cde0cfede7ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:21.115785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:21.134153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.134153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.134153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.135505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:21.147004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:21.275329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1628/3248] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:20 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:26:21.279337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:21.304031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51f909-b5b4-4719-8443-5531536295f0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:21.318964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:21.319625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.320576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.320576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.325810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:21.325810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:21.348983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1621/3249] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:21.350227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:21.367671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ed651-2498-4104-95a9-29160e65f8da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:21.386666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:21.387785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.391672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.391672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.391672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:21.392972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85ac91-9a9e-4f40-bba3-7c6dcae00e33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:21.409398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1629/3250] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:21.413561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:21.431413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ace6d1-3b0f-42fa-984d-c750ca3b0ca4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:21.443514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:21.444344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.449097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.449097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] PATH_INFO: `/v3/projects/06b464a61277413b8a6f59597af7c87d/users/d7b869c5501946389a06c3bc8ca2eb59/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.484596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b464a61277413b8a6f59597af7c87d, user_id=d7b869c5501946389a06c3bc8ca2eb59, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:21.487407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eea44-7b67-4d8c-a3ca-19c990d385f5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:21.574967 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1622/3251] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:21 2022] PUT /identity/v3/projects/06b464a61277413b8a6f59597af7c87d/users/d7b869c5501946389a06c3bc8ca2eb59/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:21.585577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.585869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.586140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.628505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] MFA Rules not processed for user `d7b869c5501946389a06c3bc8ca2eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:21.631581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:21.703880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:21.704411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:21.704708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:21.795733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:21.801082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:21.832608 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1630/3252] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:21.832608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:22.026145 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1623/3253] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:22.036170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cdcd-a38a-4646-a800-21395851c745 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:22.040234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:22.041350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:22.059868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:22.061470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.062951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.064464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:22.065150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:22.074100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:22.241344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04abbe-ed68-44b4-9498-a3fd9d7a1b57 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:22.254008 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1631/3254] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:21 2022] POST /identity/v3/projects => generated 395 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:26:22.254008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:22.254891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:22.414118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:22.415594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.416345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.416840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:22.441331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b6dd-b487-4ebe-93bc-748472bfacdf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:22.459284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:22.460102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.460505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.460901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] PATH_INFO: `/v3/projects/03151c271b6146db9209e77400373d00` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:22.464067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03151c271b6146db9209e77400373d00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:22.466201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:22.529505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:22.644748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:22.646435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:22.648408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03151c271b6146db9209e77400373d00', 'request_id': 'req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:22.688475 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1624/3255] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:26:22.709427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:22.748533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d584-d50f-457b-b5ae-8c79491fbdbe service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:22.768955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03151c271b6146db9209e77400373d00', 'request_id': 'req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:22.776017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03151c271b6146db9209e77400373d00', 'request_id': 'req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:22.797762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:22.802183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] The token cache is being invalidate because project 03151c271b6146db9209e77400373d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:22.802483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:22.806095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19d9a524-278c-4d4a-b6d7-e24be57a0bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:22.813686 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1632/3256] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:22 2022] DELETE /identity/v3/projects/03151c271b6146db9209e77400373d00 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:22.815176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9806-f95a-41ea-a755-3227740a1e9e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.815463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9806-f95a-41ea-a755-3227740a1e9e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.815739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9806-f95a-41ea-a755-3227740a1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:22.898731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:22.901360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.901796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.902377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:22.904339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:22.906457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:22.925222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11cb9806-f95a-41ea-a755-3227740a1e9e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:22.931694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11cb9806-f95a-41ea-a755-3227740a1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:22.951866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1633/3257] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:22.970942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:22.971224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:22.971501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.013588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:23.013588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:23.044257 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1634/3258] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:23.045263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.051786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1625/3259] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:22 2022] POST /identity/v3/users => generated 304 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:23.063161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead6b13-c3be-4c7f-8a20-d4e918ec4679 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.065296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.067397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:23.071869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.073926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.074797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.075674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.076383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:23.077038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.078341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.091778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b806-da3b-4d9c-b6d9-8a712903b736 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.112241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1635/3260] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:23.113245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.161126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.162063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.162525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.163278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.164136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.166043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.190506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881804e-c827-4151-886b-fca78f5741f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.200306 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1626/3261] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:23.206008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.208398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.209025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.209301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.209571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.210200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.215552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.222742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea535-687c-4c00-85bc-72545b871076 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.235509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.236187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.236460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.236730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] PATH_INFO: `/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f/users/d88086012ecb449abc86d8d8373f4cb8/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.263201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc81a15fcd448ed9a5b8ba367bfc89f, user_id=d88086012ecb449abc86d8d8373f4cb8, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.266497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.388287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1636/3262] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:23 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:23.393194 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1627/3263] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:23 2022] PUT /identity/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f/users/d88086012ecb449abc86d8d8373f4cb8/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:23.405083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.406628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.617852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b2327-861e-45cc-8b70-314273c47363 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.647156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.647707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.648085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.648476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.649253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.661976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c76b3-2c9c-47ca-81ed-c7e9e92c077f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.663728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.669268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.670005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.670525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.675694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.675694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.675694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356ae1f-7258-4fad-87a9-f063da6f9769 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.695545 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1628/3264] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:23.699959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f84be-ff33-4361-b055-59259519198a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.700254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f84be-ff33-4361-b055-59259519198a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.700527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f84be-ff33-4361-b055-59259519198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.753043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6d9f84be-ff33-4361-b055-59259519198a None None] MFA Rules not processed for user `3e535628dda941ba8fa2df9c86c5431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:23.756524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d9f84be-ff33-4361-b055-59259519198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:23.816086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1637/3265] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:23 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:23.817624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.850207 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1629/3266] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:23.851486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f84be-ff33-4361-b055-59259519198a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.852090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485748-27b7-4dda-8ef6-51829a97bf41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.862875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.865138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.865138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.865138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] PATH_INFO: `/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f/users/d88086012ecb449abc86d8d8373f4cb8/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.867699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f84be-ff33-4361-b055-59259519198a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:23.871478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc81a15fcd448ed9a5b8ba367bfc89f, user_id=d88086012ecb449abc86d8d8373f4cb8, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.874754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.880468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:23.881101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.883696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.883998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:23.887815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:23.891894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fd270-fb3d-4745-9af6-4da5dafcfc23 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:23.908798 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1638/3267] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:23 2022] PUT /identity/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f/users/d88086012ecb449abc86d8d8373f4cb8/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:23.914645 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1630/3268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:23.919246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:23.922953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a534-1afa-4909-b5cd-890ca11d9b8a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:23.926944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a534-1afa-4909-b5cd-890ca11d9b8a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:23.926944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a534-1afa-4909-b5cd-890ca11d9b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.015485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-50f9a534-1afa-4909-b5cd-890ca11d9b8a None None] MFA Rules not processed for user `d88086012ecb449abc86d8d8373f4cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:24.017125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50f9a534-1afa-4909-b5cd-890ca11d9b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:24.138095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a057-fc9b-4805-adeb-3dfac18089ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:24.150690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:24.151381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:24.151654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:24.152725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.153989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:24.158353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:24.182935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1639/3269] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:24.187048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:24.205410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e1caa-9375-4fc8-ab2b-77ac5a4a3293 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:24.216959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:24.217877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:24.218407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:24.219062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] PATH_INFO: `/v3/projects/21b614b69d304e97a883e7f129c4fdf5/users/3d9e7d2fe2d04a438af7951167395848/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.260603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1631/3270] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:24.260803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b614b69d304e97a883e7f129c4fdf5, user_id=3d9e7d2fe2d04a438af7951167395848, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:24.261168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:24.264332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebba-6f99-4ebd-be91-db98f3bc3dbf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:24.264617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebba-6f99-4ebd-be91-db98f3bc3dbf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:24.264879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebba-6f99-4ebd-be91-db98f3bc3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.293443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:24.334053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-aef9ebba-6f99-4ebd-be91-db98f3bc3dbf None None] MFA Rules not processed for user `d7b869c5501946389a06c3bc8ca2eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:24.334053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aef9ebba-6f99-4ebd-be91-db98f3bc3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:24.370395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:24.425639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1632/3271] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:24.473382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1640/3272] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:24 2022] PUT /identity/v3/projects/21b614b69d304e97a883e7f129c4fdf5/users/3d9e7d2fe2d04a438af7951167395848/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:24.484494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccbdf-e7f1-4587-a1b7-75f5ff2e6be9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:24.484940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccbdf-e7f1-4587-a1b7-75f5ff2e6be9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:24.485318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccbdf-e7f1-4587-a1b7-75f5ff2e6be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.532174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-84cccbdf-e7f1-4587-a1b7-75f5ff2e6be9 None None] MFA Rules not processed for user `3d9e7d2fe2d04a438af7951167395848`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:24.538510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-84cccbdf-e7f1-4587-a1b7-75f5ff2e6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:24.644248 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1633/3273] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:24.758829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:24.761382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:24.891559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555ac15-7483-4bdc-9068-ed0ba200ac30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:24.899319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:24.900222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:24.900832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:24.901301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:24.904907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:25.015229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:25.018048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:25.047160 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1641/3274] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:26:25.346348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:25.604214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cce1c-4c19-4809-8d79-8d8ac9c842ef None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:25.604214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cce1c-4c19-4809-8d79-8d8ac9c842ef None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:25.604214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cce1c-4c19-4809-8d79-8d8ac9c842ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:25.671833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-293cce1c-4c19-4809-8d79-8d8ac9c842ef None None] MFA Rules not processed for user `3e535628dda941ba8fa2df9c86c5431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:25.674402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-293cce1c-4c19-4809-8d79-8d8ac9c842ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:25.736538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:25.737967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:25.780187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cadb-d4c5-4a06-b907-f4032724fcfb service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:25.784545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:25.804128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:25.804769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:25.805055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:25.805333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:25.833281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:25.834930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:25.900407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1642/3275] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:25.913108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1634/3276] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:26.048283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:26.207489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80205897-a94b-44fe-b1b1-d23ffc1642bb service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:26.219556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:26.220510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:26.232358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:26.232977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] PATH_INFO: `/v3/users/3d9e7d2fe2d04a438af7951167395848` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:26.234583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9e7d2fe2d04a438af7951167395848)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:26.239653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:26.568504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9e7d2fe2d04a438af7951167395848'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:26.574190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9e7d2fe2d04a438af7951167395848'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:26.657391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9e7d2fe2d04a438af7951167395848'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:26.694308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9e7d2fe2d04a438af7951167395848'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:26.695093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9e7d2fe2d04a438af7951167395848'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:26.742277 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1643/3277] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:26 2022] DELETE /identity/v3/users/3d9e7d2fe2d04a438af7951167395848 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:26.744964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:26.746497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a258cb-6705-417d-bff1-ca7d0b038910 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:26.746913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a258cb-6705-417d-bff1-ca7d0b038910 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:26.747194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a258cb-6705-417d-bff1-ca7d0b038910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:26.794995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:26.813506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-76a258cb-6705-417d-bff1-ca7d0b038910 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:26.816709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76a258cb-6705-417d-bff1-ca7d0b038910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:27.023338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1635/3278] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:27.045224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:27.046758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:27.232835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ecd-6cc2-42e3-80cc-7f9f41f729f5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:27.232835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ecd-6cc2-42e3-80cc-7f9f41f729f5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:27.233197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85ecd-6cc2-42e3-80cc-7f9f41f729f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:27.240808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7434f-0f23-4905-a9f8-30cf4935280d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:27.265181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:27.265181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:27.265181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:27.265181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:27.289382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bbf85ecd-6cc2-42e3-80cc-7f9f41f729f5 None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:27.297287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:27.304326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:27.308040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bbf85ecd-6cc2-42e3-80cc-7f9f41f729f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:27.355326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1644/3279] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:27.479765 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1636/3280] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:27.817166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.514748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.578127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:28.903168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:28.904643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:28.929280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4cafa-1e93-4ecf-9a5f-59b4d15976e4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:28.949832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:28.950495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:28.951319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:28.951319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] PATH_INFO: `/v3/projects/21b614b69d304e97a883e7f129c4fdf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:28.953268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b614b69d304e97a883e7f129c4fdf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:28.956988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:29.144801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b614b69d304e97a883e7f129c4fdf5', 'request_id': 'req-018290c6-7eb3-4a1b-a07c-24f57266336e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:29.211849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b614b69d304e97a883e7f129c4fdf5', 'request_id': 'req-018290c6-7eb3-4a1b-a07c-24f57266336e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:29.235414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b614b69d304e97a883e7f129c4fdf5', 'request_id': 'req-018290c6-7eb3-4a1b-a07c-24f57266336e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:29.256255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] The token cache is being invalidate because project 21b614b69d304e97a883e7f129c4fdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:29.256793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:29.270425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018290c6-7eb3-4a1b-a07c-24f57266336e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:29.274799 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1645/3281] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:28 2022] DELETE /identity/v3/projects/21b614b69d304e97a883e7f129c4fdf5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:29.281113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:29.281758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:29.281838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:29.318410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:29.319902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:29.419799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1637/3282] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:29.428662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:29.428953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:29.432545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:29.475281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:29.476533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:29.503187 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1646/3283] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:29.508802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:29.534726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68705b-7c93-4ecf-85f3-d4b7a94b4c93 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:29.553305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:29.554935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:29.555264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:29.555534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:29.556455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:29.556970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:29.559804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:29.617228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1638/3284] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:29.617533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:29.633017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb7582-daf9-4d2d-a029-763531ea0347 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:29.647134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:29.647753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:29.648034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:29.648304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:29.648949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:29.650891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:29.809444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1647/3285] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:29 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:26:29.810713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:29.826323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744334a-e6bc-4108-be3e-bb27f36d9448 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:30.123266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:30.123266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:30.123266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:30.123266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:30.124221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:30.124221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:30.140828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1639/3286] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:29 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:30.146607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:30.152657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:30.173304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e802b-6c0d-405a-b75d-9864da15a76f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:30.198967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:30.199823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:30.200293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:30.200738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:30.201587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:30.209002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:30.257207 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1648/3287] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:30.258755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:30.338923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b561c-c8bf-40a2-a1bb-a83b78f2a999 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:30.406896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:30.411138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:30.412469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:30.413100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:30.420741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:30.437517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90239-e13d-4776-9f05-79e22cc96b05 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:30.470225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1640/3288] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:30.476366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:30.490838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47a9cd-c470-41c7-bac2-bbed6fb68302 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:30.514505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:30.515316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:30.515853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:30.516666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] PATH_INFO: `/v3/projects/28495c5366504111828a1c39aa5f3d5d/users/d7b9ed48b78643f9bd8486cfaf6e2552/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:30.571551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28495c5366504111828a1c39aa5f3d5d, user_id=d7b9ed48b78643f9bd8486cfaf6e2552, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:30.588510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf54e2-6589-42da-9b56-38918b271900 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:30.704949 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1649/3289] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:30 2022] PUT /identity/v3/projects/28495c5366504111828a1c39aa5f3d5d/users/d7b9ed48b78643f9bd8486cfaf6e2552/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:26:30.712459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:30.712744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:30.715159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:30.822949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] MFA Rules not processed for user `d7b9ed48b78643f9bd8486cfaf6e2552`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:30.826314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:30.893975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:31.014425 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1641/3290] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:31.025312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c3e7-81b4-42ee-9903-91bedb7f8058 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:31.025851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c3e7-81b4-42ee-9903-91bedb7f8058 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:31.026282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c3e7-81b4-42ee-9903-91bedb7f8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:31.062697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1b93c3e7-81b4-42ee-9903-91bedb7f8058 None None] MFA Rules not processed for user `d7b9ed48b78643f9bd8486cfaf6e2552`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:31.063881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b93c3e7-81b4-42ee-9903-91bedb7f8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:31.114226 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1650/3291] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:31.190606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:31.193967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:31.357147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723d3cc-4901-4ef5-ba92-cd192baa114d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:31.393078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:31.404275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:31.415730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:31.415730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:31.458498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:31.461254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d88dc-e816-4b9f-ac53-be2d1336a68a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:31.492192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1642/3292] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:39.909268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:39.909790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:39.909790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:39.967665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:39.969458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:40.091969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1651/3293] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:40.103209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:40.103919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:40.104199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:40.148107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:40.149379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:40.175664 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1643/3294] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:40.183693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:40.185758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:40.208302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c967fd-90c9-4148-83b2-7621170b9f35 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:40.218501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:40.222120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:40.222400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:40.222735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:40.235114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:40.238394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4010d4c-8468-4cba-a56f-36c18c788aa2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:40.249598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1652/3295] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:44.193067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:44.200981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:44.351744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01be9d-a1fd-4d16-988c-0dbbe02072de None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:44.359052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:44.363285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:44.364818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:44.367809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] PATH_INFO: `/v3/users/f7bc608b554e4c6b94ec547f4e6c1d20` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:44.369411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bc608b554e4c6b94ec547f4e6c1d20)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:44.372126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:44.645654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bc608b554e4c6b94ec547f4e6c1d20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:44.647578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bc608b554e4c6b94ec547f4e6c1d20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:44.657702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:44.747136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:44.747661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:44.747661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:44.759705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bc608b554e4c6b94ec547f4e6c1d20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:44.782367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bc608b554e4c6b94ec547f4e6c1d20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:44.797911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bc608b554e4c6b94ec547f4e6c1d20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:44.803116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:44.804348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:44.817531 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1644/3296] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:44 2022] DELETE /identity/v3/users/f7bc608b554e4c6b94ec547f4e6c1d20 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:44.915874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:44.918428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:44.920388 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1653/3297] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:26:45.054213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ed2b6-829e-4292-a1a7-d1ab0e943b67 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:45.065003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:45.066227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:45.066975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:45.067415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:45.082910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:45.086984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:45.106883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1645/3298] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:26:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:26:45.707250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:45.707250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:45.712963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:45.848384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ad84-80dd-44a8-aa0c-520e5bb7d742 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:45.861003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:45.862016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:45.862508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:45.863013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] PATH_INFO: `/v3/projects/1b980a8f51d24a1a89adac420e257a14` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:45.864978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b980a8f51d24a1a89adac420e257a14)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:45.872461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:46.071667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b980a8f51d24a1a89adac420e257a14', 'request_id': 'req-13d01205-3387-4fab-a107-1df17ce2f64f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.168721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b980a8f51d24a1a89adac420e257a14', 'request_id': 'req-13d01205-3387-4fab-a107-1df17ce2f64f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.176967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b980a8f51d24a1a89adac420e257a14', 'request_id': 'req-13d01205-3387-4fab-a107-1df17ce2f64f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.194996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] The token cache is being invalidate because project 1b980a8f51d24a1a89adac420e257a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:46.195466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.196664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13d01205-3387-4fab-a107-1df17ce2f64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.202639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1654/3299] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:45 2022] DELETE /identity/v3/projects/1b980a8f51d24a1a89adac420e257a14 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:46.203153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:46.223470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e658feb-c5c3-44a8-9380-29ee250a0301 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:46.380210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:46.381696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:46.382159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:46.382669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] PATH_INFO: `/v3/users/fa59e5b84e75459cbccb8549e957fd6b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:46.384188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa59e5b84e75459cbccb8549e957fd6b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:46.387545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:46.621526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa59e5b84e75459cbccb8549e957fd6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.622997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa59e5b84e75459cbccb8549e957fd6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.722819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa59e5b84e75459cbccb8549e957fd6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.788433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa59e5b84e75459cbccb8549e957fd6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.788745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa59e5b84e75459cbccb8549e957fd6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:46.811668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1646/3300] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:46 2022] DELETE /identity/v3/users/fa59e5b84e75459cbccb8549e957fd6b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:46.926382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:46.977853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f826d1-0d18-4f41-aad6-3c69863e30cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:46.978686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f826d1-0d18-4f41-aad6-3c69863e30cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:46.979109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f826d1-0d18-4f41-aad6-3c69863e30cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.002802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6f826d1-0d18-4f41-aad6-3c69863e30cf None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:47.004124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6f826d1-0d18-4f41-aad6-3c69863e30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:47.086913 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1655/3301] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:47.102284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:47.104990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:47.213440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e326bf-49c4-4e05-8fa1-d3cf14ad8ac3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:47.218223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:47.218887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:47.219187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:47.219481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] PATH_INFO: `/v3/projects/55fd6b1466194635b1696e0935ae6709` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.220563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fd6b1466194635b1696e0935ae6709)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:47.222526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:47.412542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fd6b1466194635b1696e0935ae6709', 'request_id': 'req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:47.543426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fd6b1466194635b1696e0935ae6709', 'request_id': 'req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:47.562240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fd6b1466194635b1696e0935ae6709', 'request_id': 'req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:47.580567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] The token cache is being invalidate because project 55fd6b1466194635b1696e0935ae6709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:47.581186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:47.581949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d5fb1d-b4ab-4b60-a1c9-f5addb837e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:47.588338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1647/3302] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:47 2022] DELETE /identity/v3/projects/55fd6b1466194635b1696e0935ae6709 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:47.590101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:47.590389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:47.590699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.633231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:47.636372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:47.684060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:47.742581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1656/3303] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:47.756261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:47.756546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:47.756820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.812911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:47.814164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:47.838723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1648/3304] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:47.842769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:47.854059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e0968-62a2-4ad7-bb26-dfaa5bc29e14 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:47.862922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:47.863652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:47.864085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:47.864499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.865356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:47.865793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:47.868038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:47.882334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1657/3305] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:26:47.886812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:47.898454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0f3e-177e-4a36-8784-b4002f42cba8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:47.907070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:47.907874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:47.908294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:47.908662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:47.909452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:47.911913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:48.014763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:48.027934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1649/3306] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:47 2022] POST /identity/v3/projects => generated 411 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:48.028486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb6873-742f-4ed0-aea1-689a4c036903 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:48.102934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:48.103674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:48.104026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:48.105323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:48.106494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:48.109794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:48.228066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1658/3307] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:48 2022] POST /identity/v3/users => generated 306 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:26:48.232997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:48.255858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a99-e625-4bc5-9fea-ddfdef2f70c8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:48.265048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:48.266975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:48.270883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:48.271331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:48.272358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:48.274191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:48.292909 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1650/3308] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:48.297171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:48.312575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909efbb-e5c9-4053-b1ec-c7d84bb786e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:48.319711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:48.320593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:48.320973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:48.321348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:48.322074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:48.325915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b73ba-c40e-45f5-be17-cc57c36c928b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:48.353948 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1659/3309] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:48.357744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:48.380071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec865c2f-3fa4-4639-ad62-10d8740d48c5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:48.395784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:48.398564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:48.399618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:48.401249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] PATH_INFO: `/v3/projects/1ee8778614cd4adaa7b81f70aae9e40b/users/db9bc9656daf454ea9649a459d809d12/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:48.443717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee8778614cd4adaa7b81f70aae9e40b, user_id=db9bc9656daf454ea9649a459d809d12, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:48.446641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:48.561188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1651/3310] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:48 2022] PUT /identity/v3/projects/1ee8778614cd4adaa7b81f70aae9e40b/users/db9bc9656daf454ea9649a459d809d12/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:48.572269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:48.572984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:48.573998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:48.609940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:48.614731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:48.811792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1660/3311] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:48.821088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:48.822932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:49.056380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a57f6-71bd-4173-9bde-3c12cde25fa5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:49.066636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:49.067494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:49.070255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:49.070255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:49.082682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:49.084395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44555d73-36ad-4660-bb9c-9256b77e3b03 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:49.109415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1652/3312] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:49.120008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:52.540984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:52.544259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:52.561721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270bd48-0c68-40e7-b9d0-de82c66a5be8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:52.575988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:52.576859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:52.577447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:52.577829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] PATH_INFO: `/v3/users/d7b9ed48b78643f9bd8486cfaf6e2552` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:52.595633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b9ed48b78643f9bd8486cfaf6e2552)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:52.597657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:52.868370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:52.886469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b9ed48b78643f9bd8486cfaf6e2552'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:52.887135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b9ed48b78643f9bd8486cfaf6e2552'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:53.005552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b9ed48b78643f9bd8486cfaf6e2552'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:53.032020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b9ed48b78643f9bd8486cfaf6e2552'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:53.033037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b9ed48b78643f9bd8486cfaf6e2552'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:53.059509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1661/3313] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:26:52 2022] DELETE /identity/v3/users/d7b9ed48b78643f9bd8486cfaf6e2552 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:53.064221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:53.064723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:53.064816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:53.099644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:53.103102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:53.236060 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1653/3314] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:53.255282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:53.259186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:53.370952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834cce4-50c2-4b49-b8f9-b7135c7fd60e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:53.376177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:53.376966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:53.377418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:53.377831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:53.388909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:53.394867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a89fd-15fd-481a-b8e2-a38ed8c55aaf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:53.408476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1662/3315] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:55.091330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:55.097668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:55.137128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101253ae-f21c-445b-b0ef-6e32efea06bc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:55.145788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:55.148978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.150405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.152037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] PATH_INFO: `/v3/projects/28495c5366504111828a1c39aa5f3d5d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.156551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28495c5366504111828a1c39aa5f3d5d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:55.161403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:55.314464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28495c5366504111828a1c39aa5f3d5d', 'request_id': 'req-514fca71-978d-4b16-895f-3f933e416723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:55.398086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28495c5366504111828a1c39aa5f3d5d', 'request_id': 'req-514fca71-978d-4b16-895f-3f933e416723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:55.405167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28495c5366504111828a1c39aa5f3d5d', 'request_id': 'req-514fca71-978d-4b16-895f-3f933e416723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:55.436078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] The token cache is being invalidate because project 28495c5366504111828a1c39aa5f3d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:26:55.436460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:55.437293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-514fca71-978d-4b16-895f-3f933e416723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:26:55.439381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1654/3316] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:26:55 2022] DELETE /identity/v3/projects/28495c5366504111828a1c39aa5f3d5d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:55.444638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.445172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.445172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.478871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:55.481080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:55.559491 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1663/3317] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:55.568430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.569092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.569622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.595717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:55.597636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:55.609971 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1655/3318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:55.612121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:55.634348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38618-25f0-48d7-a5e3-ecf2df9a5604 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:55.641681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:55.647494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.647494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.647494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.647494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:26:55.647494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:55.648306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:55.663859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1664/3319] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:26:55.674672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:55.698794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef06d-fa00-4e2f-9406-69ef5ee6edc8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:55.711125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:55.712312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.712690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.713055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.714054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:55.716375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:55.812316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:55.820338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1656/3320] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:26:55 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:55.824511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:55.840278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fc4d-b2fd-4960-b06d-dc8460239fe3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:55.927912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:26:55.946534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:55.947450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:55.947752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:55.948531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:55.949181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:55.951350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:56.057935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1665/3321] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:26:55 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:26:56.062248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:56.074547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5c0a-9389-4ad4-a113-a6cfa56fe3eb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:56.079934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:56.082799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:56.082799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:56.082799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:56.082799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:56.083541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:56.096476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1657/3322] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:56.100806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:56.120174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91636-a59b-46f9-b600-c1a5bd37911a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:56.125394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:56.128707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:56.128707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:56.128707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:56.128707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:56.128993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ef22e-dc45-4e9b-87ab-a8569f145917 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:56.159392 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1666/3323] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:26:56.160660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:56.196251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab911f-78e5-445b-b32b-00da75a576ed admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:56.205699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:56.207315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:56.207825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:56.208301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] PATH_INFO: `/v3/projects/bb359fa533884c8d97c22f95474c8c27/users/7bda3ce741ee49598f84b5d82e25a822/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:56.228036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb359fa533884c8d97c22f95474c8c27, user_id=7bda3ce741ee49598f84b5d82e25a822, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:56.232307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:56.332106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1658/3324] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:26:56 2022] PUT /identity/v3/projects/bb359fa533884c8d97c22f95474c8c27/users/7bda3ce741ee49598f84b5d82e25a822/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:26:56.338187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120d28c-ee15-46d9-ad37-a8b72fcf9cac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:56.339036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120d28c-ee15-46d9-ad37-a8b72fcf9cac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:56.339313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120d28c-ee15-46d9-ad37-a8b72fcf9cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:56.370570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9120d28c-ee15-46d9-ad37-a8b72fcf9cac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:56.372047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9120d28c-ee15-46d9-ad37-a8b72fcf9cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:56.508003 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1667/3325] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:26:56.528939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:26:56.530710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:56.617789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34163f-fc62-43ba-a82a-c4863373be53 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:26:56.626242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:26:56.628127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:56.628617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:56.630844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:56.654836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:26:56.657572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:26:56.685498 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1659/3326] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:26:58.867895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251274-e178-4a03-bddd-4b91f3175111 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:26:58.868357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251274-e178-4a03-bddd-4b91f3175111 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:26:58.868473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251274-e178-4a03-bddd-4b91f3175111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:26:58.912946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54251274-e178-4a03-bddd-4b91f3175111 None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:26:58.917212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54251274-e178-4a03-bddd-4b91f3175111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:26:58.987485 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1668/3327] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:03.128075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:03.130432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:03.149133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050de7-87cd-4bed-92d6-f4159a88e31c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:03.164077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:03.168093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:03.168093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:03.168093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:03.173675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:03.391067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:03.393068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f3de4-8e81-4bb4-b3a8-97ccd5ac2a7c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:03.438698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1660/3328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:04.178424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:04.179487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:04.179921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:04.220877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] MFA Rules not processed for user `db9bc9656daf454ea9649a459d809d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:04.222357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:04.329182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:04.337571 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1669/3329] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:04.355234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:04.356137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:04.356587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:04.391275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] MFA Rules not processed for user `db9bc9656daf454ea9649a459d809d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:04.392962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:04.409881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1661/3330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:04 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:04.423484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:04.425240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:04.462082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95750996-48e1-4b29-9adb-f7ff92645cb9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:04.479205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:04.479846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:04.480287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:04.480738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:04.495883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:04.498311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:04.509969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1670/3331] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:06.354641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:06.356114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:06.446860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:06.464054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d244-553a-4081-ac8a-ec00e7c321a5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:06.472304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:06.473123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:06.473548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:06.473962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:06.482802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:06.485578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:06.512405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:06.513847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9856e-10d4-4aef-8606-ec48239f6e3b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:06.542933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2b5bc-b7c0-4a9a-a124-b4f2c4108d13 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:06.547644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1671/3332] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:06.557520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:06.558167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:06.558455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:06.558787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:06.569569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:06.600377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:06.602842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:06.628427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1662/3333] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:08.604131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:08.605093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:08.605700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:08.745277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:08.746442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:08.875238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1672/3334] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:08.904050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:08.905561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:09.172371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cacec-89b9-4e83-b6bc-53216675a4c7 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:09.185785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:09.186838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:09.187349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:09.187849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:09.208549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:09.210535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3d0d4-2832-453e-84ff-db7c31e2522e service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:09.256073 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1663/3335] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:27:10.164008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:10.171395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:10.239939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9e26-4d9c-4176-95a8-75f6afe5cb2b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:10.261165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:10.262228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:10.263775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:10.265303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] PATH_INFO: `/v3/users/d7b869c5501946389a06c3bc8ca2eb59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:10.274357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b869c5501946389a06c3bc8ca2eb59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:10.290318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:10.697797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b869c5501946389a06c3bc8ca2eb59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:10.700333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b869c5501946389a06c3bc8ca2eb59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:10.802853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b869c5501946389a06c3bc8ca2eb59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:10.845553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b869c5501946389a06c3bc8ca2eb59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:10.848094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b869c5501946389a06c3bc8ca2eb59'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:10.917724 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1673/3336] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:27:10 2022] DELETE /identity/v3/users/d7b869c5501946389a06c3bc8ca2eb59 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:10.923023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c87-b0f4-47cc-ad9d-04c146269f1b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:10.923886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c87-b0f4-47cc-ad9d-04c146269f1b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:10.924327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c87-b0f4-47cc-ad9d-04c146269f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:10.960954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-69f43c87-b0f4-47cc-ad9d-04c146269f1b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:10.971767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69f43c87-b0f4-47cc-ad9d-04c146269f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:11.128860 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1664/3337] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:11.204939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:11.206368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:11.263353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:11.388201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11e01-01b3-4864-a078-cda8127789fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:11.402044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:11.402864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:11.403488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:11.404814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:11.434386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:11.436096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a2c2d-8e37-4e5d-87a3-22ca6e67e437 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:11.470460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1674/3338] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:11.687386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:11.687950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:11.688464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:11.741821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] MFA Rules not processed for user `7bda3ce741ee49598f84b5d82e25a822`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:11.746985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:11.866665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:11.953084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1665/3339] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:11.960906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:11.962205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:11.962845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:12.039720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] MFA Rules not processed for user `7bda3ce741ee49598f84b5d82e25a822`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:12.041345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:12.066796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:12.069081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:12.071095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1675/3340] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:12.083903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:12.085874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:12.105634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0552ad1-5b13-4e62-82b4-8e463cacab57 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:12.117254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:12.118190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:12.118657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:12.119902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] PATH_INFO: `/v3/projects/06b464a61277413b8a6f59597af7c87d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:12.123536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b464a61277413b8a6f59597af7c87d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:12.125663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:12.258815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3edfbc-e8b3-4d58-a1ee-892fdd54700e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:12.273927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:12.276449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:12.276887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:12.277393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:12.290089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:12.294049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:12.325352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b464a61277413b8a6f59597af7c87d', 'request_id': 'req-2ec76030-094e-427a-9358-d2c99a2f8c46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.343099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1676/3341] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:27:12.416744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b464a61277413b8a6f59597af7c87d', 'request_id': 'req-2ec76030-094e-427a-9358-d2c99a2f8c46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.428071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b464a61277413b8a6f59597af7c87d', 'request_id': 'req-2ec76030-094e-427a-9358-d2c99a2f8c46'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.502885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] The token cache is being invalidate because project 06b464a61277413b8a6f59597af7c87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:27:12.503463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.505064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2ec76030-094e-427a-9358-d2c99a2f8c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.508627 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1666/3342] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:27:12 2022] DELETE /identity/v3/projects/06b464a61277413b8a6f59597af7c87d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:12.513154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:12.527990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a34c-2dd8-433c-ba66-fced205dba9a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:12.622203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:12.623324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:12.624070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:12.625330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] PATH_INFO: `/v3/users/d88086012ecb449abc86d8d8373f4cb8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:12.628766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88086012ecb449abc86d8d8373f4cb8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:12.633653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:12.874971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88086012ecb449abc86d8d8373f4cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.880198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88086012ecb449abc86d8d8373f4cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.960376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88086012ecb449abc86d8d8373f4cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.987927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88086012ecb449abc86d8d8373f4cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:12.989062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88086012ecb449abc86d8d8373f4cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:13.016200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1677/3343] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:27:12 2022] DELETE /identity/v3/users/d88086012ecb449abc86d8d8373f4cb8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:13.205423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:13.421025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:13.422053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:13.422513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:13.468103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:13.473908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:13.641578 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1667/3344] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:13.651288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:13.652907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:13.992921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d852-e165-4f95-b760-af819e808c09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:14.014447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:14.016914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:14.018694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:14.022539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:14.044288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:14.060966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17c52-924f-4740-9f0c-eb7d89dc5fd3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:14.072088 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1678/3345] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:27:16.490603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:16.492168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:16.693142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b171b1-875f-40ae-87aa-c022f0259662 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:16.718047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:16.719639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:16.720034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:16.720715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] PATH_INFO: `/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:16.725804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc81a15fcd448ed9a5b8ba367bfc89f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:16.728107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:16.762071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:16.955130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc81a15fcd448ed9a5b8ba367bfc89f', 'request_id': 'req-49d192dc-c44a-4d29-9f1f-011114028c26'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:17.033991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc81a15fcd448ed9a5b8ba367bfc89f', 'request_id': 'req-49d192dc-c44a-4d29-9f1f-011114028c26'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:17.044902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc81a15fcd448ed9a5b8ba367bfc89f', 'request_id': 'req-49d192dc-c44a-4d29-9f1f-011114028c26'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:17.074237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] The token cache is being invalidate because project bcc81a15fcd448ed9a5b8ba367bfc89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:27:17.075384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:17.077457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49d192dc-c44a-4d29-9f1f-011114028c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:17.084670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1668/3346] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:27:16 2022] DELETE /identity/v3/projects/bcc81a15fcd448ed9a5b8ba367bfc89f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:17.086923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:17.093247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:17.093247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:17.138813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:17.142061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:17.321530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1679/3347] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:17.323745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:17.324286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:17.324643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:17.372576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:17.376427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:17.404796 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1669/3348] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:17.407847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:17.430848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f751f-306c-41fc-ba55-b0a7e5aafef0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:17.460995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:17.461744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:17.464143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:17.466058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:17.466879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:27:17.467264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:17.470782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:17.531873 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1680/3349] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:27:17.533178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:17.550244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78fcfe-9455-40bf-a744-80e009a994a3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:17.571030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:17.571906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:17.572945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:17.573261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:17.574150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:17.579650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:17.809802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1670/3350] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:27:17 2022] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:17.809896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:17.826682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cf532-02ce-4102-860b-711a839ae8cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:17.919106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:17.974593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:17.975423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:17.975907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:17.976249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:17.982481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:17.987342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:18.167757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:18.178919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1681/3351] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:27:17 2022] POST /identity/v3/users => generated 303 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:18.190817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f0fe-6859-4f55-bed1-5ad5fb5fe2b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:18.198268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:18.200203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:18.200544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:18.201446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:18.201774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:18.203493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:18.209584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:18.212992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:18.231702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1671/3352] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:27:18.235427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:18.259914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647e88-e524-41fa-b222-130c6ddf778f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:18.277336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:18.280618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:18.280912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:18.281183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:18.287494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:18.292496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:18.327024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1672/3353] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:27:18.333520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:18.366442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be1e48-e4bb-485a-a441-524a8ec13575 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:18.375665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d011-618c-4e3f-a348-fb698d92fe7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:18.386511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:18.390087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:18.390939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:18.390939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:18.392316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:18.393213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:18.393544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:18.393968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] PATH_INFO: `/v3/projects/154ba2f9acca4073b8af21463e9157de/users/6de218747de54e89b430812bcf4196c5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:18.394084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:18.421481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:18.427375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=154ba2f9acca4073b8af21463e9157de, user_id=6de218747de54e89b430812bcf4196c5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:18.427805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe60aa8-9670-4bc6-a2d9-8dda8fcb01e8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:18.431157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:18.508782 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1682/3354] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:18.531211 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1673/3355] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:27:18 2022] PUT /identity/v3/projects/154ba2f9acca4073b8af21463e9157de/users/6de218747de54e89b430812bcf4196c5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:27:18.533846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:18.534258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:18.535626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:18.610741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:18.614025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:18.821112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1683/3356] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:18.837531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:18.840087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:19.019431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50a20-4c0f-4b5a-8fef-4061849ca12a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:19.023529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:19.024285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:19.024798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:19.025326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:19.049778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:19.051658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:19.092473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1674/3357] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:19.607524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:19.622963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d8dd-32dc-4c8a-b0d0-3403985f6031 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:19.632851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:19.633485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:19.633766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:19.634037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:19.646352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:19.711129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:19.716000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3037fb9-7c28-4e7e-879f-36a3852715e6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:19.765623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1684/3358] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:29.070476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:29.751202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:32.514607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:32.517112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:32.572294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fa3b-7316-4c27-bdc7-304b011380f0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:32.574510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fa3b-7316-4c27-bdc7-304b011380f0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:32.574990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fa3b-7316-4c27-bdc7-304b011380f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:32.621102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ffc3fa3b-7316-4c27-bdc7-304b011380f0 None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:32.623285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffc3fa3b-7316-4c27-bdc7-304b011380f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:32.781311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f69c3-80e4-4c91-9016-665cac61480c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:32.789461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:32.790125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:32.790701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:32.790701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:32.792586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:32.794936 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1685/3359] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:32.839867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:32.843489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:32.861404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1675/3360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:33.958897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:33.959478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:33.959478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:34.026760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] MFA Rules not processed for user `6de218747de54e89b430812bcf4196c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:34.028818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:34.203249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1686/3361] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:35.595661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:35.615091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0983-dd3e-4bc9-8a41-4479b267c517 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:35.628791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:35.630307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:35.630589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:35.630888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:35.643880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:35.646227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29591-3a79-4f41-acf9-575a4a302dc3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:35.671239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1676/3362] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:35.976030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:35.978457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:36.001006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc490d1-94db-4160-9c47-af83dc98c159 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:36.008513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:36.009443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:36.009873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:36.010310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:36.013679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:36.047544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:36.049796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:36.064161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1687/3363] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:36.954055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f9de-0a84-4501-82a1-cb3c019eea94 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:36.954055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f9de-0a84-4501-82a1-cb3c019eea94 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:36.954055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f9de-0a84-4501-82a1-cb3c019eea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:36.988777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7f51f9de-0a84-4501-82a1-cb3c019eea94 None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:36.994053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f51f9de-0a84-4501-82a1-cb3c019eea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:37.093315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1677/3364] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:40.848230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:40.849761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:40.865109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17857933-9154-475c-90b0-eaeba8bb441d service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:40.871317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:40.872180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:40.872646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:40.873635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] PATH_INFO: `/v3/users/41a310afce70406682173eb169e062bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:40.875143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a310afce70406682173eb169e062bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:40.880933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:41.074903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a310afce70406682173eb169e062bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:41.076519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a310afce70406682173eb169e062bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:41.190880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a310afce70406682173eb169e062bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:41.204194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a310afce70406682173eb169e062bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:41.205022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a310afce70406682173eb169e062bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:41.209857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:41.221953 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1688/3365] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:27:40 2022] DELETE /identity/v3/users/41a310afce70406682173eb169e062bd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:41.223874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:41.229061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:41.229061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:41.247163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:41.248689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:41.319457 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1678/3366] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:41.324955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:41.326402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:41.403505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc15d7-3e0e-4fa2-8219-3bef43d46697 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:41.410689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:41.410689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:41.410689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:41.410689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:41.418751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:41.420189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eecffe-d6a4-4e47-b2e0-2deb8fc2e8c0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:41.429927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1689/3367] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:41.704567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:41.711736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:41.733495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b68a-070d-4128-9a41-b65a3fbfc5ee None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:41.739993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:41.740646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:41.740927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:41.741199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] PATH_INFO: `/v3/projects/60fe1f4e4d784f9b9ace066861b72dec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:41.742538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fe1f4e4d784f9b9ace066861b72dec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:41.745174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:41.764937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:41.941229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fe1f4e4d784f9b9ace066861b72dec', 'request_id': 'req-a55e4e08-9bdf-40fc-af80-7d8f71122417'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:42.020081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fe1f4e4d784f9b9ace066861b72dec', 'request_id': 'req-a55e4e08-9bdf-40fc-af80-7d8f71122417'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:42.028429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fe1f4e4d784f9b9ace066861b72dec', 'request_id': 'req-a55e4e08-9bdf-40fc-af80-7d8f71122417'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:42.047498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] The token cache is being invalidate because project 60fe1f4e4d784f9b9ace066861b72dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:27:42.048243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:42.049413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a55e4e08-9bdf-40fc-af80-7d8f71122417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:27:42.058264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1679/3368] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:27:41 2022] DELETE /identity/v3/projects/60fe1f4e4d784f9b9ace066861b72dec => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:42.058412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.058412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.058412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.091530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:42.092754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:42.162437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1690/3369] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:42.171834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.172016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.172229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.194873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:42.196645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:42.209312 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1680/3370] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:42.210563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.231016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17a747-bf71-4d29-8212-718d5625a2ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.242605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.244388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.244657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.245774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.249449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:27:42.250009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.254474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fe818-2b2e-418b-9284-e6e298ffe16f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.294863 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1691/3371] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:27:42.299254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.311334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.311607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.311886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.312741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778368-f85e-4d77-8253-ed2d6ee064ac None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.327696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.328430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.329568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.329926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.330721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.332808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.335761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:42.337779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:42.421259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1692/3372] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:42.437971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.439371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:42.462427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1681/3373] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:27:42 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:42.466526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.480939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:42.526855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c44929-322a-4fab-abd2-1b8faf35e233 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.609097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.609777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.610056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.610331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.621507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6dc0-6df2-42fc-9761-4fd4e2668c2c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.628491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.629892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.630427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.631213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.631920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.635575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.679659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.686642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.691275 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1693/3374] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:27:42.751254 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1682/3375] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:27:42 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:42.752234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.763348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dca8-37a4-43b5-8dbb-a78cffd521e5 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.768111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.768716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.768996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.769272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.769908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.771536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.787405 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1694/3376] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:27:42.789450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.800799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa8de7-cef7-412d-8596-b15a4c5da46b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.806569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.807285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.807659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.807984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.809374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.811258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a296406-87da-4018-8592-4811898c36e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:42.835090 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1683/3377] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:27:42.840431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:42.851310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7700f-95b5-42a1-9480-42ac5ac0be9e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:42.879836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:42.880595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:42.880882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:42.881519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] PATH_INFO: `/v3/projects/69a0cb2197af447abadbc0338b591a6e/users/d50b40acedcc4cbc970d1a06cc074d66/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:42.906203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a0cb2197af447abadbc0338b591a6e, user_id=d50b40acedcc4cbc970d1a06cc074d66, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:42.908129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9570c8-8544-4b77-8ab3-6820b90788f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:43.040762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1695/3378] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:27:42 2022] PUT /identity/v3/projects/69a0cb2197af447abadbc0338b591a6e/users/d50b40acedcc4cbc970d1a06cc074d66/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:27:43.053160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.053690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.054145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.126189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] MFA Rules not processed for user `d50b40acedcc4cbc970d1a06cc074d66`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:43.127889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:43.128493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.129363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.131030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.188817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] MFA Rules not processed for user `c3e1daec3443449b871a1d15b9cccb21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:43.195699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:43.262202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:43.323607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1684/3379] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:43.327824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:43.342711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:43.395153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1696/3380] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:43.472117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521043e-4020-4b3b-a3c6-9eeef32cd048 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:43.479592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036617-de57-4250-926a-542c7a382404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:43.480352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036617-de57-4250-926a-542c7a382404 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.480872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036617-de57-4250-926a-542c7a382404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.481390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036617-de57-4250-926a-542c7a382404 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.482446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96036617-de57-4250-926a-542c7a382404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:43.485288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96036617-de57-4250-926a-542c7a382404 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:43.575615 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1685/3381] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:27:43 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:43.579464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:43.597071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853bbc9-9226-408d-94cf-11c9f33d88d0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:43.727815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:43.728169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.728452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.728728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.729374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:43.740271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:43.849676 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1697/3382] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:27:43 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:27:43.854347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036617-de57-4250-926a-542c7a382404 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:43.881653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036617-de57-4250-926a-542c7a382404 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:43.898731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:43.899384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.899666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.899952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.900609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:43.902230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:43.933620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1686/3383] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:27:43.937138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:43.953022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4143e0-fa9b-4a89-bf77-9fc9662cdd66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:43.965223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:43.966756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:43.967207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:43.968077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] PATH_INFO: `/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417/users/c36b8af46d3e4dea991cd62080505422/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:43.990743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0a4ec78daf4b5680661fb30dd5e417, user_id=c36b8af46d3e4dea991cd62080505422, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:43.995953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:44.071726 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1698/3384] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:27:43 2022] PUT /identity/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417/users/c36b8af46d3e4dea991cd62080505422/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:44.075721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:44.097697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506273-6945-4c97-8349-e1947edc157b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:44.272647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:44.273533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:44.279730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:44.280786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:44.284272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:44.287643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7420-b8b6-4505-9294-1a5c11817d8c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:44.303601 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1687/3385] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:27:44.307635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:44.337880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c9ba8-f48e-4bb9-bcea-4d401fdc9293 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:44.364943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:44.365656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:44.366157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:44.366687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] PATH_INFO: `/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417/users/c36b8af46d3e4dea991cd62080505422/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:44.372883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0a4ec78daf4b5680661fb30dd5e417, user_id=c36b8af46d3e4dea991cd62080505422, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:44.379164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:44.391433 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1699/3386] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:27:44 2022] PUT /identity/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417/users/c36b8af46d3e4dea991cd62080505422/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:27:44.402323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:44.404081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:44.404572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:44.463794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] MFA Rules not processed for user `c36b8af46d3e4dea991cd62080505422`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:44.466254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:44.543462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:44.606225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1688/3387] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:27:44.619544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:44.621615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:44.762574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3aa1c-6981-4f22-b5f3-3193a9e2d5fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:44.766991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:44.768722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:44.769482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:44.770231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:44.782691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:44.784153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a51fa-2b82-4a03-a8b8-dffbc7b5eff1 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:44.796629 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1700/3388] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:45.069572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:45.085893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095a7f-7277-42ed-af82-54af511414dd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:45.102902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:45.104096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:45.104648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:45.105202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:45.213236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:45.216121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:45.228318 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1689/3389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:46.988308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:46.988860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:46.989275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:47.020449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:27:47.022285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:47.157983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:47.234445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1701/3390] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:27:47.270326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:47.542113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31350f5b-dd0e-4d78-882b-85fd5f71859f service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:47.549409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:47.551245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:47.551525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:47.551794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:47.569128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:47.573606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:47.588762 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1690/3391] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:27:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:27:48.559690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:27:48.561242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:48.753111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06f8c6-b56d-462b-bbba-466f75537989 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:27:48.762053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:27:48.762793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:27:48.763226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:27:48.763503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:27:48.767951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:27:48.795011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:27:48.796480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:27:48.824574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1702/3392] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:27:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:27:57.582599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=71 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:27:58.821821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:07.092348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:07.093858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:07.290067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d0247-189f-4f78-8619-e698b1511435 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:07.301778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:07.304012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:07.305667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:07.307825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] PATH_INFO: `/v3/users/7bda3ce741ee49598f84b5d82e25a822` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:07.312069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bda3ce741ee49598f84b5d82e25a822)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:07.319549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:07.672768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bda3ce741ee49598f84b5d82e25a822'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:07.673843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bda3ce741ee49598f84b5d82e25a822'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:07.774437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bda3ce741ee49598f84b5d82e25a822'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:07.802577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bda3ce741ee49598f84b5d82e25a822'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:07.805633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bda3ce741ee49598f84b5d82e25a822'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:07.825651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1691/3393] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:07 2022] DELETE /identity/v3/users/7bda3ce741ee49598f84b5d82e25a822 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:08.334296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:08.353427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d3c9-d79f-4318-93ce-5e010befac5f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:08.565699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:08.566277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:08.566931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:08.567676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:08.568203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] PATH_INFO: `/v3/projects/bb359fa533884c8d97c22f95474c8c27` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:08.568347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:08.569762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb359fa533884c8d97c22f95474c8c27)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:08.572612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:08.701775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eb001-cb95-4f24-95b9-7e3f8f6af0ae admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:08.713574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:08.714494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:08.715748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:08.718375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:08.723373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:08.743412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:08.745207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bcb44-06b4-4b38-9c4d-917e69efa725 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:08.760463 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1692/3394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:28:08.770158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb359fa533884c8d97c22f95474c8c27', 'request_id': 'req-129faee0-e292-412c-8f7d-97a9df80e4fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:08.877962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb359fa533884c8d97c22f95474c8c27', 'request_id': 'req-129faee0-e292-412c-8f7d-97a9df80e4fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:08.923336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb359fa533884c8d97c22f95474c8c27', 'request_id': 'req-129faee0-e292-412c-8f7d-97a9df80e4fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:08.945208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] The token cache is being invalidate because project bb359fa533884c8d97c22f95474c8c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:08.949459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:08.949459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-129faee0-e292-412c-8f7d-97a9df80e4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:08.951407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1703/3395] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:08 2022] DELETE /identity/v3/projects/bb359fa533884c8d97c22f95474c8c27 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:08.958460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:08.959616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:08.959616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:08.975196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:08.989602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:08.991444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:09.162076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.162951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.165480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.168018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1693/3396] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:09.219447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:09.220959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:09.263041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1704/3397] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:09.263166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.269982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b7223-6d9c-4c5f-8af5-c71b5d540c82 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.285095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.285805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.286169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.286510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.287473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:09.287833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.290362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:09.307382 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1694/3398] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:28:09.314388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.325925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8b2a-a8e7-4675-a8e9-e04de5ee11dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.330774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.331500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.331808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.332076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.332825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.334964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:09.512411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1705/3399] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:09 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:09.517072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.527829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290631d4-f0b4-4e65-9cc5-940f0314e3e6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.594809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.595457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.595693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.595966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.596645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.598570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:09.789620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1695/3400] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:09 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:09.793992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.810197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43447-c2fe-465b-851e-2441323b9fb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.817932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.818948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.818948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.819508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.821032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.823234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:09.870791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1706/3401] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:09.871034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.889756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac1ce4-1ce3-40aa-bb9e-5da9539d371f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.900003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.900631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.900913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.901658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.902314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.908320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be007510-6f99-4026-b0db-084293a5c3f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:09.922956 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1696/3402] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:09.926350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:09.941449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf52d-55bd-4dbb-b1b0-a229bec903f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:09.947697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:09.948262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:09.948630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:09.948802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] PATH_INFO: `/v3/projects/0142b08920c34e6aac46d1bd3bd42e73/users/d22d29c5b4fc4204ace2a5ce89e7bc21/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:09.993594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0142b08920c34e6aac46d1bd3bd42e73, user_id=d22d29c5b4fc4204ace2a5ce89e7bc21, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:09.996296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a7b67-c303-46b0-817d-440d9a754f0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:10.116306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1707/3403] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:09 2022] PUT /identity/v3/projects/0142b08920c34e6aac46d1bd3bd42e73/users/d22d29c5b4fc4204ace2a5ce89e7bc21/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:10.133769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94009543-64b6-4855-971c-a3eda2572811 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:10.134045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94009543-64b6-4855-971c-a3eda2572811 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:10.134319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94009543-64b6-4855-971c-a3eda2572811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:10.198263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-94009543-64b6-4855-971c-a3eda2572811 None None] MFA Rules not processed for user `d22d29c5b4fc4204ace2a5ce89e7bc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:10.199775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94009543-64b6-4855-971c-a3eda2572811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:10.393053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:10.405626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1697/3404] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:10.415746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aba2-cb01-4c1f-bb25-b0b19b00db9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:10.416253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aba2-cb01-4c1f-bb25-b0b19b00db9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:10.416530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aba2-cb01-4c1f-bb25-b0b19b00db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:10.440649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ec0aba2-cb01-4c1f-bb25-b0b19b00db9a None None] MFA Rules not processed for user `d22d29c5b4fc4204ace2a5ce89e7bc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:10.442291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ec0aba2-cb01-4c1f-bb25-b0b19b00db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:10.451354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1708/3405] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:11.438924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94009543-64b6-4855-971c-a3eda2572811 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:11.440443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94009543-64b6-4855-971c-a3eda2572811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:11.658987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94009543-64b6-4855-971c-a3eda2572811 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:11.666749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:11.667376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:11.667654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:11.667935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:11.685843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:11.687703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:11.704748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1698/3406] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:12.342128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:12.342128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:12.342128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:12.378521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] MFA Rules not processed for user `d22d29c5b4fc4204ace2a5ce89e7bc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:12.379811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:12.390537 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1709/3407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:18.696595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:18.698112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:18.848966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0e8f-4525-445c-a116-4a449401ecb9 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:18.854931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:18.856058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:18.856182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:18.856706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] PATH_INFO: `/v3/users/6de218747de54e89b430812bcf4196c5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:18.858061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de218747de54e89b430812bcf4196c5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:18.860293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:19.118938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de218747de54e89b430812bcf4196c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:19.119952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de218747de54e89b430812bcf4196c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:19.191697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de218747de54e89b430812bcf4196c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:19.206010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de218747de54e89b430812bcf4196c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:19.206931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-23e9f18a-d1d8-4e7c-89cd-196c65e30605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de218747de54e89b430812bcf4196c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:19.220477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1699/3408] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:18 2022] DELETE /identity/v3/users/6de218747de54e89b430812bcf4196c5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:19.543453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:19.560528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7dab4-f3f5-4447-a1e4-ad852f1179f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:19.594870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:19.752525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:19.753906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:19.754434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:19.755284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] PATH_INFO: `/v3/projects/154ba2f9acca4073b8af21463e9157de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:19.764238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154ba2f9acca4073b8af21463e9157de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:19.764238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:19.940439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154ba2f9acca4073b8af21463e9157de', 'request_id': 'req-774833b8-b0d5-4747-9ec9-890119b5a132'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:20.020929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154ba2f9acca4073b8af21463e9157de', 'request_id': 'req-774833b8-b0d5-4747-9ec9-890119b5a132'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:20.030000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154ba2f9acca4073b8af21463e9157de', 'request_id': 'req-774833b8-b0d5-4747-9ec9-890119b5a132'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:20.046036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] The token cache is being invalidate because project 154ba2f9acca4073b8af21463e9157de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:20.046344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:20.047063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-774833b8-b0d5-4747-9ec9-890119b5a132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:20.048761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1710/3409] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:19 2022] DELETE /identity/v3/projects/154ba2f9acca4073b8af21463e9157de => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:20.054025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.055434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.056103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.066704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:20.088173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:20.089739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:20.189789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1700/3410] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:20.198074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.198358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.198736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.219902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:20.221090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:20.238228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1711/3411] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:20.239848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.250255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8277d6a-8060-4328-8a2f-757d1ccc213a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.255139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.256052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.256546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.256819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.258128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:20.258431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.260069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.276921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1701/3412] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:28:20.278127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.290923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38779f52-5ed2-41f4-925a-1b0515fee2f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.327328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.327960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.328237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.328507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.329142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.331119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.450458 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1712/3413] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:20 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:20.454011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.484296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dab77-7af6-403e-8a8b-8063d06395bd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.576105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.576105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.576105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.576105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.577361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.577361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.666395 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1702/3414] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:20 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:20.670763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.683377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ca0ab-2185-4598-bf18-ec7abba87631 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.689153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.690052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.690498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.690958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.691766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.693545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.706067 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1713/3415] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:28:20.710011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.722912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a1e5a-ce60-4b28-9b90-d523fb0878e3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.728675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.729297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.729579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.729869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.730500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.732454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dddd8-54ee-4788-9e41-62a07330acf5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.746657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1703/3416] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:20.750408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:20.762185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af09-4652-45f5-b98d-1132b8517a93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:20.766859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:20.767509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.767791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.768065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] PATH_INFO: `/v3/projects/76e953d4cf04460893b682e9429ae66d/users/0c46e0451aad433fb45d74e158ed83a5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.785481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e953d4cf04460893b682e9429ae66d, user_id=0c46e0451aad433fb45d74e158ed83a5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:20.789207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:20.876961 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1714/3417] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:20 2022] PUT /identity/v3/projects/76e953d4cf04460893b682e9429ae66d/users/0c46e0451aad433fb45d74e158ed83a5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:28:20.882335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4df7-b9d7-41fe-9bc4-ae5c4f79f3db None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:20.882851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4df7-b9d7-41fe-9bc4-ae5c4f79f3db None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:20.883149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4df7-b9d7-41fe-9bc4-ae5c4f79f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:20.942594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-900a4df7-b9d7-41fe-9bc4-ae5c4f79f3db None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:20.945899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-900a4df7-b9d7-41fe-9bc4-ae5c4f79f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:21.172391 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1704/3418] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:21.193710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:21.197088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:21.322994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:21.404719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded7730-a1a2-4e4c-ab22-f2337f733ab3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:21.410953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:21.410953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:21.410953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:21.418419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:21.432363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:21.433899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:21.468538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1715/3419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:21.539245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:21.539534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:21.539990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:21.576247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:21.580140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:21.589943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:21.710902 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1705/3420] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:21.746902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:21.746902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:21.828079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d28b-9d88-441e-910e-f18c78966e8d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:21.839332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:21.840383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:21.840876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:21.841931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:21.851714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:21.853526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab544-30e0-42c1-b88b-5fad9a1cdf08 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:21.863819 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1716/3421] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:23.270426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:23.272246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:23.298167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584420b9-ee0b-488b-9974-48a3e4b0ad68 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:23.312368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:23.313374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:23.313963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:23.314404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] PATH_INFO: `/v3/users/d50b40acedcc4cbc970d1a06cc074d66` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:23.316912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50b40acedcc4cbc970d1a06cc074d66)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:23.320604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:23.614885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50b40acedcc4cbc970d1a06cc074d66'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:23.617899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50b40acedcc4cbc970d1a06cc074d66'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:23.792162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50b40acedcc4cbc970d1a06cc074d66'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:23.834262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50b40acedcc4cbc970d1a06cc074d66'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:23.834862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cfd71a13-d0dc-4c94-9551-f62937ebb8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50b40acedcc4cbc970d1a06cc074d66'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:23.862670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1706/3422] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:23 2022] DELETE /identity/v3/users/d50b40acedcc4cbc970d1a06cc074d66 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:28:23.869043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:23.869562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:23.869562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:23.904829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:23.907448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:24.060916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1717/3423] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:24.093974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:24.093974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:24.093974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:24.103254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:24.104754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:24.148517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] MFA Rules not processed for user `cba1c08f53b14729adf893683ccec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:24.151410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:24.292219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9936-dc51-40ae-b184-ac13f40eff4a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:24.305629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:24.307266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:24.307549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:24.308003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:24.346319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:24.347943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:24.372871 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1707/3424] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:24.395845 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1718/3425] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:28:25.911801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:25.914428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:25.935454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b4485-e433-477c-8054-6a809e46e9f8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:25.942158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:25.942925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:25.943307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:25.943644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] PATH_INFO: `/v3/projects/69a0cb2197af447abadbc0338b591a6e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:25.945476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a0cb2197af447abadbc0338b591a6e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:25.947568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:26.064525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:26.121606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a0cb2197af447abadbc0338b591a6e', 'request_id': 'req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.250027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a0cb2197af447abadbc0338b591a6e', 'request_id': 'req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.264468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a0cb2197af447abadbc0338b591a6e', 'request_id': 'req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.279972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] The token cache is being invalidate because project 69a0cb2197af447abadbc0338b591a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:26.283079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.284201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.289778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1708/3426] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:25 2022] DELETE /identity/v3/projects/69a0cb2197af447abadbc0338b591a6e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:26.293045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:26.307589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bce744-69e3-4005-87b8-98b4630d4fed service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:26.329091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:26.478713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:26.479657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:26.480136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:26.481218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] PATH_INFO: `/v3/users/c36b8af46d3e4dea991cd62080505422` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:26.489375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36b8af46d3e4dea991cd62080505422)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:26.492431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:26.729000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36b8af46d3e4dea991cd62080505422'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.729000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36b8af46d3e4dea991cd62080505422'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.803651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36b8af46d3e4dea991cd62080505422'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.817251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36b8af46d3e4dea991cd62080505422'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.818313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83a8f9a0-32d2-4c5e-a2d9-cc84d8836b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36b8af46d3e4dea991cd62080505422'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:26.834958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1719/3427] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:26 2022] DELETE /identity/v3/users/c36b8af46d3e4dea991cd62080505422 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:28:27.643951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:27.645233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:27.678857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1a0a-9d12-4d86-b28b-9440a62106a7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:27.853194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:27.853194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:27.853194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:27.853477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] PATH_INFO: `/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:27.854723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0a4ec78daf4b5680661fb30dd5e417)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:27.856911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:28.065175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0a4ec78daf4b5680661fb30dd5e417', 'request_id': 'req-89cb3762-09f9-488e-a5d0-b6ed8650aab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:28.148698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0a4ec78daf4b5680661fb30dd5e417', 'request_id': 'req-89cb3762-09f9-488e-a5d0-b6ed8650aab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:28.162063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0a4ec78daf4b5680661fb30dd5e417', 'request_id': 'req-89cb3762-09f9-488e-a5d0-b6ed8650aab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:28.180857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] The token cache is being invalidate because project 8f0a4ec78daf4b5680661fb30dd5e417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:28.181414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:28.182394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cb3762-09f9-488e-a5d0-b6ed8650aab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:28.184857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1709/3428] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:27 2022] DELETE /identity/v3/projects/8f0a4ec78daf4b5680661fb30dd5e417 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:28.204490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.204490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.204490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.235679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:28.238876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:28.358920 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1720/3429] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:28.366916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.367326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.367888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.389835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:28.391534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:28.405141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1710/3430] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:28:28.405434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.414841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5aead-0470-474f-b6a7-9b225994c4a7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:28.419856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:28.420887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.421355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.421624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.422492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:28.422844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:28.424647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:28.459358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.468746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1721/3431] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:28:28.475357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45edaff-1620-4b47-9a57-25000037c0dc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:28.481699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:28.482322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.482600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.482912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.483720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:28.485949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594ec1a-58e7-4a81-bcd1-904aa1e6deda admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:28.610134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1711/3432] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:28 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:28.614311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.625458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631058-1b6f-4446-a906-53fce68760fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:28.646818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:28.702094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.702579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.702688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.734262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:28.735835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.736291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.738110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:28.738234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.738234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:28.738377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:28.742068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:28.775333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:28.825855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1722/3433] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:28 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:28.830757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.853100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db6f5-d5d3-461e-9a28-323f6ce7c513 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:28.868891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:28.870153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.870488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.870955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:28.871784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:28.873821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:28.873997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1712/3434] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:28:28.876808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.879798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:28.948909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1723/3435] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:28.952411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:28.961391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:28.977113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e56f8b-e0d3-4a2c-a987-e8d1dcd573ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:28.985410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:28.986035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:28.989168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:28.989168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.000297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.002161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.026800 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1713/3436] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:28:29.027820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:29.041266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48429ea-6c86-4152-b5b7-93f76a8531d2 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:29.047086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:29.047914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.048292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.048661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.049456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.051559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.068910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1714/3437] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:29.071227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:29.087509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ece5-63c6-4bb8-9b6c-65ef71c916e0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:29.093846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:29.095000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.095380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.095751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] PATH_INFO: `/v3/projects/6ca78d13ae6f4db4b955a5d0837540ce/users/ef9efadc68004076b546fcdca3c55995/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.117198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca78d13ae6f4db4b955a5d0837540ce, user_id=ef9efadc68004076b546fcdca3c55995, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.120188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.136779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eae86-3ec3-4599-a992-35ddedb44849 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:29.143207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:29.143838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.144310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.144597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.150002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:29.262205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.262967 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1715/3438] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:29 2022] PUT /identity/v3/projects/6ca78d13ae6f4db4b955a5d0837540ce/users/ef9efadc68004076b546fcdca3c55995/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:29.263505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:29.268456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29234a9-16c4-43ee-a205-bbdaa2e45702 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.274076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:29.310489 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1724/3439] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:29.314466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.315447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.317324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.424788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] MFA Rules not processed for user `ef9efadc68004076b546fcdca3c55995`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:29.427345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:29.463372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25a67-b342-4eec-8180-600876f01cf1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:29.480826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:29.482436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.483946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.486478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] PATH_INFO: `/v3/users/db9bc9656daf454ea9649a459d809d12` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.489812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9bc9656daf454ea9649a459d809d12)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.495853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.505144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:29.555412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:29.592412 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1725/3440] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:29.603430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:29.616530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74304853-acc3-4674-bb28-99489e1678d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:29.622303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:29.623267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:29.623762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:29.624244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:29.625111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:29.627480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:29.767001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9bc9656daf454ea9649a459d809d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:29.768645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9bc9656daf454ea9649a459d809d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:29.784528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1726/3441] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:29 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:28:29.789411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:29.797936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:29.894854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9bc9656daf454ea9649a459d809d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:29.918367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9bc9656daf454ea9649a459d809d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:29.919221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9bc9656daf454ea9649a459d809d12'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:29.955827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1716/3442] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:29 2022] DELETE /identity/v3/users/db9bc9656daf454ea9649a459d809d12 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:30.002677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937abe-195d-49e0-8c61-e1661cd3e682 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:30.262655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:30.262655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:30.262655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:30.262655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:30.263660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:30.275767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:30.492789 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1727/3443] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:29 2022] POST /identity/v3/users => generated 297 bytes in 704 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:30.497447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:30.522139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a3677-845a-4131-9787-cf17d4c4d9b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:30.537051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:30.540813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:30.547878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:30.550743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:30.551582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:30.554510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:30.555333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:30.560935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:30.606933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd522-6bd9-4ec5-88a3-bcb43b22a350 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:30.623770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:30.625102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1717/3444] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:30.632693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:30.633000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:30.633937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] PATH_INFO: `/v3/projects/1ee8778614cd4adaa7b81f70aae9e40b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:30.634481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:30.636806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee8778614cd4adaa7b81f70aae9e40b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:30.642246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:30.660459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968b02-8be1-45e7-91d0-21269aabe742 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:30.677984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:30.678873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:30.679378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:30.679629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] PATH_INFO: `/v3/projects/f445923021e24cdda31f42d41fef6590/users/cd00add912e84bdd99b3d7c788ef19d1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:30.724888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f445923021e24cdda31f42d41fef6590, user_id=cd00add912e84bdd99b3d7c788ef19d1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:30.724888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:30.820127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1718/3445] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:30 2022] PUT /identity/v3/projects/f445923021e24cdda31f42d41fef6590/users/cd00add912e84bdd99b3d7c788ef19d1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:30.825698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:30.852091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:30.895142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee8778614cd4adaa7b81f70aae9e40b', 'request_id': 'req-55f93978-3027-450d-a5e8-73b50e23f69e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:30.996350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee8778614cd4adaa7b81f70aae9e40b', 'request_id': 'req-55f93978-3027-450d-a5e8-73b50e23f69e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:31.010553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee8778614cd4adaa7b81f70aae9e40b', 'request_id': 'req-55f93978-3027-450d-a5e8-73b50e23f69e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:31.043973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] The token cache is being invalidate because project 1ee8778614cd4adaa7b81f70aae9e40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:31.045720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:31.046983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55f93978-3027-450d-a5e8-73b50e23f69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:31.053228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1728/3446] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:30 2022] DELETE /identity/v3/projects/1ee8778614cd4adaa7b81f70aae9e40b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:31.059755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1512-5a80-44ec-bd9c-70062c06d704 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.060265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1512-5a80-44ec-bd9c-70062c06d704 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.071916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cba7-3560-4750-a28e-3d1d008c6589 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:31.074922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1512-5a80-44ec-bd9c-70062c06d704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.116058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b77f1512-5a80-44ec-bd9c-70062c06d704 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:31.117683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b77f1512-5a80-44ec-bd9c-70062c06d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:31.274474 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1729/3447] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:31.334293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:31.355618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.355835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.356144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.356744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:31.368481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.369669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.369669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.374790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:31.408206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:31.409933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:31.423203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1719/3448] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 595 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:31.427865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:31.430885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1730/3449] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:28:31.433791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:31.435945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:31.452136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32462d0-d388-47a0-a42f-77131a5bf3a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:31.462205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:31.462836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.463184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.464082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.464082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:31.464548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:31.466248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:31.492606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:31.507157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4daef-03ae-4736-9ed2-f7a0fa96b7ff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:31.513934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1731/3450] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:28:31.516499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:31.517410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.517553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:31.517970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.518398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] PATH_INFO: `/v3/projects/f445923021e24cdda31f42d41fef6590/users/cd00add912e84bdd99b3d7c788ef19d1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.531601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f445923021e24cdda31f42d41fef6590, user_id=cd00add912e84bdd99b3d7c788ef19d1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:31.534837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756064b-2e16-4c0a-b353-7d09f6166073 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:31.543802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f7f7-9522-43db-9513-d5c00cc2005b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:31.558428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1720/3451] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:31 2022] PUT /identity/v3/projects/f445923021e24cdda31f42d41fef6590/users/cd00add912e84bdd99b3d7c788ef19d1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:31.570606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.571232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.571575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.577723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:31.578370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:31.591616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:31.592226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:31.593712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:31.603336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:31.674015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] MFA Rules not processed for user `cd00add912e84bdd99b3d7c788ef19d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:31.681960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:31.969948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1721/3452] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:28:31.969948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:31.969948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:32.056000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7af9e0-e4af-49f9-945e-36a43184ce49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:32.061577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:32.062197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:32.062543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:32.062818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:32.064730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:32.123977 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1732/3453] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:31 2022] POST /identity/v3/projects => generated 391 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:32.129122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:32.188428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:32.189892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:32.221417 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1722/3454] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:32.330171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d949-e0d6-425f-b2f2-9c3230536fbd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:32.346804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:32.349454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:32.349806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:32.350090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:32.351062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:32.356554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:32.500165 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1733/3455] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:32 2022] POST /identity/v3/users => generated 296 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:28:32.504999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:32.696132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8cb64-9664-4f4e-a838-039e084be136 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:32.707985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:32.708616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:32.708895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:32.709266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:32.709953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:32.711688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:32.737858 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1723/3456] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:32.738080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:32.757190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5ad-4127-4154-9dde-b06a833c9620 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:32.784655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:32.787375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:32.790020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:32.790423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:32.791236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:32.796851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbccb-2c2b-4aa3-9590-5390bfab0265 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:32.832393 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1734/3457] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:28:32.833744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:32.851471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0a27-7ef4-49db-99a1-2afe1a54ca2f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:32.865192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:32.865869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:32.866779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:32.867054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] PATH_INFO: `/v3/projects/debef9511e59440598ed20cb894abe36/users/1f05714e459b46cd81e0915b0ec5345f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:32.912621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debef9511e59440598ed20cb894abe36, user_id=1f05714e459b46cd81e0915b0ec5345f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:32.924742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:33.056456 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1724/3458] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:32 2022] PUT /identity/v3/projects/debef9511e59440598ed20cb894abe36/users/1f05714e459b46cd81e0915b0ec5345f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:33.060824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:33.060824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:33.060824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:33.125206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] MFA Rules not processed for user `1f05714e459b46cd81e0915b0ec5345f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:33.129004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:33.368297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:33.502829 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1735/3459] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:33.830068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:33.835685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:34.031646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7901a-bd37-4650-8239-0c49d91c27e8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:34.045873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:34.047029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:34.047556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:34.048066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:34.071502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:34.075149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49f85-0d52-42e2-9f8b-ee83ef0048d3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:34.113472 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1725/3460] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:34.221106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:35.389935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:35.543868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119c27-7a0b-45ec-84bf-891f4552e25f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:35.567767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:35.569916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:35.573405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:35.573702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] PATH_INFO: `/v3/users/1f05714e459b46cd81e0915b0ec5345f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:35.579338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f05714e459b46cd81e0915b0ec5345f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:35.582288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:35.876175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f05714e459b46cd81e0915b0ec5345f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:35.878537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f05714e459b46cd81e0915b0ec5345f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:35.951715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f05714e459b46cd81e0915b0ec5345f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:35.995953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f05714e459b46cd81e0915b0ec5345f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:36.003995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f05714e459b46cd81e0915b0ec5345f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:36.078700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1736/3461] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:35 2022] DELETE /identity/v3/users/1f05714e459b46cd81e0915b0ec5345f => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:36.080829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979f8a-ef50-49ec-bc88-788c4866867f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:36.081309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979f8a-ef50-49ec-bc88-788c4866867f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:36.081416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979f8a-ef50-49ec-bc88-788c4866867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:36.149841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e8979f8a-ef50-49ec-bc88-788c4866867f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:36.151222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e8979f8a-ef50-49ec-bc88-788c4866867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:36.332352 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1726/3462] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:36.441773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:36.443822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:36.469638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:36.572401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ff85-9d74-429e-95ae-9faf75268eb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:36.583513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:36.583513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:36.583513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:36.583513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:36.606348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:36.607843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:36.637115 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1737/3463] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:36.673130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:36.673526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:36.673803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:36.761086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] MFA Rules not processed for user `0c46e0451aad433fb45d74e158ed83a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:36.762470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:36.828436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:36.991606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1727/3464] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:37.032192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:37.036137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:37.184194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b356-bca7-415e-aeec-00a6f334a95a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:37.192655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:37.193924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:37.194365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:37.194664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:37.221591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:37.221591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123100a2-9b9c-4071-8f6d-fd7c2fdeba1b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:37.237283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1738/3465] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:38.646524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:38.649872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:38.697593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d808-3fd3-4cdd-a7e8-b6b3b39474a8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:38.714571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:38.715268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:38.715553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:38.715829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] PATH_INFO: `/v3/projects/debef9511e59440598ed20cb894abe36` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:38.718029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=debef9511e59440598ed20cb894abe36)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:38.728458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:39.011011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debef9511e59440598ed20cb894abe36', 'request_id': 'req-df34e378-cb62-4827-b327-ffae9104ce6c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:39.104760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debef9511e59440598ed20cb894abe36', 'request_id': 'req-df34e378-cb62-4827-b327-ffae9104ce6c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:39.114823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debef9511e59440598ed20cb894abe36', 'request_id': 'req-df34e378-cb62-4827-b327-ffae9104ce6c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:39.149110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] The token cache is being invalidate because project debef9511e59440598ed20cb894abe36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:39.149768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:39.151086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df34e378-cb62-4827-b327-ffae9104ce6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:39.159263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1728/3466] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:38 2022] DELETE /identity/v3/projects/debef9511e59440598ed20cb894abe36 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:39.165491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:39.170592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:39.170592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:39.262569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:39.264215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:39.431889 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1739/3467] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:39.441032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:39.448488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:39.448488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:39.483700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:39.489818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:39.523964 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1729/3468] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:39.526863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:39.560145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c25a08-4cf9-4c30-9c2a-7c85aad7023f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:39.580676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:39.581336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:39.583212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:39.583630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:39.589486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:39.590558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:39.597515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:39.658325 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1740/3469] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:28:39.663014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:39.683367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e5717-221b-453c-92a9-ef63eed52ca3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:39.702650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:39.725774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:39.726055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:39.726326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:39.727017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:39.728961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:39.955919 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1730/3470] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:39 2022] POST /identity/v3/projects => generated 373 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:39.958403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:39.973857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704da47e-177d-4609-a626-5df3b730f168 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:40.109750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:40.253437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:40.254801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:40.255239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:40.257030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:40.258142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:40.265437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:40.464517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1741/3471] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:39 2022] POST /identity/v3/users => generated 287 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:40.467752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:40.502735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40da3b4-1810-4925-beda-05d2774c9a3c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:40.518893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:40.522650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:40.523332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:40.524170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:40.526551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:40.528370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:40.560634 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1731/3472] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:28:40.562065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:40.579568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a491-8b27-4ab1-baae-80f42771fc01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:40.617250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:40.617635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:40.619320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:40.619605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:40.622212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:40.629307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e63ad-9a78-408f-8749-3e3bf64ca495 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:40.712247 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1742/3473] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:40.727752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:40.742360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f29337-1927-43d1-85a6-b3389ed5915f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:40.785258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:40.799604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:40.802011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:40.804416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] PATH_INFO: `/v3/projects/1829550466c74d62892f071021d528ea/users/92eecce3d3c84391a85dfcf22a3cfc79/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:40.903565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1829550466c74d62892f071021d528ea, user_id=92eecce3d3c84391a85dfcf22a3cfc79, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:40.909760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:41.054097 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1732/3474] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:40 2022] PUT /identity/v3/projects/1829550466c74d62892f071021d528ea/users/92eecce3d3c84391a85dfcf22a3cfc79/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:41.055819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:41.056682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:41.056682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:41.157962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] MFA Rules not processed for user `92eecce3d3c84391a85dfcf22a3cfc79`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:41.168132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:41.446874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1743/3475] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:42.117794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:42.124266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:42.132708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:42.134171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:42.250428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:42.291792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6346d-f075-49ea-899b-7a48be1c6fbb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:42.305727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:42.306372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:42.306658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:42.307106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:42.316047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:42.367251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030bdf-018a-4f96-92fa-7e10f9429e98 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:42.386930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:42.391816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:42.391816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:42.391816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:42.418641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:42.418641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d32a5-abc3-4fa1-80de-cd492e7bf382 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:42.434882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:42.467724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:42.468839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1733/3476] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:42.475746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2417-4f89-4352-ab72-a89801c11701 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:42.499739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1744/3477] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:28:43.568644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:43.568644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:43.568644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:43.603853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] MFA Rules not processed for user `0c46e0451aad433fb45d74e158ed83a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:43.606111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:43.810774 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1734/3478] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:48.927709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09163-605f-4f2f-9523-75d7ef6f7937 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:48.928234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09163-605f-4f2f-9523-75d7ef6f7937 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:48.928485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09163-605f-4f2f-9523-75d7ef6f7937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:48.981271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28b09163-605f-4f2f-9523-75d7ef6f7937 None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:49.003037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28b09163-605f-4f2f-9523-75d7ef6f7937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:49.163287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1745/3479] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:49.735538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:50.035563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c70c9-f7fc-43fc-8783-2fd1964cfcfa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:50.043144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:50.044921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:50.045399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:50.046069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] PATH_INFO: `/v3/users/92eecce3d3c84391a85dfcf22a3cfc79` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:50.056943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92eecce3d3c84391a85dfcf22a3cfc79)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:50.078958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:50.362258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92eecce3d3c84391a85dfcf22a3cfc79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:50.366425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92eecce3d3c84391a85dfcf22a3cfc79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:50.465948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92eecce3d3c84391a85dfcf22a3cfc79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:50.479033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:50.480493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92eecce3d3c84391a85dfcf22a3cfc79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:50.481257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92eecce3d3c84391a85dfcf22a3cfc79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:50.506366 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1735/3480] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:49 2022] DELETE /identity/v3/users/92eecce3d3c84391a85dfcf22a3cfc79 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:50.511593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:50.512886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:50.513393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:50.550331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:50.556903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:50.704037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1746/3481] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:50.744676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:50.744676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:50.918740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194116-0806-45e2-b060-928d83525285 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:50.931373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:50.932070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:50.932555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:50.932770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:50.953406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:50.955121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:50.981778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1736/3482] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:51.446873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:51.448591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:51.659339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf6dd-bd06-4048-8959-2aa8c3a07e21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:51.671133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:51.674128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:51.674547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:51.675069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:51.677852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:51.694942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:51.695250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06ccce-f763-4a67-b345-a13f46f85fe1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:51.740237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1747/3483] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:52.005702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:52.007357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:52.037994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4d0e-436a-4db4-b684-d72b242f1067 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:52.048576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:52.052890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.052890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.053302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] PATH_INFO: `/v3/projects/1829550466c74d62892f071021d528ea` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.055440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1829550466c74d62892f071021d528ea)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:52.059955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:52.200934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791f47-cb2a-4b70-a36f-92ccf673aa8a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.201431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791f47-cb2a-4b70-a36f-92ccf673aa8a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.201968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791f47-cb2a-4b70-a36f-92ccf673aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.257641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1829550466c74d62892f071021d528ea', 'request_id': 'req-baa0789a-1e78-4958-80e1-87c28b0be0d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:52.285678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-49791f47-cb2a-4b70-a36f-92ccf673aa8a None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:52.294741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49791f47-cb2a-4b70-a36f-92ccf673aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:52.335163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1829550466c74d62892f071021d528ea', 'request_id': 'req-baa0789a-1e78-4958-80e1-87c28b0be0d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:52.344126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:52.348922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1829550466c74d62892f071021d528ea', 'request_id': 'req-baa0789a-1e78-4958-80e1-87c28b0be0d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:52.378544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] The token cache is being invalidate because project 1829550466c74d62892f071021d528ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:52.378917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:52.379576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-baa0789a-1e78-4958-80e1-87c28b0be0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:52.382337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1737/3484] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:52 2022] DELETE /identity/v3/projects/1829550466c74d62892f071021d528ea => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:52.392872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.393170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.393419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.460979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1748/3485] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:52.463919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:52.471577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:52.639122 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1738/3486] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:52.646986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.650249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.650249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.734757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:52.741284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:52.763624 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1749/3487] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:52.770957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:52.810227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25489f13-ac0a-4291-8fcf-27a3bb19346e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:52.818742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:52.819427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.820241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.820519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.821361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:52.821665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:52.823490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:52.834705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:52.839313 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1739/3488] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:28:52.843772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:52.868811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab4b7a-a404-4b54-9631-4e06827c998e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:52.883331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:52.884732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:52.885487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:52.885981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:52.886787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:52.892795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:53.000123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1750/3489] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:52 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:53.004009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:53.019993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841ca2a-3e04-4b2c-8014-f752fec696e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:53.211091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:53.212006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:53.212440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:53.212998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:53.213946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:53.216306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:53.312776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1740/3490] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:53 2022] POST /identity/v3/users => generated 280 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:53.316887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:53.330347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8ae8-aaf0-472e-bcc5-7eb04777d3dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:53.339401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:53.340032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:53.340322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:53.340599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:53.343409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:53.364508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:53.406277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:53.406667 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1751/3491] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:53.463058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc347e20-3896-4f32-b7b2-9f3d1e554a59 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:53.477403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:53.478028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:53.478310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:53.478580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:53.479329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:53.486307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47958827-d9c2-4baf-9646-158b0776a91d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:53.538364 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1741/3492] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:53.542762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:53.563122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10504a-a9a9-4f49-a6ef-47a0df8fb19a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:53.572184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:53.573131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:53.573577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:53.574004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] PATH_INFO: `/v3/projects/5bf075ce78bf4b9c92ac43600ea5e010/users/bf74f466780448de8d7974af1b662d7a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:53.604824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf075ce78bf4b9c92ac43600ea5e010, user_id=bf74f466780448de8d7974af1b662d7a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:53.608922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:53.700266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1752/3493] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:53 2022] PUT /identity/v3/projects/5bf075ce78bf4b9c92ac43600ea5e010/users/bf74f466780448de8d7974af1b662d7a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:53.718022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:53.718332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:53.718902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:53.803470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] MFA Rules not processed for user `bf74f466780448de8d7974af1b662d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:53.813867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:53.985172 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1742/3494] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:55.057840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:55.059690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:55.139932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2302d5e-c88d-4a6c-a0c1-c711b93af35c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:55.146902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:55.147532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:55.147816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:55.148336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:55.158830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:55.160959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5e36d-5384-4b3c-803f-4e432818af32 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:55.189920 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1753/3495] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:55.243055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:55.509753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d88b-debe-450d-9f61-ec3252353bf0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:55.542161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:55.542941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:55.543287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:55.543627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] PATH_INFO: `/v3/users/bf74f466780448de8d7974af1b662d7a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:55.545631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf74f466780448de8d7974af1b662d7a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:55.553509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:55.610450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:55.876926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf74f466780448de8d7974af1b662d7a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:55.882826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf74f466780448de8d7974af1b662d7a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:56.015017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf74f466780448de8d7974af1b662d7a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:56.043752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf74f466780448de8d7974af1b662d7a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:56.046348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf74f466780448de8d7974af1b662d7a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:56.088455 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1743/3496] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:55 2022] DELETE /identity/v3/users/bf74f466780448de8d7974af1b662d7a => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:56.089779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:56.090698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:56.091191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:56.170727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:56.180036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:56.326647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:56.387577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1754/3497] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:56.438279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:56.440686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:56.596760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574763a-2b28-4a34-a681-97be49cf9a58 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:56.609405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:56.613944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:56.616532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:56.617091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:56.637793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:56.639575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664e1d2-9c57-405f-b51b-ab908007a164 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:56.663263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1744/3498] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:28:58.187891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:58.191256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:58.205754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce09ff9-2b4a-4242-9625-72a57364015e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:58.214812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:58.215772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:58.218980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:58.218980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] PATH_INFO: `/v3/projects/5bf075ce78bf4b9c92ac43600ea5e010` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:58.218980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf075ce78bf4b9c92ac43600ea5e010)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:58.220487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:58.456176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf075ce78bf4b9c92ac43600ea5e010', 'request_id': 'req-948c6c26-9cfc-4095-930a-5ffcef74d313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:58.568987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf075ce78bf4b9c92ac43600ea5e010', 'request_id': 'req-948c6c26-9cfc-4095-930a-5ffcef74d313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:58.581875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf075ce78bf4b9c92ac43600ea5e010', 'request_id': 'req-948c6c26-9cfc-4095-930a-5ffcef74d313'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:58.641830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] The token cache is being invalidate because project 5bf075ce78bf4b9c92ac43600ea5e010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:28:58.643511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:58.648716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-948c6c26-9cfc-4095-930a-5ffcef74d313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:28:58.649679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1755/3499] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:28:58 2022] DELETE /identity/v3/projects/5bf075ce78bf4b9c92ac43600ea5e010 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:58.652857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:58.653313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:58.654393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:58.723634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:58.724888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:58.805700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1745/3500] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:58.815043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:58.815652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:58.816140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:58.839216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:58.852788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:58.871900 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1756/3501] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:58.877540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:58.896060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb8035-04fa-44e7-9d22-75b82d3b3d6a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:58.911209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:58.912555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:58.912969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:58.913373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:58.914167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:28:58.914911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:58.916780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:58.939068 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1746/3502] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:28:58.945816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:58.958539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01051170-c1a5-4ef1-a827-ac378e5eefbd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:58.966975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:58.969364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:58.969364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:58.970195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:58.970934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:58.972848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.106131 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1757/3503] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:59.111688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.126019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96025-6717-4e58-aa24-b925d59ae517 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.169252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:59.243717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.244388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.244670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.244988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.245629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.251318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.375103 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1747/3504] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:28:59 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:28:59.391133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.403940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f07ed-664a-4353-9a4b-86de181c9ffb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.410040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.410979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.411259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.411530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.412322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.413877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.434649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.438771 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1758/3505] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:59.444340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9719d-980f-48f6-bde4-d54cf91b51ec admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.449781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.450480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.450844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.451178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.452491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.455137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bcc27-38d6-4e96-b7fd-7178fab0ef11 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.468046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1748/3506] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:28:59.472356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.482720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1c6c-ef84-4044-8451-582ef8290aa7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.488362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.489044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.489319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.490460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] PATH_INFO: `/v3/projects/43da78e418a64ac6839d09f984ff9bdd/users/8667041b511a4ab3a6e93645f23ccc47/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.509064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43da78e418a64ac6839d09f984ff9bdd, user_id=8667041b511a4ab3a6e93645f23ccc47, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.511552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.609227 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1759/3507] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:28:59 2022] PUT /identity/v3/projects/43da78e418a64ac6839d09f984ff9bdd/users/8667041b511a4ab3a6e93645f23ccc47/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:28:59.614236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.614522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.614817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.641664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:28:59.642705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:59.732504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.734769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:59.800471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1749/3508] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:28:59.815744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:28:59.817275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:28:59.825151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dfa07-7959-45a9-89b1-123ec1df9d1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.832095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.832733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.833005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.833415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] PATH_INFO: `/v3/users/ef9efadc68004076b546fcdca3c55995` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.834425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9efadc68004076b546fcdca3c55995)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.836404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.844128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:28:59.888843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7284-df27-4b13-a60c-5c47c1f928b3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:28:59.893399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:28:59.896557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:28:59.896557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:28:59.896557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:28:59.908732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:28:59.910224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b3bb-59ae-4862-90b5-297d6460040f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:28:59.925385 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1750/3509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:00.058747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9efadc68004076b546fcdca3c55995'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:00.059710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9efadc68004076b546fcdca3c55995'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:00.134351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9efadc68004076b546fcdca3c55995'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:00.155652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9efadc68004076b546fcdca3c55995'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:00.157362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9efadc68004076b546fcdca3c55995'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:00.172669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1760/3510] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:28:59 2022] DELETE /identity/v3/users/ef9efadc68004076b546fcdca3c55995 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:00.177253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da35b0-51fd-4223-8a71-cf7bdedb28da None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:00.179719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da35b0-51fd-4223-8a71-cf7bdedb28da None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:00.180067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da35b0-51fd-4223-8a71-cf7bdedb28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:00.210247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-49da35b0-51fd-4223-8a71-cf7bdedb28da None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:00.211693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-49da35b0-51fd-4223-8a71-cf7bdedb28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:00.247350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:00.276166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1751/3511] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:00.287066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:00.290264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:00.480807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b057-44a2-42a6-bf68-27e93d86cdf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:00.484695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:00.485371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:00.486719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:00.486719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:00.512182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:00.516552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:00.539831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1761/3512] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:01.829860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:01.831012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:01.831442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:01.857869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:01.859119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:01.929278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1752/3513] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:01.949552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:01.949552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:01.986900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:01.988495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:02.006799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e234b-93c9-4e63-a826-3f05127990c2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:02.015202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:02.016283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:02.017704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:02.017704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] PATH_INFO: `/v3/projects/6ca78d13ae6f4db4b955a5d0837540ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:02.018652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca78d13ae6f4db4b955a5d0837540ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:02.021765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:02.104171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c9f8-17e9-435c-841c-2580fe3f436c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:02.118088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:02.119116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:02.120226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:02.120565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:02.134984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:02.136991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:02.154454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1762/3514] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:02.170358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca78d13ae6f4db4b955a5d0837540ce', 'request_id': 'req-280a7706-0a30-4e8a-8036-64d4d3f44d5b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.277195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca78d13ae6f4db4b955a5d0837540ce', 'request_id': 'req-280a7706-0a30-4e8a-8036-64d4d3f44d5b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.284452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca78d13ae6f4db4b955a5d0837540ce', 'request_id': 'req-280a7706-0a30-4e8a-8036-64d4d3f44d5b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.311678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] The token cache is being invalidate because project 6ca78d13ae6f4db4b955a5d0837540ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:02.312189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.313268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.316558 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1753/3515] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:01 2022] DELETE /identity/v3/projects/6ca78d13ae6f4db4b955a5d0837540ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:02.321107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:02.336828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71f90-310e-40d9-993d-71d684e8fc42 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:02.390916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:02.465790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:02.466474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:02.466714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:02.466989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] PATH_INFO: `/v3/users/cd00add912e84bdd99b3d7c788ef19d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:02.471682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd00add912e84bdd99b3d7c788ef19d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:02.475710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:02.741605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd00add912e84bdd99b3d7c788ef19d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.743052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd00add912e84bdd99b3d7c788ef19d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:02.950687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd00add912e84bdd99b3d7c788ef19d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:03.011163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd00add912e84bdd99b3d7c788ef19d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:03.013911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cae44472-4fba-42fe-b3a9-bfe483f41c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd00add912e84bdd99b3d7c788ef19d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:03.046149 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1763/3516] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:02 2022] DELETE /identity/v3/users/cd00add912e84bdd99b3d7c788ef19d1 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:03.812838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:03.815147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:03.859293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a7706-0a30-4e8a-8036-64d4d3f44d5b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:03.897485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:03.897889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:03.898288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:03.961156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:03.962261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:03.962261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:03.962261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:03.962261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] PATH_INFO: `/v3/projects/f445923021e24cdda31f42d41fef6590` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:03.962566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:03.962886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f445923021e24cdda31f42d41fef6590)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:03.978121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:04.010253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:04.100034 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1764/3517] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:04.101268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:04.102941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:04.195723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f445923021e24cdda31f42d41fef6590', 'request_id': 'req-1713d470-6b7b-4c8a-9422-1701644c2d28'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:04.217548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c591e8-b989-4464-b377-26487d5c1325 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:04.294836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f445923021e24cdda31f42d41fef6590', 'request_id': 'req-1713d470-6b7b-4c8a-9422-1701644c2d28'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:04.311893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:04.321362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f445923021e24cdda31f42d41fef6590', 'request_id': 'req-1713d470-6b7b-4c8a-9422-1701644c2d28'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:04.339996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] The token cache is being invalidate because project f445923021e24cdda31f42d41fef6590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:04.340659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:04.341586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1713d470-6b7b-4c8a-9422-1701644c2d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:04.344362 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1754/3518] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:03 2022] DELETE /identity/v3/projects/f445923021e24cdda31f42d41fef6590 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:04.349095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.354710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.354710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.372267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:04.372819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.373100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.373376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.375450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:04.392387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:04.394217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:04.511450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:04.516316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ca42c-d473-44f1-aca6-753eeffe03e8 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:04.537339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1765/3519] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:04.555299 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1755/3520] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:04.564468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.572238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.572238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.591976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:04.601423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:04.616721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:04.625365 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1766/3521] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:04.629121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23458-25ec-497f-b666-e1a92cee1040 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:04.634570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:04.635561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.635918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.636265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.637000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:04.637377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:04.639263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:04.656900 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1756/3522] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:04.660457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:04.670236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154458b1-54df-43f4-bc88-c104807e2833 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:04.675065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:04.675664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.675941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.676209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.676832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:04.679311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:04.848213 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1767/3523] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:04 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:04.852933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:04.884502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30ceb8-2659-4219-9d96-fde58e73bd2a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:04.894058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:04.897266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:04.984968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:04.985879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:04.986317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:04.986781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:04.987584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:04.991181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.011296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de7d7-b570-464b-971a-ca74d109b5a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.016010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.017172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.017634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.017888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.020417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:05.045581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.047110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.069270 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1768/3524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:05.131060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:05.137970 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1757/3525] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:04 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:05.152122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3be0c-6c06-4fdc-91c8-a4c14688cde2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.170797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.172226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.172848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.173337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.179407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.181537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.196727 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1769/3526] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:05.200515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:05.219768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5e40-abb2-4780-a897-8077a9120ab7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.229179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.230392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.230860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.231284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.232667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.237521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5cdc4-f511-44c8-922c-ed0b540b5722 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.259414 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1758/3527] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:05.263656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:05.273380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9152-6d9e-4718-818b-46e863c98684 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.280143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.280957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.282174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.283011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] PATH_INFO: `/v3/projects/50c69e2f67094d97b9430e675c13381c/users/a618d3fcae3c4252826fd3f8a1cf5201/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.309955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c69e2f67094d97b9430e675c13381c, user_id=a618d3fcae3c4252826fd3f8a1cf5201, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.314893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.482665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1770/3528] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:05 2022] PUT /identity/v3/projects/50c69e2f67094d97b9430e675c13381c/users/a618d3fcae3c4252826fd3f8a1cf5201/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:05.490666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.491368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.491655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.538808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] MFA Rules not processed for user `a618d3fcae3c4252826fd3f8a1cf5201`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:05.540358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:05.566264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:05.568945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:05.700555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb729-6782-4c83-b440-a9b2ffcfd64a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.718845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.719437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.719717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.719991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] PATH_INFO: `/v3/users/c3e1daec3443449b871a1d15b9cccb21` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.728121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1759/3529] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:05.729391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:05.730859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e1daec3443449b871a1d15b9cccb21)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.732823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.751757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74af94-9970-48ea-a72b-32832b50f5de None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:05.764553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:05.765252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:05.765463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:05.765737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:05.766382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:05.768391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:05.898813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1760/3530] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:05 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:05.899886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.006357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e1daec3443449b871a1d15b9cccb21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:06.007071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e1daec3443449b871a1d15b9cccb21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:06.037832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6945-654a-44f6-b79a-5c1e2ca2a372 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.045124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.045938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.046368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.047555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.048231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.050237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce46cb-2bca-4500-99dc-ea27dc0b52de admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.081856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e1daec3443449b871a1d15b9cccb21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:06.110637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e1daec3443449b871a1d15b9cccb21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:06.111109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36410a3b-fefc-4ea9-ab26-554d1f4e664b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e1daec3443449b871a1d15b9cccb21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:06.129246 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1771/3531] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:05 2022] DELETE /identity/v3/users/c3e1daec3443449b871a1d15b9cccb21 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:06.131495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.132079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.132734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.164009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1761/3532] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:05 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:29:06.166015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.166296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.166563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.191215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:06.200871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:06.207888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:06.209409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:06.298269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1772/3533] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:06.299503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.300794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:06.365588 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1762/3534] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:06.365588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.365588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:06.432950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a0703-c354-4662-b348-c1c64687991f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.438902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.439682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.439969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.440266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.440878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.444052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.457884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1773/3535] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:06.464066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.469105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:06.531292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b22bb-7580-483a-9100-f54d78aaa3e8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.543441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.544240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fefc5a-020f-4b35-8787-f78c6aa46274 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.545424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.545424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.545721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.552679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.553431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.555073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.555073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.562040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.563669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.565300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.567103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.579261 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1763/3537] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:06.579586 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1774/3537] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:06.579978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.610165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1c5a3-07c0-439e-87ce-c1169ce42da1 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.615838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.616609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.616951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.617601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] PATH_INFO: `/v3/projects/e576dcfd62d64a2badec7a24109dc93c/users/25dc237695e8401c8a35a9c5e204dea5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.640122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e576dcfd62d64a2badec7a24109dc93c, user_id=25dc237695e8401c8a35a9c5e204dea5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.645319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.820874 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1764/3538] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:06 2022] PUT /identity/v3/projects/e576dcfd62d64a2badec7a24109dc93c/users/25dc237695e8401c8a35a9c5e204dea5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:06.823067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:06.842884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd3c8-733d-4b4e-bbc7-bef79b650cbe service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:06.904387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:06.965958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:06.966965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:06.967431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:06.967913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:06.968761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:06.971655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65695e92-4a2c-4ec0-9b3d-13f08ce50c0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:06.984478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1775/3539] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:06.988684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:07.005155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a012-b23b-45c5-b5fa-4cd9eae65865 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:07.011927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:07.013193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:07.014760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:07.015249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] PATH_INFO: `/v3/projects/e576dcfd62d64a2badec7a24109dc93c/users/25dc237695e8401c8a35a9c5e204dea5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:07.018219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e576dcfd62d64a2badec7a24109dc93c, user_id=25dc237695e8401c8a35a9c5e204dea5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:07.022289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:07.054944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:07.072861 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1765/3540] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:06 2022] PUT /identity/v3/projects/e576dcfd62d64a2badec7a24109dc93c/users/25dc237695e8401c8a35a9c5e204dea5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:07.075052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:07.075412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:07.075909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:07.113091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] MFA Rules not processed for user `25dc237695e8401c8a35a9c5e204dea5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:07.115627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:07.212897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1776/3541] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:07.222019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:07.223919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:07.297203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1755-b470-4d75-966e-5168a4a17956 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:07.301617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:07.302489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:07.302951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:07.303553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:07.314383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:07.317138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:07.340686 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1766/3542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:07.639701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:07.690054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:07.691390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:07.752568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa767a-96fc-40c6-b2bd-198a1a6184d4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:07.765934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:07.766600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:07.766907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:07.767182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] PATH_INFO: `/v3/users/a618d3fcae3c4252826fd3f8a1cf5201` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:07.772122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a618d3fcae3c4252826fd3f8a1cf5201)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:07.779687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:07.864040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbbdec-7053-4b47-b60b-0e2f9c12bb93 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:07.872977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:07.873687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:07.873975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:07.874253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] PATH_INFO: `/v3/projects/bf06c5c1d8be48a081f00abee2c6d38e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:07.875967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf06c5c1d8be48a081f00abee2c6d38e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:07.878065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:08.077200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf06c5c1d8be48a081f00abee2c6d38e', 'request_id': 'req-dc586a66-f2fb-44e1-8945-b6de85a794ff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.086403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a618d3fcae3c4252826fd3f8a1cf5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.118108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a618d3fcae3c4252826fd3f8a1cf5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.210821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf06c5c1d8be48a081f00abee2c6d38e', 'request_id': 'req-dc586a66-f2fb-44e1-8945-b6de85a794ff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.233244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf06c5c1d8be48a081f00abee2c6d38e', 'request_id': 'req-dc586a66-f2fb-44e1-8945-b6de85a794ff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.255068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] The token cache is being invalidate because project bf06c5c1d8be48a081f00abee2c6d38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:08.259186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.259186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.260206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1767/3543] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:07 2022] DELETE /identity/v3/projects/bf06c5c1d8be48a081f00abee2c6d38e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:08.264912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:08.268365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:08.310830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a618d3fcae3c4252826fd3f8a1cf5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.332914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a618d3fcae3c4252826fd3f8a1cf5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.335166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dbc2251-d50f-4d1f-89bb-480aa8d07470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a618d3fcae3c4252826fd3f8a1cf5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.360167 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1777/3544] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:07 2022] DELETE /identity/v3/users/a618d3fcae3c4252826fd3f8a1cf5201 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:08.367573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:08.368850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:08.369286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:08.385621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586a66-f2fb-44e1-8945-b6de85a794ff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:08.436386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:08.444814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:08.454978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:08.471369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:08.472090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:08.472687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:08.472812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] PATH_INFO: `/v3/users/bc28d8e8a2544aa9a43a037f55693954` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:08.475335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc28d8e8a2544aa9a43a037f55693954)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:08.477638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:08.566434 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1778/3545] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:08.574465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:08.575953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:08.681422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a8b2c-b580-4b38-9669-fc2f85b25c8a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:08.689022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:08.690057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:08.691403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:08.691863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:08.706580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:08.708573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:08.709352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc28d8e8a2544aa9a43a037f55693954'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.710665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc28d8e8a2544aa9a43a037f55693954'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.728008 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1779/3546] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:08.777591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:08.808342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc28d8e8a2544aa9a43a037f55693954'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.866465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc28d8e8a2544aa9a43a037f55693954'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.868499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc28d8e8a2544aa9a43a037f55693954'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:08.899905 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1768/3547] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:08 2022] DELETE /identity/v3/users/bc28d8e8a2544aa9a43a037f55693954 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:09.772616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:09.788041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019318a-17d8-4669-bf57-b2f2da274487 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:09.875298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:09.879678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:09.889741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:09.928779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:09.929706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:09.930177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:09.930641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] PATH_INFO: `/v3/projects/77cfa96e5ba743a9a28f703aac375414` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:09.933793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cfa96e5ba743a9a28f703aac375414)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:09.941279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:10.044520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7aa49-d4ac-4006-88fd-a5b7e600b654 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:10.066277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:10.067235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.067658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.068651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] PATH_INFO: `/v3/projects/50c69e2f67094d97b9430e675c13381c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.070108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c69e2f67094d97b9430e675c13381c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:10.072398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:10.152526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:10.187184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cfa96e5ba743a9a28f703aac375414', 'request_id': 'req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.295372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cfa96e5ba743a9a28f703aac375414', 'request_id': 'req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.319263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cfa96e5ba743a9a28f703aac375414', 'request_id': 'req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.348694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c69e2f67094d97b9430e675c13381c', 'request_id': 'req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.362846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] The token cache is being invalidate because project 77cfa96e5ba743a9a28f703aac375414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:10.363632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.365453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e53d8c7f-0e39-42aa-af37-7f76e7e11f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.367413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1780/3548] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:09 2022] DELETE /identity/v3/projects/77cfa96e5ba743a9a28f703aac375414 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:10.374036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6957f4-9b4c-4241-9532-179d00f4eeb0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.387128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6957f4-9b4c-4241-9532-179d00f4eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.387421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6957f4-9b4c-4241-9532-179d00f4eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.423333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e6957f4-9b4c-4241-9532-179d00f4eeb0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:10.424513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e6957f4-9b4c-4241-9532-179d00f4eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:10.507022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c69e2f67094d97b9430e675c13381c', 'request_id': 'req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.516028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c69e2f67094d97b9430e675c13381c', 'request_id': 'req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.531663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] The token cache is being invalidate because project 50c69e2f67094d97b9430e675c13381c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:10.533215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.534894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.537619 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1769/3549] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:09 2022] DELETE /identity/v3/projects/50c69e2f67094d97b9430e675c13381c => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:10.541644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1781/3550] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:10.544561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:10.546916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:10.554483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.555024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.560891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.572951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34baa0-b88e-4efa-9a4c-3a302eda95fd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:10.579908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:10.582471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.582471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.582471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] PATH_INFO: `/v3/users/25dc237695e8401c8a35a9c5e204dea5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.583174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dc237695e8401c8a35a9c5e204dea5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:10.586440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:10.592181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:10.593569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:10.615630 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1782/3551] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:10.619663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:10.649680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc2a8f-d76c-48a0-9250-129453651543 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:10.656629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:10.656629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.656824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.657077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.657745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:10.658121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:10.659821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:10.685641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1783/3552] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:10.691943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:10.729720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56089-279b-45ed-8d25-10830af0511a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:10.738040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:10.749310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:10.749823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:10.751611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:10.752586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:10.764792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:10.778975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:10.876008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dc237695e8401c8a35a9c5e204dea5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.877434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dc237695e8401c8a35a9c5e204dea5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.935815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1784/3553] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:10 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:10.939037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:10.944015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:10.960795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dc237695e8401c8a35a9c5e204dea5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.994729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dc237695e8401c8a35a9c5e204dea5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:10.995728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dc237695e8401c8a35a9c5e204dea5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:11.012284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:11.033061 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1770/3554] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:10 2022] DELETE /identity/v3/users/25dc237695e8401c8a35a9c5e204dea5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:11.109219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bde81-b413-4f46-b029-675c16cc7897 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:11.204574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:11.205312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:11.205594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:11.205862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:11.206697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:11.209393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:11.335419 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1785/3555] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:10 2022] POST /identity/v3/users => generated 290 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:11.338048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:11.351290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c16007-8c2b-4e98-aa3c-fbde888648b4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:11.376552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:11.376552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:11.376552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:11.376552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:11.376975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:11.376975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:11.396532 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1771/3556] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:11.402041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:11.413086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2e7de-bd78-4847-975f-7a38c6c5d4bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:11.426441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:11.428357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:11.428357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:11.428357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:11.428942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:11.431820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473895b7-f198-47c4-8572-e827c7e491c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:11.454419 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1786/3557] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:11.462316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:11.535571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0a9e-dd1c-4b88-92f7-cdea6e33555a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:11.549021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:11.552685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:11.554923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:11.556747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] PATH_INFO: `/v3/projects/c3f8ad03eaf747fa951b2a7772bf1237/users/c1fe63f8f6344791a63c9a308fe20162/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:11.613991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8ad03eaf747fa951b2a7772bf1237, user_id=c1fe63f8f6344791a63c9a308fe20162, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:11.638804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:11.764448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1772/3558] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:11 2022] PUT /identity/v3/projects/c3f8ad03eaf747fa951b2a7772bf1237/users/c1fe63f8f6344791a63c9a308fe20162/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:11.780785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:11.781247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:11.781338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:11.835764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] MFA Rules not processed for user `c1fe63f8f6344791a63c9a308fe20162`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:11.837060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:11.954754 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1787/3559] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:11.959158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:11.969438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:12.043792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a42da-c669-4b14-b91d-ae2aebd4fa5f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:12.047237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:12.056071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:12.057147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.063127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.063434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:12.064125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:12.066083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:12.264350 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1773/3560] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:11 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:29:12.272645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:12.294944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fd9c0-842c-44ce-b766-b351824bc929 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:12.428657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:12.429876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.430156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.430429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:12.431769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:12.433733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:12.461255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:12.463328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:12.490012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05b523-c81f-48b4-8e79-e2e9f09aa30b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:12.499342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:12.505976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.506376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.506775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] PATH_INFO: `/v3/projects/e576dcfd62d64a2badec7a24109dc93c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:12.508478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e576dcfd62d64a2badec7a24109dc93c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:12.511662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:12.709812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e576dcfd62d64a2badec7a24109dc93c', 'request_id': 'req-e71ef23f-a91e-47f5-a467-22d99fbcdef9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:12.778848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1788/3561] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:12 2022] POST /identity/v3/users => generated 295 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:12.780193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:12.829571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc4cee-6eb7-4741-95a5-fca21dbc9264 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:12.832907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e576dcfd62d64a2badec7a24109dc93c', 'request_id': 'req-e71ef23f-a91e-47f5-a467-22d99fbcdef9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:12.853000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e576dcfd62d64a2badec7a24109dc93c', 'request_id': 'req-e71ef23f-a91e-47f5-a467-22d99fbcdef9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:12.892958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] The token cache is being invalidate because project e576dcfd62d64a2badec7a24109dc93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:12.893489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:12.905722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e71ef23f-a91e-47f5-a467-22d99fbcdef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:12.919788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1774/3562] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:12 2022] DELETE /identity/v3/projects/e576dcfd62d64a2badec7a24109dc93c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:12.921817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4da32-ab41-41ed-935c-271c1178fdb0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.922106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4da32-ab41-41ed-935c-271c1178fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.922548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4da32-ab41-41ed-935c-271c1178fdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:12.954065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:12.955083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.955552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.956051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:12.957025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:12.960300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8851bc8-ec41-43ac-8b3d-f51128657892 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:12.974928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d3c4da32-ab41-41ed-935c-271c1178fdb0 None None] MFA Rules not processed for user `8667041b511a4ab3a6e93645f23ccc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:12.979515 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1789/3563] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:12.980818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d3c4da32-ab41-41ed-935c-271c1178fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:12.981992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:12.982454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:12.983015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.014142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:13.015469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.029049 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1790/3564] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:13.031345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.034403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.062751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e42f2-bdc6-4db4-adb1-eaeb241d9c88 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.069228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.070251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.071113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.071540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] PATH_INFO: `/v3/projects/d35c542737da4174b344962cbc641614/users/b84cc4aef76e4b9987856ba432254c92/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.097609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35c542737da4174b344962cbc641614, user_id=b84cc4aef76e4b9987856ba432254c92, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.108532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.146410 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1775/3565] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:13.150361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.150361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.150361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.183121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:13.184363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.194218 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1776/3566] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:13.195458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.196976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.242107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1791/3567] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:13 2022] PUT /identity/v3/projects/d35c542737da4174b344962cbc641614/users/b84cc4aef76e4b9987856ba432254c92/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:13.246371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.276195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e18c6-d499-47c1-b93b-b76b7aa07e8f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.382932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.383718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.384091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.384469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.384599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5724391-db04-49c9-b1df-5dfef679ac49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.406862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.406862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.406862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.406862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.407423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:13.407423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.412432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.455096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1792/3568] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:13.456105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.499266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536038-b505-4918-9e1b-12610006a50e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.529991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.530786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.531211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.531594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.532151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.533880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.559810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.561486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.577051 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1793/3569] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:13.577906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.582256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1777/3570] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:13.584022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.608755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c5b9f-1a62-46e0-8ccd-a4e7701a93f3 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.609035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed6cd9-5eec-423d-beb3-ded21ad9a063 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.613919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:13.620492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.621132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.621402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.621530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.621675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.622313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.623087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.624104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.625189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] PATH_INFO: `/v3/projects/d35c542737da4174b344962cbc641614/users/b84cc4aef76e4b9987856ba432254c92/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.626303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.631565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35c542737da4174b344962cbc641614, user_id=b84cc4aef76e4b9987856ba432254c92, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.634747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772aba5-748f-4157-b0e4-d615365e1084 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:13.661512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:13.676303 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1778/3571] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:13 2022] PUT /identity/v3/projects/d35c542737da4174b344962cbc641614/users/b84cc4aef76e4b9987856ba432254c92/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:13.678583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.679014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.679441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.753052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] MFA Rules not processed for user `b84cc4aef76e4b9987856ba432254c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:13.758961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.766219 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1794/3572] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:13 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:13.770364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.945035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1779/3573] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:13.960836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:13.961823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:13.966667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fa82-9b80-4212-91db-b3e7158b74d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:13.973107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:13.974602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:13.975258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:13.975677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:13.976810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:13.979131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:14.075825 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1795/3574] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:13 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:29:14.079773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:14.101295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4ec6f-c1af-4b3d-af33-b94a36685c6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:14.117164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:14.118539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447382a-d259-4d0d-a4fc-54e87efd0558 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:14.119113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.120387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.121356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.123448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:14.129149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:14.180269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1796/3575] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:14.181496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:14.194653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3bdb-e348-40e0-93b8-53167733067d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:14.200741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:14.201627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.202038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.202419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.203246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:14.205119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:14.227200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1797/3576] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:14.228396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:14.241264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68eabd-0a22-4c07-b2cc-06a5ea82b4f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:14.258391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:14.261645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.261927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.262205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.269382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:14.270299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.272407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.272864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] PATH_INFO: `/v3/projects/48ce30f1e687471e9a787a79a42736cc/users/d4501eb36ebb412884c0f13c94ce6a4f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.310925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ce30f1e687471e9a787a79a42736cc, user_id=d4501eb36ebb412884c0f13c94ce6a4f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:14.316277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425a5d-0a64-4f2f-bc01-2429b1a808d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:14.381963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:14.383525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:14.400268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1798/3577] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:14 2022] PUT /identity/v3/projects/48ce30f1e687471e9a787a79a42736cc/users/d4501eb36ebb412884c0f13c94ce6a4f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:14.414111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1780/3578] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:14.422767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.423086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.423333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.518586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] MFA Rules not processed for user `d4501eb36ebb412884c0f13c94ce6a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:14.525759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:14.728662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1799/3579] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:14.733964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:14.761900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e579-9195-4a59-aca1-4db7896b142f service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:14.830712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:14.967311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:14.967947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:14.968228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:14.968501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:14.969424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:14.972484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.001213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c34e9-7e94-4d9f-9ae2-178f9efdab97 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.009897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.010059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.010402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.010762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] PATH_INFO: `/v3/users/c1fe63f8f6344791a63c9a308fe20162` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.014415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fe63f8f6344791a63c9a308fe20162)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.018757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.032283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:15.108843 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1781/3580] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:14 2022] POST /identity/v3/projects => generated 377 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:15.113389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.244682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeec995-1bed-47ac-9456-a2d56f3561ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.250533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.251405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.251760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.252257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.253227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.256747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.268811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fe63f8f6344791a63c9a308fe20162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.269177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fe63f8f6344791a63c9a308fe20162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.369254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fe63f8f6344791a63c9a308fe20162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.383762 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1782/3581] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:15 2022] POST /identity/v3/users => generated 295 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:15.386878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.393002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:15.409052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fe63f8f6344791a63c9a308fe20162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.412583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fe63f8f6344791a63c9a308fe20162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.418501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5ae7-1b82-4cdd-8012-4d8c37956077 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.424331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.425098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.425450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.425799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] PATH_INFO: `/v3/users/cba1c08f53b14729adf893683ccec5a2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.427325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba1c08f53b14729adf893683ccec5a2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.429510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.435271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1800/3582] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:14 2022] DELETE /identity/v3/users/c1fe63f8f6344791a63c9a308fe20162 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:15.436519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.440441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:15.531854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284243-cd71-4acc-b99f-2ef07a67ce45 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.538807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.545925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.545925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.545925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.545925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.545925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158d6b6-0390-4920-8eb0-0dd122e3e209 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.565658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1801/3583] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:15.567036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.567320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.568114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.591017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:15.591017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:15.604475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1802/3584] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:15.604475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.614968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302d17-8e32-4274-ac9e-5805b6a031e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.622052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.622864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.623078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.623394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] PATH_INFO: `/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6/users/e2b9e8b05a564658bccb939fb0e68577/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.660519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5554f3a1b304f7d843b4c4ef69a04b6, user_id=e2b9e8b05a564658bccb939fb0e68577, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.680541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.687864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba1c08f53b14729adf893683ccec5a2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.687864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba1c08f53b14729adf893683ccec5a2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.765562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba1c08f53b14729adf893683ccec5a2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.774064 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1803/3585] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:15 2022] PUT /identity/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6/users/e2b9e8b05a564658bccb939fb0e68577/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:15.774935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.784438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:15.786533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba1c08f53b14729adf893683ccec5a2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.790719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba1c08f53b14729adf893683ccec5a2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:15.824471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1783/3586] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:15 2022] DELETE /identity/v3/users/cba1c08f53b14729adf893683ccec5a2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:15.825419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:15.826863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:15.908053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d61-08db-4582-83be-f215f03c6973 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.931110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:15.935749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72de71-be66-4900-a127-7b4e968d5d15 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:15.943361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:15.944159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:15.944562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:15.944906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:15.945755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:15.947637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:15.970837 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1784/3587] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:15.972129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:16.003035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96471f0-3fab-4111-8c63-338cee0e44c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:16.011564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:16.015383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:16.015710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:16.016564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:16.017015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:16.019216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:16.019701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:16.021268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] PATH_INFO: `/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6/users/e2b9e8b05a564658bccb939fb0e68577/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:16.023780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:16.027685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5554f3a1b304f7d843b4c4ef69a04b6, user_id=e2b9e8b05a564658bccb939fb0e68577, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:16.030967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daa563-9008-4a1b-b363-e38efd949589 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:16.052379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:16.053752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:16.057495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1785/3588] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:15 2022] PUT /identity/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6/users/e2b9e8b05a564658bccb939fb0e68577/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:16.060456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:16.061154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:16.061895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:16.081185 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1804/3589] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:16.129036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] MFA Rules not processed for user `e2b9e8b05a564658bccb939fb0e68577`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:16.133137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:16.417106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1786/3590] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:16.429532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:16.431126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:16.503823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:16.506016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:16.641879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414228bd-887b-42fc-aa3c-d268175caa4d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:16.731720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29ca3-23cf-4452-bb51-739077365787 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:16.743104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:16.743761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:16.744031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:16.744298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] PATH_INFO: `/v3/projects/e07ae5405c0b492f824759456fdca7b7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:16.748777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07ae5405c0b492f824759456fdca7b7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:16.750740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:16.800761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:16.803713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:16.804206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:16.804704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:16.812900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:16.855314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:16.924502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07ae5405c0b492f824759456fdca7b7', 'request_id': 'req-7a95fa1b-497d-430d-ba56-547a60879e77'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:16.938792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:16.940996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed78519-c9eb-4451-b099-8c2b9f242f96 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:16.957302 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1805/3591] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:17.031903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07ae5405c0b492f824759456fdca7b7', 'request_id': 'req-7a95fa1b-497d-430d-ba56-547a60879e77'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:17.045304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07ae5405c0b492f824759456fdca7b7', 'request_id': 'req-7a95fa1b-497d-430d-ba56-547a60879e77'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:17.072629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] The token cache is being invalidate because project e07ae5405c0b492f824759456fdca7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:17.073294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:17.076324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a95fa1b-497d-430d-ba56-547a60879e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:17.084527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1787/3592] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:16 2022] DELETE /identity/v3/projects/e07ae5405c0b492f824759456fdca7b7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:17.089781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.090307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.090514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.142972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:17.150559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:17.284884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1806/3593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:17.293367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.293894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.294275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.316707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:17.318395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:17.329956 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1788/3594] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:17.332372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:17.347245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08b4ce-842c-43aa-9c3d-9927ca8817be None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:17.353524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:17.358996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:17.371942 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1807/3595] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:29:17.376154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:17.386559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14d1ab-4f34-4b30-b6f9-6b6d281209df None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:17.394710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:17.395626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.396085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.396527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.397348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:17.399673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:17.540164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:17.543335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:17.556848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1789/3596] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:17 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:17.561546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:17.581381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3bd9-7e60-480c-bb8d-4542dda6cb97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:17.746167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:17.747186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.747687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.748922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] PATH_INFO: `/v3/projects/c3f8ad03eaf747fa951b2a7772bf1237` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.750429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8ad03eaf747fa951b2a7772bf1237)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:17.752801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:17.793699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd9e3-8b65-424e-9a98-72295e8b5931 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:17.806018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:17.806686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:17.807012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:17.807280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:17.807912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:17.809944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:17.956863 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1790/3597] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:17 2022] POST /identity/v3/users => generated 290 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:17.959353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:17.972261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac105-0d8b-40ce-8b32-6b5123021dde admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:17.985596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8ad03eaf747fa951b2a7772bf1237', 'request_id': 'req-f25f865f-57c8-4432-ba57-beebdaf2e377'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.144061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:18.144981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.146219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.146881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.147993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:18.151273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:18.163686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8ad03eaf747fa951b2a7772bf1237', 'request_id': 'req-f25f865f-57c8-4432-ba57-beebdaf2e377'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.173088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8ad03eaf747fa951b2a7772bf1237', 'request_id': 'req-f25f865f-57c8-4432-ba57-beebdaf2e377'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.178708 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1791/3598] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:18.188997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:18.201756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] The token cache is being invalidate because project c3f8ad03eaf747fa951b2a7772bf1237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:18.202337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.203209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f25f865f-57c8-4432-ba57-beebdaf2e377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.203820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627afa3-0dd4-45c3-b497-fbcc95371dfb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:18.206698 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1808/3599] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:17 2022] DELETE /identity/v3/projects/c3f8ad03eaf747fa951b2a7772bf1237 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:18.216296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:18.217421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.218673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.218962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.220851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:18.223017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.223637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.224196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.226063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:18.254883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] MFA Rules not processed for user `8667041b511a4ab3a6e93645f23ccc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:18.256542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:18.270484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1792/3600] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:18.275723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:18.278010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:18.303035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ef981-7a17-4f33-96e4-5627f7952350 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:18.308920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:18.309593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.315621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.315621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] PATH_INFO: `/v3/users/b84cc4aef76e4b9987856ba432254c92` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.315621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84cc4aef76e4b9987856ba432254c92)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:18.315621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:18.404731 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1809/3601] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:18.405648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:18.409073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:18.448110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249d294-294f-493f-a853-da7da1cfd8f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:18.461273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:18.462344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.462985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.463464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] PATH_INFO: `/v3/projects/347b92c73e4e4feba2748ccade2dd609/users/5400400f5ecc4db28f887ac684c58d16/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.485506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] RBAC: Authorizing `identity:create_grant(project_id=347b92c73e4e4feba2748ccade2dd609, user_id=5400400f5ecc4db28f887ac684c58d16, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:18.488452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd0a7-a1da-4d14-bf1e-2dd7a165275e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:18.613786 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1810/3602] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:18 2022] PUT /identity/v3/projects/347b92c73e4e4feba2748ccade2dd609/users/5400400f5ecc4db28f887ac684c58d16/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:18.619394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:18.620587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:18.621109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:18.641071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84cc4aef76e4b9987856ba432254c92'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.644476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84cc4aef76e4b9987856ba432254c92'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.655285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:18.664122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:18.665577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:18.762756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84cc4aef76e4b9987856ba432254c92'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.785856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84cc4aef76e4b9987856ba432254c92'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.789103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84cc4aef76e4b9987856ba432254c92'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:18.840102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1793/3603] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:18 2022] DELETE /identity/v3/users/b84cc4aef76e4b9987856ba432254c92 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:18.858643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:18.861089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:18.870410 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1811/3604] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:18.882647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:18.884319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:19.055906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa82a-f976-4552-962e-3f15036bd2af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:19.065116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:19.065116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:19.065116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:19.065116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:19.073853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960500-b5c5-4412-b3ae-fa5ca5ff4579 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:19.079357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:19.080279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:19.080627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:19.081143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:19.087566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:19.103576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:19.106256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:19.123358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1794/3605] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:19.196919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:19.198313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67b96c-aca4-4a8e-89d0-43199db38a17 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:19.217741 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1812/3606] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:19.444090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:19.652693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:19.654931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:19.704105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81d6d-841a-47ec-aa93-92ba1e2b80a4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:19.713847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:19.714511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:19.714810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:19.715084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] PATH_INFO: `/v3/projects/d35c542737da4174b344962cbc641614` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:19.718671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35c542737da4174b344962cbc641614)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:19.720625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:19.902791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35c542737da4174b344962cbc641614', 'request_id': 'req-e5598523-e4ed-4606-87fb-562ba6b8926b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:20.007965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35c542737da4174b344962cbc641614', 'request_id': 'req-e5598523-e4ed-4606-87fb-562ba6b8926b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:20.021700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35c542737da4174b344962cbc641614', 'request_id': 'req-e5598523-e4ed-4606-87fb-562ba6b8926b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:20.050457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] The token cache is being invalidate because project d35c542737da4174b344962cbc641614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:20.052720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:20.054232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5598523-e4ed-4606-87fb-562ba6b8926b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:20.059310 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1795/3607] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:19 2022] DELETE /identity/v3/projects/d35c542737da4174b344962cbc641614 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:20.065758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.067024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.067024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.121736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:20.123266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:20.303016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1813/3608] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:20.303720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.303907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.304191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.351650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:20.352648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:20.391261 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1796/3609] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:20.395415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:20.412668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd11f-1b81-4fee-bc03-ae1714c5eb9f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:20.428184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:20.429310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.429691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.430348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.431208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:20.431946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:20.436335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:20.473052 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1814/3610] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:20.477995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:20.495157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cb43-5bbd-402a-9122-442fd9168dc4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:20.509440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:20.535425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.535425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.535425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.535425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:20.546321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:20.571094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:20.679092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1797/3611] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:20 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:20.680290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:20.694856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d075dd-27d5-45e8-a2b5-67a480c689e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:20.804963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:20.805762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.806294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.806712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.807542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:20.809901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:20.889078 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1815/3612] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:20 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:20.893418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:20.906377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29702d-f077-4d01-8235-82024ac588fd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:20.932154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:20.932154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:20.933958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:20.934775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:20.936141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:20.944683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:20.982214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1798/3613] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:20.989650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:21.003170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a804f0-1521-49af-b857-3d80cbd5455a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:21.023078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:21.023711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.023988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.024459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.025267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:21.027070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92307458-fad3-4ebf-b608-a4cb7fd41b14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:21.047779 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1816/3614] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:21.048552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:21.066010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf92bb-e21d-456f-abef-9adcc6a7994f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:21.066010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:21.066010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.066010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.066343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] PATH_INFO: `/v3/projects/2ed28db711b74fb893b21f9f707313d1/users/9b5fde2ee6e6482b905ab53433d970b5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.086131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed28db711b74fb893b21f9f707313d1, user_id=9b5fde2ee6e6482b905ab53433d970b5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:21.089618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:21.229361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.229649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.229929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.232737 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1799/3615] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:21 2022] PUT /identity/v3/projects/2ed28db711b74fb893b21f9f707313d1/users/9b5fde2ee6e6482b905ab53433d970b5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:21.284357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] MFA Rules not processed for user `9b5fde2ee6e6482b905ab53433d970b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:21.285691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:21.415195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1817/3616] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:21.419533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:21.558268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352d48-6250-4499-8c6b-fa7c1555ceb0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:21.563267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:21.563937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.564211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.564520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.565153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:21.568041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:21.597356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:21.600261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:21.667575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23204-a8cf-4aba-80da-0b7deb23ee11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:21.671580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:21.672197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.672480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.672755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.674515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:21.751510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:21.780110 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1800/3617] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:21 2022] POST /identity/v3/projects => generated 377 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:21.790198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:21.827400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:21.828859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:21.861645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1818/3618] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:21.908573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3186-c6e7-4223-ba74-faf685e40d21 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:21.920780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:21.921532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:21.921913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:21.922281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:21.923122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:21.925367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:22.017332 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1801/3619] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:21 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:22.022371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:22.043240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9235-6855-40df-99fa-6ad902b82cbc service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:22.049429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:22.050264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.050563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.051382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.052665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:22.054632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:22.070119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:22.075617 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1819/3620] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:22.084003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc9c8-910c-497a-a764-b72f4c366c3d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:22.092419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:22.093645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.094021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.094382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] PATH_INFO: `/v3/projects/00f66faa86534d2ea9b6542a763f1f58/users/e4d07fe50b904fc9a417c535a6620234/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.126521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f66faa86534d2ea9b6542a763f1f58, user_id=e4d07fe50b904fc9a417c535a6620234, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:22.134993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:22.221441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:22.257095 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1802/3621] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:22 2022] PUT /identity/v3/projects/00f66faa86534d2ea9b6542a763f1f58/users/e4d07fe50b904fc9a417c535a6620234/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:22.258724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:22.269752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929356ad-9cc5-435a-9e0b-f057599926b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:22.353871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:22.354573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.354992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.355389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.356141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:22.357925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99608a1-ba18-45fc-89d1-872704109388 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:22.393951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:22.394519 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1820/3622] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:22.421135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19b67-8f28-49be-a7b5-ee3609ed9a3b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:22.429331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:22.430023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.430491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.430812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] PATH_INFO: `/v3/projects/00f66faa86534d2ea9b6542a763f1f58/users/e4d07fe50b904fc9a417c535a6620234/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.435583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f66faa86534d2ea9b6542a763f1f58, user_id=e4d07fe50b904fc9a417c535a6620234, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:22.438550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c7b6-f7cd-4996-ba33-55b1d0f2175d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:22.457377 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1803/3623] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:22 2022] PUT /identity/v3/projects/00f66faa86534d2ea9b6542a763f1f58/users/e4d07fe50b904fc9a417c535a6620234/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:22.469447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.469997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.470234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.568939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] MFA Rules not processed for user `e4d07fe50b904fc9a417c535a6620234`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:22.572415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:22.705597 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1821/3624] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:22.720951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4231a-f7e5-4c1c-8b11-870163e3a566 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:22.721398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4231a-f7e5-4c1c-8b11-870163e3a566 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:22.721930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4231a-f7e5-4c1c-8b11-870163e3a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:22.765317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-52a4231a-f7e5-4c1c-8b11-870163e3a566 None None] MFA Rules not processed for user `9b5fde2ee6e6482b905ab53433d970b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:22.766553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52a4231a-f7e5-4c1c-8b11-870163e3a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:22.882727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1804/3625] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:22.896477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:22.898846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:23.110093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb920ede-363e-4e32-ad7e-a330f4090f06 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:23.132136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:23.132773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:23.133054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:23.133322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:23.155769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:23.158463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:23.176116 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1822/3626] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:24.157004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:24.186880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:24.187441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:24.187441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:24.210927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:24.212729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:24.390409 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1805/3627] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:24.424557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:24.426715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:24.529572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d2fb-e9f3-4768-8204-07b48ede4890 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:24.537572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:24.538364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:24.539438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:24.540071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:24.563829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:24.567551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ff13-04d0-4a16-ba93-fda26c18a664 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:24.587637 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1823/3628] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:29:24.749161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:24.750727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:24.896716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:24.941840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca6ef7-c105-4527-880e-9371eaba6afe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:24.953612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:24.954281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:24.954558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:24.957033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] PATH_INFO: `/v3/users/d22d29c5b4fc4204ace2a5ce89e7bc21` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:24.962451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22d29c5b4fc4204ace2a5ce89e7bc21)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:24.972435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:25.148725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:25.305650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22d29c5b4fc4204ace2a5ce89e7bc21'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:25.307024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22d29c5b4fc4204ace2a5ce89e7bc21'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:25.330698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:25.331692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:25.332224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:25.377014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:25.378792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:25.403103 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1824/3629] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:25.408355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22d29c5b4fc4204ace2a5ce89e7bc21'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:25.422842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:25.424551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:25.433732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22d29c5b4fc4204ace2a5ce89e7bc21'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:25.434467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c01dd343-3554-42ed-9285-54be9074d6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22d29c5b4fc4204ace2a5ce89e7bc21'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:25.469964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ca467-d2b0-41e8-8ade-f74d94fbbdb3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:25.494861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647570f-de52-43a1-b699-46501297ffee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:25.495496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647570f-de52-43a1-b699-46501297ffee service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:25.495781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647570f-de52-43a1-b699-46501297ffee service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:25.496055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647570f-de52-43a1-b699-46501297ffee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:25.500387 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1806/3630] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:24 2022] DELETE /identity/v3/users/d22d29c5b4fc4204ace2a5ce89e7bc21 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:25.506392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66d9f7-4b2b-43f6-9c4d-b4d287f3e120 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:25.506921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66d9f7-4b2b-43f6-9c4d-b4d287f3e120 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:25.508678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66d9f7-4b2b-43f6-9c4d-b4d287f3e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:25.529158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647570f-de52-43a1-b699-46501297ffee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:25.531734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647570f-de52-43a1-b699-46501297ffee service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:25.571351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8b66d9f7-4b2b-43f6-9c4d-b4d287f3e120 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:25.576976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b66d9f7-4b2b-43f6-9c4d-b4d287f3e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:25.601329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1825/3631] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:25.691850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1807/3632] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:26.098558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647570f-de52-43a1-b699-46501297ffee service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:26.099501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:26.099792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:26.100066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:26.100564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0647570f-de52-43a1-b699-46501297ffee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:26.139249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:26.140401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:26.254021 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1808/3633] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:26.268374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:26.307890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647570f-de52-43a1-b699-46501297ffee service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:26.403963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec1a3-d5cd-4a2d-9e72-e3bc7ba04111 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:26.419729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:26.420361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:26.420650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:26.420925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:26.435139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:26.436751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:26.450538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1809/3634] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:29:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:29:26.475907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:26.476526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:26.476801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:26.477074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:26.503519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:26.505124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e153aac-8dcd-4a70-adc6-4adef14ba7e7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:26.528791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1826/3635] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:27.043008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:27.044471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:27.072717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7fab4-ea5e-4b9c-bba8-9e23f12e2f66 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:27.085472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:27.085914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:27.086200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:27.086478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] PATH_INFO: `/v3/users/3e535628dda941ba8fa2df9c86c5431b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:27.089319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e535628dda941ba8fa2df9c86c5431b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:27.091663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:27.402464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e535628dda941ba8fa2df9c86c5431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:27.404635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e535628dda941ba8fa2df9c86c5431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:27.511837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e535628dda941ba8fa2df9c86c5431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:27.542775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e535628dda941ba8fa2df9c86c5431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:27.542775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8c059a3-1e81-47ad-99fd-6d0be993ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e535628dda941ba8fa2df9c86c5431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:27.572958 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1810/3636] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:27 2022] DELETE /identity/v3/users/3e535628dda941ba8fa2df9c86c5431b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:27.577268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:27.579018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:27.579548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:27.608580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:27.609316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:27.609813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:27.620211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:27.641158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:27.647355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:27.671099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:27.673150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:27.806476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1827/3637] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:27.871805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:27.902557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1811/3638] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:27.947885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:27.949923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:28.058868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d53d0-c981-4262-bb47-d19f0432bbac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:28.075730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:28.076439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.076614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.079066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.085203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:28.087345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:28.105055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:28.107886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ffd0a-4791-4aa0-a347-b1967db454b2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:28.125323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1828/3639] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:28.127135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b53e94-0a73-48fd-b775-4a7e4a42ab27 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:28.141957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:28.143168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.143454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.143903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] PATH_INFO: `/v3/projects/0142b08920c34e6aac46d1bd3bd42e73` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.146682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0142b08920c34e6aac46d1bd3bd42e73)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:28.169595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:28.368047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0142b08920c34e6aac46d1bd3bd42e73', 'request_id': 'req-45f0b931-291d-4895-b45b-1c37a780a5e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:28.471289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0142b08920c34e6aac46d1bd3bd42e73', 'request_id': 'req-45f0b931-291d-4895-b45b-1c37a780a5e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:28.479872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0142b08920c34e6aac46d1bd3bd42e73', 'request_id': 'req-45f0b931-291d-4895-b45b-1c37a780a5e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:28.509221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] The token cache is being invalidate because project 0142b08920c34e6aac46d1bd3bd42e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:28.509521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:28.511682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-45f0b931-291d-4895-b45b-1c37a780a5e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:28.512356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1812/3640] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:28 2022] DELETE /identity/v3/projects/0142b08920c34e6aac46d1bd3bd42e73 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:28.518054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.518352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.518653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.554981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:28.557002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:28.652723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:28.687299 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1829/3641] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:28.695348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.696825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.696825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.752283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:28.755175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:28.784791 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1813/3642] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:28.790849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:28.808691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ad53-f5f6-48a8-8806-fb5f64f1d98c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:28.819261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:28.821247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.821247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.821247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.823125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:28.825364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:28.827223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:28.870252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1830/3643] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:28.871742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:28.883965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6c6d3-6193-47ff-9743-736120b509ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:28.891521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:28.892198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.892483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.892761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.893396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:28.896848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:28.947106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:28.948839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:28.970979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abfc9-3f70-45d8-a09b-d106a99f5160 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:28.983314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:28.983314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:28.983314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:28.983314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] PATH_INFO: `/v3/projects/4529b4f769d441429232f1fcb31da4ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:28.983685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4529b4f769d441429232f1fcb31da4ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:28.984911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.042133 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1814/3644] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:28 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:29.046128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.185403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4529b4f769d441429232f1fcb31da4ae', 'request_id': 'req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:29.266811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacbcc-6c83-4417-8836-293182608f8e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.272095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4529b4f769d441429232f1fcb31da4ae', 'request_id': 'req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:29.279797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4529b4f769d441429232f1fcb31da4ae', 'request_id': 'req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:29.315849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] The token cache is being invalidate because project 4529b4f769d441429232f1fcb31da4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:29.318642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:29.320024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f2d5377-2f10-4d95-96fe-3cbad8f4ceab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:29.324968 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1831/3645] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:28 2022] DELETE /identity/v3/projects/4529b4f769d441429232f1fcb31da4ae => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:29.329910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055d62-98c5-496b-9529-d6b9cf4ac771 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.330921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055d62-98c5-496b-9529-d6b9cf4ac771 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.333826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055d62-98c5-496b-9529-d6b9cf4ac771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.397809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd055d62-98c5-496b-9529-d6b9cf4ac771 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:29.400384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd055d62-98c5-496b-9529-d6b9cf4ac771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:29.471181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.472159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.473020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.473505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.474296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.485358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.559097 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1832/3646] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:29.560587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.560942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.561283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.601255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:29.603371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:29.624871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1833/3647] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:29.625326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1815/3648] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:29 2022] POST /identity/v3/users => generated 286 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:29.626131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.632041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.639283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:29.646183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026e7c-d459-48ee-8903-af1453c35478 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.661929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.662780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.663118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.665570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.665570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:29.665570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.666680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.681622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bff9e-c1f3-48ed-9638-be6b3779cd76 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.695866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1834/3649] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:29.708747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.723106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.723106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.723106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.723106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.724593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.725105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.740301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab767-e42d-4a92-9e35-89f0923f8497 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.757426 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1816/3650] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:29.758734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.766145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.767040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.769765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.772480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.773452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.775732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.794001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521166bf-702d-4509-9e4a-162a8a535ee5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.807735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.808885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.809354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.809788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.810591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.812434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:29.840165 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1817/3651] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:29:29.845058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.869848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac0069-937b-4bab-b713-d56708fdbacd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:29.873201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:29.883762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:29.884652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:29.885139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:29.885568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] PATH_INFO: `/v3/projects/959827d027b742deb4585b9fa7d6b7a0/users/223694ada82647dbba84f99030b3fa09/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:29.897783 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1835/3652] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:29 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:29.900017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:29.937652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959827d027b742deb4585b9fa7d6b7a0, user_id=223694ada82647dbba84f99030b3fa09, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:29.947793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a249a7-dad4-4aa2-9d43-d0159cde3fa2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:30.057296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f378f-f01e-4c11-b0be-d15a2637b2cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:30.093232 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1818/3653] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:29 2022] PUT /identity/v3/projects/959827d027b742deb4585b9fa7d6b7a0/users/223694ada82647dbba84f99030b3fa09/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:30.104817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9704b-d0f5-4ddb-ab11-604a03e64d40 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.107121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9704b-d0f5-4ddb-ab11-604a03e64d40 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.108879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9704b-d0f5-4ddb-ab11-604a03e64d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.168230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:30.222445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:30.223172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.230418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.230418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.230418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:30.230418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:30.231045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2ef9704b-d0f5-4ddb-ab11-604a03e64d40 None None] MFA Rules not processed for user `223694ada82647dbba84f99030b3fa09`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:30.233296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ef9704b-d0f5-4ddb-ab11-604a03e64d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:30.346939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1836/3654] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:29 2022] POST /identity/v3/users => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:30.351721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:30.375016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3375a9-503a-44fb-a136-85e9c5305c70 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:30.381491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:30.382769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.387426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.387426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.387426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:30.388371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:30.433317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1837/3655] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:30.439714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:30.467206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b277-d992-4866-a176-f8a8c7b37d05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:30.475796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:30.477009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.477439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.478038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.479286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:30.481577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:30.501432 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1838/3656] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:30.505221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:30.521916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c3edc-846b-456b-af8d-8e3397d46f03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:30.544223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1819/3657] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:30.545723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.546014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.546291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.547156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:30.547856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.548148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.548422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] PATH_INFO: `/v3/projects/8da2a67320df44e188d7f3b08bcdae17/users/aa3316223a78492eb3e62d0293587352/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.573928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da2a67320df44e188d7f3b08bcdae17, user_id=aa3316223a78492eb3e62d0293587352, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:30.577973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac593a86-d3d8-436f-8136-1eb01c47e401 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:30.615597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] MFA Rules not processed for user `223694ada82647dbba84f99030b3fa09`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:30.616850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:30.635527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1820/3658] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:30.648608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:30.651380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:30.742206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1839/3659] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:30 2022] PUT /identity/v3/projects/8da2a67320df44e188d7f3b08bcdae17/users/aa3316223a78492eb3e62d0293587352/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:30.745933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:30.746424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:30.746977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:30.829885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] MFA Rules not processed for user `aa3316223a78492eb3e62d0293587352`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:30.834804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:30.855473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:30.917938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfddedd-d705-474d-917a-503d19ee8a9a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:31.050570 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1840/3660] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:31.064123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:31.066248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:31.102313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:31.110089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:31.110720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:31.111235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:31.258603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:31.260599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:31.273502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae335992-106d-4096-b2ff-73f2dc2154a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:31.283877 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1821/3661] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:31.290079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:31.291053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:31.292560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:31.293080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:31.303488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:31.305071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8437-e28a-4b20-87e3-8c3d02bd621d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:31.319858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1841/3662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:31.397638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:31.534737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94f32-f064-4927-9ffb-60b8795b6436 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:31.557584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:31.558238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:31.558524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:31.558829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] PATH_INFO: `/v3/users/aa3316223a78492eb3e62d0293587352` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:31.566679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3316223a78492eb3e62d0293587352)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:31.569023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:31.762802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:31.907124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3316223a78492eb3e62d0293587352'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:31.915424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3316223a78492eb3e62d0293587352'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:32.008500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3316223a78492eb3e62d0293587352'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:32.028027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3316223a78492eb3e62d0293587352'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:32.030718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3316223a78492eb3e62d0293587352'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:32.080620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1822/3663] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:31 2022] DELETE /identity/v3/users/aa3316223a78492eb3e62d0293587352 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:32.085559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:32.086307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:32.087018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:32.127648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:32.131273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:32.156902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:32.287323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1842/3664] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:32.301890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:32.327665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:32.329177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:32.487222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eadb0-245c-48b3-8071-dd8061660890 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:32.493753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:32.494804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:32.499132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:32.499132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:32.510088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:32.512413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03ea92-ef40-4763-860f-4b12ee3a74bb service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:32.529333 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1823/3665] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:32.727584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:32.729208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:32.748625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8e76-f434-4a4c-b394-bf2173fb9343 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:32.763045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:32.764305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:32.764774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:32.765231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] PATH_INFO: `/v3/users/d4501eb36ebb412884c0f13c94ce6a4f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:32.767401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4501eb36ebb412884c0f13c94ce6a4f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:32.769589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:32.952097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:32.976354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4501eb36ebb412884c0f13c94ce6a4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:32.980792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4501eb36ebb412884c0f13c94ce6a4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:33.029945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:33.030267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:33.030785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:33.092457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4501eb36ebb412884c0f13c94ce6a4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:33.104415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] MFA Rules not processed for user `5400400f5ecc4db28f887ac684c58d16`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:33.107227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:33.113285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4501eb36ebb412884c0f13c94ce6a4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:33.114569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fbe0cc38-51bb-423f-9f64-c21e97aaef24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4501eb36ebb412884c0f13c94ce6a4f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:33.151113 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1843/3666] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:32 2022] DELETE /identity/v3/users/d4501eb36ebb412884c0f13c94ce6a4f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:33.153209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:33.153497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:33.153776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:33.193805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:33.195489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:33.253076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1824/3667] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:33.267614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:33.269144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:33.287851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1844/3668] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:33.304366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:33.315662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:33.450938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef1d9-ccad-4a91-ada1-5ef6c3755376 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:33.460772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:33.461691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:33.462128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:33.463162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:33.483722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaa138-80a4-43e6-b158-10133ee91009 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:33.490634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:33.494367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:33.523324 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1845/3669] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:33.631584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:33.712587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:33.713228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:33.713585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:33.713810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:33.861684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:33.863384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a6c2f-7d8c-4d18-8a60-9c0f5dc3154f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:33.899210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1825/3670] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:34.121517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:34.123180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:34.151792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a1fa6-c7c6-4d3d-9ef8-35a34fb37107 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:34.173688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:34.176433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:34.176433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:34.176433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] PATH_INFO: `/v3/projects/8da2a67320df44e188d7f3b08bcdae17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:34.184201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da2a67320df44e188d7f3b08bcdae17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:34.186429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:34.429793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da2a67320df44e188d7f3b08bcdae17', 'request_id': 'req-a435813c-6c72-4cd4-8700-b9567bb671eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:34.612420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da2a67320df44e188d7f3b08bcdae17', 'request_id': 'req-a435813c-6c72-4cd4-8700-b9567bb671eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:34.625643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da2a67320df44e188d7f3b08bcdae17', 'request_id': 'req-a435813c-6c72-4cd4-8700-b9567bb671eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:34.652858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] The token cache is being invalidate because project 8da2a67320df44e188d7f3b08bcdae17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:34.653285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:34.654377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:34.658653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1846/3671] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:34 2022] DELETE /identity/v3/projects/8da2a67320df44e188d7f3b08bcdae17 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:34.661736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d876d-fdde-4fea-b3c6-1cefa433cc21 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:34.662249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d876d-fdde-4fea-b3c6-1cefa433cc21 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:34.662348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d876d-fdde-4fea-b3c6-1cefa433cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:34.699446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ab8d876d-fdde-4fea-b3c6-1cefa433cc21 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:34.719623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab8d876d-fdde-4fea-b3c6-1cefa433cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:34.782414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:34.784152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:34.872192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1826/3672] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:34.880455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:34.881059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:34.881743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:34.904056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:34.906373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:34.926104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435813c-6c72-4cd4-8700-b9567bb671eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:34.930679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1827/3673] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:34.932539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:34.933601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:34.934650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:34.935044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:34.935444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] PATH_INFO: `/v3/projects/48ce30f1e687471e9a787a79a42736cc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:34.936772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ce30f1e687471e9a787a79a42736cc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:34.939113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:34.946316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:34.958003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed79c0f-c2fd-4aaa-9138-9ad5a86ae2b0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:34.970795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:34.971478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:34.971770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:34.972076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:34.972799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:34.975206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:34.979201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.006783 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1828/3674] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:35.026776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.027510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:35.029492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aecaa-5bd0-448e-b053-99c16b604a7a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:35.037164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:35.039583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.039583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.039583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.039583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:35.042773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.142406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ce30f1e687471e9a787a79a42736cc', 'request_id': 'req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.158094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1829/3675] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:35 2022] POST /identity/v3/projects => generated 397 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:35.162536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.236563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ce30f1e687471e9a787a79a42736cc', 'request_id': 'req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.251543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ce30f1e687471e9a787a79a42736cc', 'request_id': 'req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.289338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] The token cache is being invalidate because project 48ce30f1e687471e9a787a79a42736cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:35.293042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.294757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.304181 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1847/3676] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:34 2022] DELETE /identity/v3/projects/48ce30f1e687471e9a787a79a42736cc => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:35.305026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.309814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:35.313823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff354362-f79c-430a-b43f-b8a8b10e8e81 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:35.321055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:35.322412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.324436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.325296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.326933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:35.332133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa07207-b0f7-475d-8ee9-1d96fd0d70ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.419917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e448-9b62-4b36-a2bd-71ace4a4b02d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:35.429199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:35.430010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.430504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.430825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] PATH_INFO: `/v3/users/e2b9e8b05a564658bccb939fb0e68577` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.432110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b9e8b05a564658bccb939fb0e68577)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:35.434120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.503491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1830/3677] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:35 2022] POST /identity/v3/users => generated 299 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:35.506322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.507457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.507813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.530238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] MFA Rules not processed for user `5400400f5ecc4db28f887ac684c58d16`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:35.531735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:35.670388 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1831/3678] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:35.672118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.679663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b9e8b05a564658bccb939fb0e68577'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.680751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b9e8b05a564658bccb939fb0e68577'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.680940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:35.705224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2576fd-f146-4451-9f21-f5a4c9a047f3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:35.731399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:35.732356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.732810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.733910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.735515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:35.737814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.791004 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1832/3679] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:35.795055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b9e8b05a564658bccb939fb0e68577'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.795292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.797746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:35.814848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b9e8b05a564658bccb939fb0e68577'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.816638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b9e8b05a564658bccb939fb0e68577'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:35.821351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e586-cff1-4f62-89b4-0579d109c37b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:35.828845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:35.830512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:35.831034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:35.831511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:35.833046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:35.836518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586a30-e6ac-477f-a57b-34bfde7ef897 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:35.856644 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1848/3680] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:35 2022] DELETE /identity/v3/users/e2b9e8b05a564658bccb939fb0e68577 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:35.858149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:35.858367 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1833/3681] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:36.076037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c21507-5dcc-4d99-9e37-b64f3cbfb4e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:36.088934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:36.090748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:36.091624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:36.092002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] PATH_INFO: `/v3/projects/54dfc79af7b84c1382256b3daa0b0d1b/users/34087904efa04ffbbb5921f1dd667f71/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:36.128234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dfc79af7b84c1382256b3daa0b0d1b, user_id=34087904efa04ffbbb5921f1dd667f71, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:36.134568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:36.225812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1849/3682] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:35 2022] PUT /identity/v3/projects/54dfc79af7b84c1382256b3daa0b0d1b/users/34087904efa04ffbbb5921f1dd667f71/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:36.231263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:36.231549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:36.231820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:36.258169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:36.259475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:36.351279 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1834/3683] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:36.381649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:36.384745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:36.506584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:36.530326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73d39-4b53-4656-90f3-3161564a3f33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:36.536439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:36.536439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:36.536439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:36.536439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:36.557196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:36.558669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0f558-b860-4ce8-82b4-7bea23dbb54e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:36.579497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1850/3684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:36.660131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:37.820168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:37.852361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:37.853940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:37.888970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1565b-23c7-45c2-bd03-e08686b4e16e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:37.900915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:37.901682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:37.902050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:37.902392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] PATH_INFO: `/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:37.903669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5554f3a1b304f7d843b4c4ef69a04b6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:37.905675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:38.110010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5554f3a1b304f7d843b4c4ef69a04b6', 'request_id': 'req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:38.145426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:38.208184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5554f3a1b304f7d843b4c4ef69a04b6', 'request_id': 'req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:38.216511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5554f3a1b304f7d843b4c4ef69a04b6', 'request_id': 'req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:38.244966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] The token cache is being invalidate because project f5554f3a1b304f7d843b4c4ef69a04b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:38.246085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:38.246919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a7b9f1c8-9a40-4b44-8769-d334b2dda31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:38.253193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1835/3685] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:37 2022] DELETE /identity/v3/projects/f5554f3a1b304f7d843b4c4ef69a04b6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:38.256284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:38.256580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:38.256848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:38.283564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:38.285575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:38.434248 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1851/3686] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:38.443029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:38.443419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:38.443791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:38.496788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:38.500821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:38.524288 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1836/3687] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:38.525050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:38.541375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4174-dd32-44d8-868a-305d2df94d1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:38.547519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:38.548428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:38.548919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:38.549423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:38.550170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:38.550656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:38.554111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:38.587170 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1852/3688] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:29:38.587457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:38.599028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8aa96-f76d-4255-b9ec-1401a9af7fb8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:38.606844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:38.607470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:38.608242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:38.608242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:38.608694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:38.611196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:38.748437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1837/3689] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:38 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:38.756447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:38.772780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439a6f-a4e6-4de0-8018-c88da38f5727 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:38.903064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:38.904532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:38.904532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:38.904532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:38.905161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:38.908091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:38.951345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:39.003103 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1853/3690] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:38 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:39.011481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:39.023306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b607-32c7-4329-9cd5-f4cbf5569480 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:39.028506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:39.029139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.029423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.029698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.030348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:39.032031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:39.043148 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1838/3691] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:39.047292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:39.058791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c0ab-f24f-449d-9ce6-575fea52c293 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:39.063742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:39.064999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.064999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.064999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.065906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:39.067840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08886-0887-4923-9288-4850f775683c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:39.090365 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1854/3692] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:39.092255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:39.104904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b254-29ab-447d-88db-2ca712eca2da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:39.112717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:39.115534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.116019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.116568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] PATH_INFO: `/v3/projects/602975fd055743a9ac2879f090a69d7d/users/e5b5371ddd2f4f409e1128e13a30ad3f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.138565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602975fd055743a9ac2879f090a69d7d, user_id=e5b5371ddd2f4f409e1128e13a30ad3f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:39.143636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:39.282854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1839/3693] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:39 2022] PUT /identity/v3/projects/602975fd055743a9ac2879f090a69d7d/users/e5b5371ddd2f4f409e1128e13a30ad3f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:39.386842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.387717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.388162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.419515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] MFA Rules not processed for user `e5b5371ddd2f4f409e1128e13a30ad3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:39.431656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:39.526799 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1855/3694] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:39.531703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:39.629980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9212034-c767-4ba5-8236-4d339a9cf2a1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:39.637174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:39.638033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.638496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.638962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.639771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:39.642136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:39.829129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1840/3695] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:39 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:29:39.832829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:39.857122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24927f1c-d17d-42fc-84a0-6ba85e7b93f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:39.980712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:39.981572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:39.993066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:39.993476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:39.994193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:39.996177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:40.123609 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1856/3696] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:39 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:40.126690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:40.138357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb28a1-2721-4391-8961-de6c0451bf28 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:40.143783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:40.144427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.144699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.144999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.145648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:40.147975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:40.160014 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1841/3697] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:40.164639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:40.183211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7302a-89c9-4a41-b888-5ea1846438e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:40.189492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:40.192464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.192464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.192464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.193290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:40.195348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcc35-e92f-4b0f-bee5-eeeb29864f02 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:40.208407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1857/3698] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:29:40.212744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:40.227085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0b88-9ba0-4545-bb27-40925a8bdd5d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:40.231232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:40.232341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.232825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.235513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] PATH_INFO: `/v3/projects/fba1642bfdcd466399371897a8432b5c/users/00fffe6958834226bacf2881bd9db2bc/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.262511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba1642bfdcd466399371897a8432b5c, user_id=00fffe6958834226bacf2881bd9db2bc, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:40.268050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:40.362907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:40.424153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1842/3699] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:40 2022] PUT /identity/v3/projects/fba1642bfdcd466399371897a8432b5c/users/00fffe6958834226bacf2881bd9db2bc/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:40.435377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.435981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.435981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.486259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] MFA Rules not processed for user `00fffe6958834226bacf2881bd9db2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:40.491311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:40.529680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:40.591979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1858/3700] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:29:40.596712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:40.685650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149834f-1741-416b-9f04-ff37435b81ae admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:40.694116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:40.695061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.695490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.695912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.696759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:40.699971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:40.838460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1843/3701] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:40 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:40.842333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:40.875931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5e7b-a758-450d-becd-707c76edb9c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:40.990749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:40.991513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:40.991813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:40.992216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:40.994139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:40.996402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:41.138372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1859/3702] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:40 2022] POST /identity/v3/users => generated 300 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:41.142268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:41.187936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07087-72fb-4e70-a229-1d3e2dc4a666 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:41.208882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:41.210438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.212879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.230088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:41.231207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:41.233656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:41.263722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:41.275729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1844/3703] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:29:41.276684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de597-407e-407d-9b6d-7a19a4da1d19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:41.283310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:41.284302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.285071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.285660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] PATH_INFO: `/v3/projects/18d7bf5fa9e44f69a16969f48730ae76/users/fb326dcee06e407b947efe127efac1ae/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:41.307373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d7bf5fa9e44f69a16969f48730ae76, user_id=fb326dcee06e407b947efe127efac1ae, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:41.314930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:41.413025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:41.415022 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1860/3704] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:41 2022] PUT /identity/v3/projects/18d7bf5fa9e44f69a16969f48730ae76/users/fb326dcee06e407b947efe127efac1ae/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:41.436604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf225-f1ce-432e-8216-f2ce2b6d0cb9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:41.564969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:41.565350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.565674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.565990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:41.566760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:41.569480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4095b-8646-44cf-bd26-e5b467ab83d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:41.585895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1845/3705] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:41.589955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:41.603128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555029b-0162-4c27-87c9-3907b4fa948e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:41.618532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:41.619235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.619518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.619946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] PATH_INFO: `/v3/projects/18d7bf5fa9e44f69a16969f48730ae76/users/fb326dcee06e407b947efe127efac1ae/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:41.631929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d7bf5fa9e44f69a16969f48730ae76, user_id=fb326dcee06e407b947efe127efac1ae, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:41.635733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:41.651249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:41.659024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1861/3706] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:41 2022] PUT /identity/v3/projects/18d7bf5fa9e44f69a16969f48730ae76/users/fb326dcee06e407b947efe127efac1ae/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:41.672319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.677581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.692354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:41.740718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] MFA Rules not processed for user `fb326dcee06e407b947efe127efac1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:41.742819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:41.872614 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1846/3707] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:41.892413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:41.894820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:41.994140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ce670-1ed1-4ed4-aa2e-0203bb0507cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:41.997791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:41.998407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:41.998706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:41.998984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:42.014418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:42.016015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:42.033889 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1862/3708] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:42.302179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:42.562447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:43.083537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:43.511028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:43.519464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:43.723383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cc2df-43cc-4cfa-8a02-70682af36133 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:43.739423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:43.740902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:43.743047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:43.745732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:43.746154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:43.746490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:43.750840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:43.761519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5ceb9-461c-4846-8e95-4b2e18e99e37 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:43.776295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:43.777535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:43.777916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:43.778348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:43.896669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:43.897669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:43.904484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:43.906743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984f773-8cca-42ee-a841-863ce829de73 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:43.921705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1863/3709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:43.938887 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1847/3710] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:44.400373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:46.876957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:49.406084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:49.406593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:49.406742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:49.448391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] MFA Rules not processed for user `34087904efa04ffbbb5921f1dd667f71`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:49.449882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:49.582936 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1864/3711] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:49.873414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:49.886759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d1205-7c01-4517-9b5c-1c13c896f507 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:49.896062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:49.897622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:49.898060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:49.899066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:49.911364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:49.914259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:49.943356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1848/3712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:51.790949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:51.793034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:51.983862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8994-7885-4f1f-b18e-90e1b0d6e0d0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:52.001705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:52.005284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:52.006743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:52.009905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:52.015874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:52.073931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:52.078393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:52.092920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:52.095274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:52.125153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1865/3713] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:52.133468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bd5db-e474-47a9-825a-73ccd1058581 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:52.156123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:52.156946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:52.157332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:52.162487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:52.168140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:52.197717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:52.204558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53c543-297b-4c61-afa3-f2b45180cb80 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:52.238347 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1849/3714] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:29:53.883150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:53.884619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:53.914762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:54.081473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b4dd5-639f-44cf-a563-dff418943662 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:54.087516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:54.088172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:54.093714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:54.093714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] PATH_INFO: `/v3/users/9b5fde2ee6e6482b905ab53433d970b5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:54.093714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5fde2ee6e6482b905ab53433d970b5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:54.095081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:54.347516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5fde2ee6e6482b905ab53433d970b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:54.348992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5fde2ee6e6482b905ab53433d970b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:54.537737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5fde2ee6e6482b905ab53433d970b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:54.577564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5fde2ee6e6482b905ab53433d970b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:54.578453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5fde2ee6e6482b905ab53433d970b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:54.599801 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1866/3715] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:53 2022] DELETE /identity/v3/users/9b5fde2ee6e6482b905ab53433d970b5 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:54.604366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:54.604827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:54.604909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:54.614262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:54.640020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:54.642344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:54.767157 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1850/3716] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:54.781687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:54.784660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:54.914111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4809-98b0-4769-913c-843aa6e15ead admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:54.918701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:54.919277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:54.919561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:54.919834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:54.935082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:54.937382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:54.951317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1867/3717] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:55.361634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:55.363208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:55.472969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dbe11-3faf-4398-a046-c0530d415d9f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:55.478650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:55.479411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:55.479901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:55.480316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:55.482449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:55.506414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:55.512281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:55.531564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754d71-220b-44e5-a03a-94f0dde1a463 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:55.546546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:55.548980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:55.549691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:55.550303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] PATH_INFO: `/v3/projects/2ed28db711b74fb893b21f9f707313d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:55.555465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed28db711b74fb893b21f9f707313d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:55.560818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:55.599359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:55.647019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:55.649982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:55.670939 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1851/3718] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:29:55.703608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed28db711b74fb893b21f9f707313d1', 'request_id': 'req-8198c9b1-b1e8-4652-80a2-f4b6ba456524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:55.789348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed28db711b74fb893b21f9f707313d1', 'request_id': 'req-8198c9b1-b1e8-4652-80a2-f4b6ba456524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:55.798499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed28db711b74fb893b21f9f707313d1', 'request_id': 'req-8198c9b1-b1e8-4652-80a2-f4b6ba456524'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:55.832565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] The token cache is being invalidate because project 2ed28db711b74fb893b21f9f707313d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:55.832859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:55.834392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:55.841254 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1868/3719] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:55 2022] DELETE /identity/v3/projects/2ed28db711b74fb893b21f9f707313d1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:55.841771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:55.856951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053e00-49be-42fd-991e-2dc4ac56a374 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:55.996623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:56.004946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:56.005708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:56.006119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:56.006393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] PATH_INFO: `/v3/users/e4d07fe50b904fc9a417c535a6620234` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:56.007826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d07fe50b904fc9a417c535a6620234)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:56.010409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:56.350099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d07fe50b904fc9a417c535a6620234'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:56.350772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d07fe50b904fc9a417c535a6620234'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:56.437362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d07fe50b904fc9a417c535a6620234'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:56.494650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d07fe50b904fc9a417c535a6620234'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:56.494650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9548b808-8fae-40a5-a862-70dfd5d69640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d07fe50b904fc9a417c535a6620234'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:56.516411 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1852/3720] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:29:55 2022] DELETE /identity/v3/users/e4d07fe50b904fc9a417c535a6620234 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:57.725428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:57.738708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:57.785579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198c9b1-b1e8-4652-80a2-f4b6ba456524 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:57.987163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:57.987818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:57.988123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:57.988393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] PATH_INFO: `/v3/projects/00f66faa86534d2ea9b6542a763f1f58` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:57.989571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f66faa86534d2ea9b6542a763f1f58)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:57.991848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:58.152838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f66faa86534d2ea9b6542a763f1f58', 'request_id': 'req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:58.282197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f66faa86534d2ea9b6542a763f1f58', 'request_id': 'req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:58.294435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f66faa86534d2ea9b6542a763f1f58', 'request_id': 'req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:58.313879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] The token cache is being invalidate because project 00f66faa86534d2ea9b6542a763f1f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:29:58.314549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:58.315501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513ad79-3f5a-4ca7-81e8-dcbd91ace841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:29:58.323067 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1869/3721] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:29:57 2022] DELETE /identity/v3/projects/00f66faa86534d2ea9b6542a763f1f58 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:29:58.330549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:58.333024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:58.340346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:58.400705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:58.405441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:58.492915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1853/3722] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:58.502526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:58.503297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:58.504282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:58.544563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:58.546318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:58.560615 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1870/3723] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:58.561833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:58.580340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c062f-b00d-4ed3-b5ad-f92f003aac9f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:58.601912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:58.602769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:58.604265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:58.604703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:58.614176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:29:58.614720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:58.616538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:58.643920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1854/3724] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:29:58.654952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:58.669897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49caa0-03da-4fd4-a305-69a20fe70e09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:58.681476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:58.682857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:58.683381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:58.686559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:58.687419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:58.689569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:58.801060 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1871/3725] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:29:58 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:29:58.803408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:58.833016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa3cc-e95b-4ca9-870c-9f43f8685044 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:58.977850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:58.978367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:58.978792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:58.979077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:58.979726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:58.981986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:59.001196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:59.143371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1855/3726] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:29:58 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:29:59.144665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:59.160513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20df1-1e98-4395-8fcd-f48c6b3b336b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:59.172109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:59.172747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:59.173028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:59.173304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:59.173959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:59.175689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:59.205788 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1872/3727] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:59.210275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:59.221136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a2051-17fd-4625-93f0-e6d8828fbf90 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:59.236804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:59.237445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:59.240251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:59.240533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:59.241647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:59.245032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f66ef4-5b94-4a5c-8c0c-b93bcf2cfc81 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:59.271446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1856/3728] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:29:59.276013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:59.281631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:29:59.297040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356739-4850-4735-860b-deb7ca6418b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:59.319402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:59.319402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:59.319402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:59.319402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] PATH_INFO: `/v3/projects/09237d89bedc478eb238f3773402c209/users/30654870bc994ffab886c9ad05379643/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:59.347517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09237d89bedc478eb238f3773402c209, user_id=30654870bc994ffab886c9ad05379643, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:59.351711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:59.518475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1873/3729] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:29:59 2022] PUT /identity/v3/projects/09237d89bedc478eb238f3773402c209/users/30654870bc994ffab886c9ad05379643/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:29:59.524397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:59.525309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:59.525743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:59.574407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:29:59.576269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:59.762491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1857/3730] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:29:59.782593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:29:59.785659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:29:59.926540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672df875-8985-431f-b986-93a40eb07a41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:29:59.939319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:29:59.940101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:29:59.940489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:29:59.940865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:29:59.963853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:29:59.965604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:29:59.981062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1874/3731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:00.740856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:00.744468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:00.767438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cff91-c39c-43ab-8b28-3dc583854882 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:00.776000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:00.776927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:00.778080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:00.778633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] PATH_INFO: `/v3/users/34087904efa04ffbbb5921f1dd667f71` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:00.779897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34087904efa04ffbbb5921f1dd667f71)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:00.782603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:01.124030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34087904efa04ffbbb5921f1dd667f71'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:01.129671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34087904efa04ffbbb5921f1dd667f71'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:01.195750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34087904efa04ffbbb5921f1dd667f71'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:01.218496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34087904efa04ffbbb5921f1dd667f71'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:01.219864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bb3b251-b419-4d49-85bf-419eb3e49759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34087904efa04ffbbb5921f1dd667f71'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:01.267817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1858/3732] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:00 2022] DELETE /identity/v3/users/34087904efa04ffbbb5921f1dd667f71 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:01.623017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:01.646142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf389f3-92cb-4747-a792-52bae6ae7870 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:01.837920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:01.843766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:01.846194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:01.846194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] PATH_INFO: `/v3/projects/54dfc79af7b84c1382256b3daa0b0d1b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:01.847002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dfc79af7b84c1382256b3daa0b0d1b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:01.849726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.021413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dfc79af7b84c1382256b3daa0b0d1b', 'request_id': 'req-826cdc11-0947-4e18-9f47-b49bb6fa2555'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.093331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dfc79af7b84c1382256b3daa0b0d1b', 'request_id': 'req-826cdc11-0947-4e18-9f47-b49bb6fa2555'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.103201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dfc79af7b84c1382256b3daa0b0d1b', 'request_id': 'req-826cdc11-0947-4e18-9f47-b49bb6fa2555'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.126457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] The token cache is being invalidate because project 54dfc79af7b84c1382256b3daa0b0d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:02.126984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.127978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-826cdc11-0947-4e18-9f47-b49bb6fa2555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.135911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.136463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1875/3733] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:01 2022] DELETE /identity/v3/projects/54dfc79af7b84c1382256b3daa0b0d1b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:02.136573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.136573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.175260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:02.176590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:02.280940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:02.294555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1859/3734] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:02.306548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.307028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.307450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.333249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:02.335195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:02.399346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:02.401204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:02.417763 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1876/3735] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:02.418862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:02.425649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:02.430639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28591bc-2c4a-47df-b69a-432948d9fdb9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:02.439385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:02.440132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.440521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.441149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.441482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:30:02.441921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:02.445295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.476746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1877/3736] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:30:02.491528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:02.510449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b364a9-8b86-4e98-89d3-95a2d880f7cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:02.523055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:02.523396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10377f-0028-406d-9fcf-5159ae285835 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:02.524353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.524500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.537318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.541437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:02.544889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.546053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:02.546982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.547619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.553511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.553511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:02.596781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:02.601221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.632078 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1860/3737] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:02.633383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:02.636983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:02.663303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a059b9f-67e7-41eb-aa2c-f610e0ba6bcb service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:02.670406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:02.671407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.671896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.672344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] PATH_INFO: `/v3/users/0c46e0451aad433fb45d74e158ed83a5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.674301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c46e0451aad433fb45d74e158ed83a5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:02.677683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.706447 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1878/3738] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:02 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:02.710582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:02.864719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f2e5e-d9ee-4634-a00c-699b9e9cae5e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:02.882515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:02.883865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:02.884233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:02.886470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:02.889440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:02.891461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:02.914113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c46e0451aad433fb45d74e158ed83a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.916165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c46e0451aad433fb45d74e158ed83a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:02.990757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c46e0451aad433fb45d74e158ed83a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.008249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c46e0451aad433fb45d74e158ed83a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.008986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c46e0451aad433fb45d74e158ed83a5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.036034 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1861/3739] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:02 2022] DELETE /identity/v3/users/0c46e0451aad433fb45d74e158ed83a5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:03.045353 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1879/3740] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:02 2022] POST /identity/v3/users => generated 295 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:30:03.052492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:03.056711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:03.247227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae19c-5bce-4868-a99f-afc7ed8be5cd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:03.254247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:03.255616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.255616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.255898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.256620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:03.259179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:03.275202 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1862/3741] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:03.279803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:03.298166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531047-6ee7-4112-8822-8281a9d6c21a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:03.303463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:03.305558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.305558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.305558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.305558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:03.307293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:03.319668 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1880/3742] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:03.324077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:03.336922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810d31-e884-415f-82d6-6dbda233b4ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:03.342004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:03.343444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.343444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.343444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] PATH_INFO: `/v3/projects/47a4702527e949e7912331b45c5fb2d7/users/d8b3cf194d6345a1ad9209a65f24ebcb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.359848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a4702527e949e7912331b45c5fb2d7, user_id=d8b3cf194d6345a1ad9209a65f24ebcb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:03.363698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208459-d20d-47cb-ab5b-32304ba8f57b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:03.407253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:03.413602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:03.452603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff718a7-8d5c-48ec-bd47-46b885386181 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:03.469939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:03.470653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.470918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.471173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] PATH_INFO: `/v3/projects/76e953d4cf04460893b682e9429ae66d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.473011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e953d4cf04460893b682e9429ae66d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:03.476436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:03.488698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1863/3743] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:03 2022] PUT /identity/v3/projects/47a4702527e949e7912331b45c5fb2d7/users/d8b3cf194d6345a1ad9209a65f24ebcb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:03.496026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.496431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.496841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.520271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:03.521624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:03.594308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1864/3744] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:30:03.641071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e953d4cf04460893b682e9429ae66d', 'request_id': 'req-02c23793-6ee6-4e80-b0da-d60b629d5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.654504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:03.656222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:03.741451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e953d4cf04460893b682e9429ae66d', 'request_id': 'req-02c23793-6ee6-4e80-b0da-d60b629d5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.752069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e953d4cf04460893b682e9429ae66d', 'request_id': 'req-02c23793-6ee6-4e80-b0da-d60b629d5201'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.786192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b10e-1b00-46e3-8b53-1e6ccc757ea2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:03.799277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] The token cache is being invalidate because project 76e953d4cf04460893b682e9429ae66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:03.799881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.802200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02c23793-6ee6-4e80-b0da-d60b629d5201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:03.806369 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1881/3745] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:03 2022] DELETE /identity/v3/projects/76e953d4cf04460893b682e9429ae66d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:03.814411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a90e9-8c71-4d0a-a383-d1dfdc85bb93 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.814720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a90e9-8c71-4d0a-a383-d1dfdc85bb93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.817259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a90e9-8c71-4d0a-a383-d1dfdc85bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.865653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e76a90e9-8c71-4d0a-a383-d1dfdc85bb93 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:03.869240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e76a90e9-8c71-4d0a-a383-d1dfdc85bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:03.928835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:03.929737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:03.930471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:03.930979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:03.934709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:04.074131 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1882/3746] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:04.080303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.080598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.080866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.107683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:04.120469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:04.143074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:04.160769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.162974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.190045 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1865/3747] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:04.192147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.196777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:04.200275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:04.201412 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1883/3748] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:30:04.204312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.229359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d107c-a837-42d9-a48d-021bd0d50e67 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.229728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b75e1-6feb-4cc1-a514-2e66b7560ef4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.233889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.234564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.234851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.235128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] PATH_INFO: `/v3/users/e5b5371ddd2f4f409e1128e13a30ad3f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.237763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b5371ddd2f4f409e1128e13a30ad3f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.240440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.241370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.242123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.242495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.242975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.243591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:30:04.244097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.247401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.267062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1884/3749] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:30:04.271590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.283561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d644e-c4d8-4456-9661-84e4ae255d2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.288126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.288741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.289022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.289297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.289928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.292185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.427632 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1885/3750] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:04 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:30:04.429823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.505183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5395d66-b181-4249-b639-818a599ea2ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.511864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.516366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.516366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.516366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.516366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.516366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.535716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b5371ddd2f4f409e1128e13a30ad3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:04.536397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b5371ddd2f4f409e1128e13a30ad3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:04.696468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1886/3751] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:04 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:04.697296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b5371ddd2f4f409e1128e13a30ad3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:04.700704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.705840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:04.735134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b5371ddd2f4f409e1128e13a30ad3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:04.739757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e8eaa5-8701-4756-b816-83e3751b2fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b5371ddd2f4f409e1128e13a30ad3f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:04.740029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9ba08-4dcf-4139-aa7e-6e16c85a312c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.754404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.758366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.758832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.759753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.766305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.779652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.812781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1866/3752] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:04 2022] DELETE /identity/v3/users/e5b5371ddd2f4f409e1128e13a30ad3f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:04.812781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.812781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.812781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.813210 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1887/3753] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:04.819930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.854194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44563380-de5a-436b-83f1-5f2610debfd4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.860995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:04.862238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:04.949601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:04.950985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:04.951655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:04.952140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:04.953031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:04.955224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:04.969954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1888/3754] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:04.971450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.974807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1867/3755] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:04.998645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb017-2121-4407-b735-16b42e4385a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:04.999367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:04.999367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:05.007372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:05.008200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:05.008647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:05.009060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] PATH_INFO: `/v3/projects/444a218f033c48e8836100b76f49bf1b/users/f3b7ea18f94a4dfcaf5e7d3f8b934163/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:05.025571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444a218f033c48e8836100b76f49bf1b, user_id=f3b7ea18f94a4dfcaf5e7d3f8b934163, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:05.028590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:05.056450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c1d60-f738-4455-be6c-8279464b6dc5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:05.060053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:05.060656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:05.061025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:05.061300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:05.070491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:05.071958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f52813-5032-4766-a6e7-4e463ce5d6a4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:05.081558 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1868/3756] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:30:05.511599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1889/3757] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:04 2022] PUT /identity/v3/projects/444a218f033c48e8836100b76f49bf1b/users/f3b7ea18f94a4dfcaf5e7d3f8b934163/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:05.516914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:05.517202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:05.517476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:05.547461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:05.548972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:05.727214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1869/3758] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:05.771069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:05.986667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc247cb-2814-4876-a668-c50b83f43b49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:05.992340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:05.994119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:05.994861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:05.995319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:06.022007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:06.023886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:06.046498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1890/3759] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:06.574086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:06.607138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:07.023925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:07.025625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:07.050938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bca1f-f7af-4bc3-821f-13f735aa8070 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:07.076079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:07.079946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:07.080831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:07.081276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] PATH_INFO: `/v3/projects/602975fd055743a9ac2879f090a69d7d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:07.086370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] RBAC: Authorizing `identity:delete_project(project_id=602975fd055743a9ac2879f090a69d7d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:07.092106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:07.255288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602975fd055743a9ac2879f090a69d7d', 'request_id': 'req-f22d3225-2a94-4efd-8c3a-2a7664a5262e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.350769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602975fd055743a9ac2879f090a69d7d', 'request_id': 'req-f22d3225-2a94-4efd-8c3a-2a7664a5262e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.357578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602975fd055743a9ac2879f090a69d7d', 'request_id': 'req-f22d3225-2a94-4efd-8c3a-2a7664a5262e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.371223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] The token cache is being invalidate because project 602975fd055743a9ac2879f090a69d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:07.374651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.374651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.374651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1870/3760] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:07 2022] DELETE /identity/v3/projects/602975fd055743a9ac2879f090a69d7d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:07.377897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:07.389269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b136-4b9e-4c2c-b780-7ab6508bf0d3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:07.470652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:07.472647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:07.473155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:07.473667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] PATH_INFO: `/v3/users/00fffe6958834226bacf2881bd9db2bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:07.475485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fffe6958834226bacf2881bd9db2bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:07.478877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:07.738391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:07.787189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fffe6958834226bacf2881bd9db2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.792093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fffe6958834226bacf2881bd9db2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.890795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fffe6958834226bacf2881bd9db2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.920696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fffe6958834226bacf2881bd9db2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.923238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fffe6958834226bacf2881bd9db2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:07.965797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1891/3761] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:07 2022] DELETE /identity/v3/users/00fffe6958834226bacf2881bd9db2bc => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:09.911719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:09.916095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:09.943593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3225-2a94-4efd-8c3a-2a7664a5262e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:10.104708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:10.105366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:10.105642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:10.105909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] PATH_INFO: `/v3/projects/fba1642bfdcd466399371897a8432b5c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:10.107257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba1642bfdcd466399371897a8432b5c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:10.109989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:10.137630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:10.304320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba1642bfdcd466399371897a8432b5c', 'request_id': 'req-985e4eaa-9564-4077-8c95-c1d211111ced'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:10.469695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba1642bfdcd466399371897a8432b5c', 'request_id': 'req-985e4eaa-9564-4077-8c95-c1d211111ced'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:10.483762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba1642bfdcd466399371897a8432b5c', 'request_id': 'req-985e4eaa-9564-4077-8c95-c1d211111ced'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:10.499902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] The token cache is being invalidate because project fba1642bfdcd466399371897a8432b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:10.500725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:10.501647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:10.504590 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1871/3762] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:09 2022] DELETE /identity/v3/projects/fba1642bfdcd466399371897a8432b5c => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:10.508620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:10.510168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:10.521674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:10.537937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22709931-e0b0-4046-b3a0-99f5c0735ef8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:10.693283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:10.693283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:10.693283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:10.700968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] PATH_INFO: `/v3/users/fb326dcee06e407b947efe127efac1ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:10.703462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb326dcee06e407b947efe127efac1ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:10.711306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:11.001629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb326dcee06e407b947efe127efac1ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:11.002725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb326dcee06e407b947efe127efac1ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:11.100493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb326dcee06e407b947efe127efac1ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:11.125364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb326dcee06e407b947efe127efac1ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:11.130262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4bcbc24-c5d1-4f3b-8ed7-aa8684286698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb326dcee06e407b947efe127efac1ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:11.182459 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1892/3763] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:10 2022] DELETE /identity/v3/users/fb326dcee06e407b947efe127efac1ae => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:30:12.312380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:12.314577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:12.345427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e4eaa-9564-4077-8c95-c1d211111ced admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:12.507043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:12.513058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:12.514581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:12.515616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] PATH_INFO: `/v3/projects/18d7bf5fa9e44f69a16969f48730ae76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:12.521019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d7bf5fa9e44f69a16969f48730ae76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:12.526601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:12.729300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d7bf5fa9e44f69a16969f48730ae76', 'request_id': 'req-32cadfcb-9433-4f70-a598-29e1ea3a90bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:12.857732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d7bf5fa9e44f69a16969f48730ae76', 'request_id': 'req-32cadfcb-9433-4f70-a598-29e1ea3a90bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:12.866889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d7bf5fa9e44f69a16969f48730ae76', 'request_id': 'req-32cadfcb-9433-4f70-a598-29e1ea3a90bf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:12.918265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] The token cache is being invalidate because project 18d7bf5fa9e44f69a16969f48730ae76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:12.920086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:12.921055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32cadfcb-9433-4f70-a598-29e1ea3a90bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:12.923824 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1872/3764] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:12 2022] DELETE /identity/v3/projects/18d7bf5fa9e44f69a16969f48730ae76 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:12.933138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:12.934417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:12.935710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:13.063749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:13.070721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:13.431402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:13.431946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:13.431946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:13.432406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1893/3765] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:13.506659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:13.508233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:13.535053 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1873/3766] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:13.541097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:13.555697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79bced-b109-4f92-afce-5fd3765ea2df None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:13.569031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:13.569922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:13.570189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:13.570458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:13.571149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:30:13.571455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:13.575390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:13.639944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1894/3767] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:30:13.641787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:13.663827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8b94-d6c0-4ecc-bb11-c2e9368745e5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:13.670655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:13.679361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:13.679361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:13.679361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:13.679361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:13.679361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:13.828057 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1874/3768] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:13 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:13.831802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:13.843021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062257a-5fab-468f-8aed-2b00f2077814 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:13.853678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:14.023498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:14.023498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.023498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.023498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.024656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:14.025919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:14.147056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:14.161611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1895/3769] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:13 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:30:14.170877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3acd5-770a-42f0-8cda-c84a176770fe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:14.186531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:14.187459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.191328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.191863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.194194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:14.196079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:14.198534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:14.223051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1875/3770] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:30:14.229718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:14.244367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6340b-1a2c-4a16-a3c7-cb02ed72e7e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:14.251511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:14.252382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.252831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.253842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.254700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:14.256471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37697055-cc39-43e2-a952-1a3aa8335d81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:14.274534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1896/3771] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:14.278298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:14.298716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b454f-829f-498a-885c-43fa374a7f98 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:14.308905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:14.312457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.312457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.312457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] PATH_INFO: `/v3/projects/3a69ed25e78149d9abe3ffc6839013f6/users/c7d53610805948d4bc1bf26af5020e8d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.359774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a69ed25e78149d9abe3ffc6839013f6, user_id=c7d53610805948d4bc1bf26af5020e8d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:14.363767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:14.470666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1876/3772] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:14 2022] PUT /identity/v3/projects/3a69ed25e78149d9abe3ffc6839013f6/users/c7d53610805948d4bc1bf26af5020e8d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:14.482551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.482914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.483536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.532972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] MFA Rules not processed for user `c7d53610805948d4bc1bf26af5020e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:14.534611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:14.696909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1897/3773] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:14.701853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:14.809338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3a096-5f9d-45aa-bc2b-49042aad8402 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:14.825487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:14.827796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:14.829030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:14.832727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:14.836669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:14.859337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.016535 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1877/3774] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:14 2022] POST /identity/v3/projects => generated 381 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:30:15.018254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.037445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e2bd7-edcb-4006-9491-40a48b23c876 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:15.103150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:15.103785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.104140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.104435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.105058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:15.107244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.247953 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1898/3775] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:15 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:15.251938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.266575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ab16-c88a-40bd-9bfe-94af0bb28ce6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:15.285252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:15.285252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.289809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.290206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.293000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:15.296967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.320626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1878/3776] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:15.324446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.340810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cae7-3ba4-4982-b6af-8bdd35c46602 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:15.351985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:15.352258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.352940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.353349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] PATH_INFO: `/v3/projects/fb6def38d9e64ef997559a0b1b41e69c/users/2c22ab9bf60140448837e9a7447e446e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.395754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6def38d9e64ef997559a0b1b41e69c, user_id=2c22ab9bf60140448837e9a7447e446e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:15.399549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.512311 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1899/3777] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:15 2022] PUT /identity/v3/projects/fb6def38d9e64ef997559a0b1b41e69c/users/2c22ab9bf60140448837e9a7447e446e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:15.516297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.526417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053335-e9f0-4f29-91d6-e0b4b67b3840 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:15.597911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:15.598742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.599019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.599472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.600482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:15.602309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1873f-5999-43b7-957e-bba63e7864a8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.621276 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1879/3778] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:15.622604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.640883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10311b-48ba-45c7-9c2a-cb2370a35090 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:15.648144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:15.649302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.649766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.650195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] PATH_INFO: `/v3/projects/fb6def38d9e64ef997559a0b1b41e69c/users/2c22ab9bf60140448837e9a7447e446e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.666521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6def38d9e64ef997559a0b1b41e69c, user_id=2c22ab9bf60140448837e9a7447e446e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:15.671144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:15.694948 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1900/3779] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:15 2022] PUT /identity/v3/projects/fb6def38d9e64ef997559a0b1b41e69c/users/2c22ab9bf60140448837e9a7447e446e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:30:15.721976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:15.722886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:15.722886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:15.754133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] MFA Rules not processed for user `2c22ab9bf60140448837e9a7447e446e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:15.755418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:15.887538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1880/3780] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:15.893041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:15.896250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:16.049717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cac5b-447f-490b-a688-7fab6157ba76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:16.058671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:16.058671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:16.058671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:16.058671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:16.088057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:16.088057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3fcd0-b53d-48d8-9d6f-1464149bd2fb service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:16.095330 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1901/3781] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:16.338323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:16.359231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865779fd-5bc8-4ac1-bd7d-274dc3391c2c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:16.374018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:16.375425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:16.375934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:16.376302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:16.379026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:16.505095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:16.506856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:16.523128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1881/3782] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:17.046070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c7f59-5146-463d-af61-d4c19a9f38cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:17.046381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c7f59-5146-463d-af61-d4c19a9f38cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:17.046684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c7f59-5146-463d-af61-d4c19a9f38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:17.083791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-012c7f59-5146-463d-af61-d4c19a9f38cf None None] MFA Rules not processed for user `5400400f5ecc4db28f887ac684c58d16`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:17.084340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-012c7f59-5146-463d-af61-d4c19a9f38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:17.186526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:17.251901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1902/3783] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:17.334226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:17.471745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c058cb0-55c4-4766-8d67-00ab681ae1ea service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:17.483159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:17.483884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:17.484168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:17.485563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] PATH_INFO: `/v3/users/c7d53610805948d4bc1bf26af5020e8d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:17.487221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d53610805948d4bc1bf26af5020e8d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:17.493388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:17.773876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d53610805948d4bc1bf26af5020e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:17.775900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d53610805948d4bc1bf26af5020e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:17.881529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d53610805948d4bc1bf26af5020e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:17.906331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d53610805948d4bc1bf26af5020e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:17.908544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d53610805948d4bc1bf26af5020e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:17.942481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1882/3784] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:17 2022] DELETE /identity/v3/users/c7d53610805948d4bc1bf26af5020e8d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:17.948902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e230c0-4075-4efe-b2db-d7ed25a6d273 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:17.949466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e230c0-4075-4efe-b2db-d7ed25a6d273 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:17.949903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e230c0-4075-4efe-b2db-d7ed25a6d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:17.990318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79e230c0-4075-4efe-b2db-d7ed25a6d273 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:17.995335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79e230c0-4075-4efe-b2db-d7ed25a6d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:18.113037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1903/3785] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:18.165966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:18.167686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:18.246572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4b25-8404-4a42-8a57-1f065ab81be4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:18.252571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:18.252993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:18.253276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:18.253552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:18.267310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:18.270909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:18.288238 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1883/3786] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:18.327819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:18.680422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:18.680940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:18.681447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:18.759174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] MFA Rules not processed for user `30654870bc994ffab886c9ad05379643`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:18.760554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:18.773656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:18.933769 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1904/3787] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:18.936048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:18.939104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:18.962951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3e1dc-6d41-4be5-92c1-94e78b51ce85 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:18.981296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:18.983244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:18.984274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:18.985171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:18.987839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:18.995870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:19.146393 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1884/3788] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:18 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:19.147577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:19.167298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf7ec-ac98-4ecc-8993-45a1770f8e6c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:19.304432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:19.305160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:19.305520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:19.305803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:19.306447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:19.311271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:19.448205 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1905/3789] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:19 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:19.449183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:19.461457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9e77-2c59-4e05-a545-2d4c249ae5a3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:19.476832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:19.477616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:19.477874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:19.479019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:19.479819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:19.481413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:19.524677 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1885/3790] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:19.525602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:19.541530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b707-ecaf-4d6c-82d2-15abe01edf1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:19.552387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:19.553095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:19.553404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:19.553658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] PATH_INFO: `/v3/projects/0ea272789b824c52a47571857e565611/users/cd37b82f85e94413b10915f48f214342/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:19.611955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea272789b824c52a47571857e565611, user_id=cd37b82f85e94413b10915f48f214342, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:19.615561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50190316-8a48-4322-8fe4-2325cf7d9688 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:19.740382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1906/3791] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:19 2022] PUT /identity/v3/projects/0ea272789b824c52a47571857e565611/users/cd37b82f85e94413b10915f48f214342/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:19.752994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:19.768494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f773-dd72-490a-8e9c-24d009e80c83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:19.859169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:19.859509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:19.859787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:19.899648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:19.904742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:19.995174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:19.995824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:19.996059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:19.996505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:19.997539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:19.999393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:20.027332 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1886/3792] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:20.032490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:20.049792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1907/3793] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:20.079916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd32851-b28d-49f6-b21e-09bb38e72f1e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:20.099444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:20.100849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:20.101136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:20.101409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] PATH_INFO: `/v3/projects/0ea272789b824c52a47571857e565611/users/cd37b82f85e94413b10915f48f214342/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:20.116450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea272789b824c52a47571857e565611, user_id=cd37b82f85e94413b10915f48f214342, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:20.119508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:20.132779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1887/3794] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:20 2022] PUT /identity/v3/projects/0ea272789b824c52a47571857e565611/users/cd37b82f85e94413b10915f48f214342/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:20.186043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:20.188707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:20.253595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:20.268636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:20.273996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:20.380116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27365742-5c10-4df8-8859-73aeffb275dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:20.426081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:20.509281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522f834-39b1-44e7-a9ba-118cc2e8a3af admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:20.523697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:20.525227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:20.525529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:20.528744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] PATH_INFO: `/v3/projects/3a69ed25e78149d9abe3ffc6839013f6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:20.541639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a69ed25e78149d9abe3ffc6839013f6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:20.541639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:20.608714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:20.615184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:20.615184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:20.615184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:20.755336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a69ed25e78149d9abe3ffc6839013f6', 'request_id': 'req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:20.798706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:20.800595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:20.819379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a69ed25e78149d9abe3ffc6839013f6', 'request_id': 'req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:20.826535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a69ed25e78149d9abe3ffc6839013f6', 'request_id': 'req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:20.836850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1908/3795] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:30:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:30:20.863975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] The token cache is being invalidate because project 3a69ed25e78149d9abe3ffc6839013f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:20.866700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:20.869231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:20.872633 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1888/3796] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:20 2022] DELETE /identity/v3/projects/3a69ed25e78149d9abe3ffc6839013f6 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:20.876960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:20.898519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db69f31-74ae-4512-aeb3-f7c8a4c74333 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:21.007078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:21.009229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:21.011137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:21.011549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] PATH_INFO: `/v3/users/2c22ab9bf60140448837e9a7447e446e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:21.014376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c22ab9bf60140448837e9a7447e446e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:21.021744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:21.388990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c22ab9bf60140448837e9a7447e446e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:21.392974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c22ab9bf60140448837e9a7447e446e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:21.487926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:21.488888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c22ab9bf60140448837e9a7447e446e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:21.512857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c22ab9bf60140448837e9a7447e446e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:21.517042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-456bad5f-3913-4f9c-bfc4-e35df2082e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c22ab9bf60140448837e9a7447e446e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:21.560762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1909/3797] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:20 2022] DELETE /identity/v3/users/2c22ab9bf60140448837e9a7447e446e => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:22.850740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:22.851156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:22.891221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ccd97-ffad-4dfb-ada4-b47a6f78420c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:23.118280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:23.119136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:23.119528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:23.119882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] PATH_INFO: `/v3/users/223694ada82647dbba84f99030b3fa09` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:23.122752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223694ada82647dbba84f99030b3fa09)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:23.138833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:23.436969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223694ada82647dbba84f99030b3fa09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:23.438038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223694ada82647dbba84f99030b3fa09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:23.533595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223694ada82647dbba84f99030b3fa09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:23.563607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:23.567135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223694ada82647dbba84f99030b3fa09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:23.570059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223694ada82647dbba84f99030b3fa09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:23.600035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1889/3798] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:30:22 2022] DELETE /identity/v3/users/223694ada82647dbba84f99030b3fa09 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:23.604581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:23.605433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:23.605868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:23.648442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:23.649924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:23.733602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:23.737052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:23.837703 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1910/3799] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:23.910584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:23.912487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.067493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3ac9-70c5-46e3-a3e9-34a356f787e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:24.099932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:24.101762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711df0-7a15-407a-ae50-15068974c4f0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:24.102386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.102704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.103050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] PATH_INFO: `/v3/projects/fb6def38d9e64ef997559a0b1b41e69c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.108303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:24.111472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6def38d9e64ef997559a0b1b41e69c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:24.112898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.113367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.114667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.118504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:24.151717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:24.153178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2865c-1bc8-4b08-97e1-b2c2c0fe0a77 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:24.186989 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1911/3800] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:24.303710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762322-8de1-4627-b42c-e41524ad0452 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.303710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762322-8de1-4627-b42c-e41524ad0452 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.303931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762322-8de1-4627-b42c-e41524ad0452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.345924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6def38d9e64ef997559a0b1b41e69c', 'request_id': 'req-2730a45e-7f84-4038-a876-484426a0120b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:24.381482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90762322-8de1-4627-b42c-e41524ad0452 None None] MFA Rules not processed for user `d8b3cf194d6345a1ad9209a65f24ebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:24.382756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90762322-8de1-4627-b42c-e41524ad0452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.415300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:24.481425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6def38d9e64ef997559a0b1b41e69c', 'request_id': 'req-2730a45e-7f84-4038-a876-484426a0120b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:24.491795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6def38d9e64ef997559a0b1b41e69c', 'request_id': 'req-2730a45e-7f84-4038-a876-484426a0120b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:24.513240 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1912/3801] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:30:24.524404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.525262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.525395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.536343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] The token cache is being invalidate because project fb6def38d9e64ef997559a0b1b41e69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:24.536732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:24.538861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2730a45e-7f84-4038-a876-484426a0120b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:24.542324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1890/3802] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:23 2022] DELETE /identity/v3/projects/fb6def38d9e64ef997559a0b1b41e69c => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:24.547331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a10c2-7517-4224-a83f-7e7d4a27a1a2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.550332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a10c2-7517-4224-a83f-7e7d4a27a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.559064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a10c2-7517-4224-a83f-7e7d4a27a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.574818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] MFA Rules not processed for user `d8b3cf194d6345a1ad9209a65f24ebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:24.579570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.599486 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1913/3803] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:30:24.618286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9d3a10c2-7517-4224-a83f-7e7d4a27a1a2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:24.620224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9d3a10c2-7517-4224-a83f-7e7d4a27a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.751358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:24.753635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.803156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1891/3804] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:24.822011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.822664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.823546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.897483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:24.903518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.930755 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1892/3805] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:24.934936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:24.936928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadf6a-686e-439d-97fe-c891de63dadd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:24.952438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:24.953378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.957550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8fb3-50b7-441c-8cd0-b6081f3c298b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:24.957832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.958308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.960521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:24.975734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:24.976639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:24.977209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:24.977673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:24.978808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:30:24.980314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:24.984267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:24.990011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:24.994425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:25.013806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:25.025540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1893/3806] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:30:25.026245 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1914/3807] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:30:25.032705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:25.055187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a9872-77e5-4611-b225-89806b88fe3c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:25.062133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:25.063323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:25.064282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:25.065884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:25.069673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:25.080288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:25.268817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1894/3808] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:25 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:25.269912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:25.291041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8144-67d5-4d85-8b66-7d7454ad2ec9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:25.446915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:25.450046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:25.450373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:25.452578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:25.453387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:25.463495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:25.751201 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1915/3809] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:25 2022] POST /identity/v3/users => generated 293 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:30:25.756007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:25.770741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5a9e-128a-4dcb-821f-203803d4d254 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:25.786162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:25.786909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:25.787187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:25.787450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:25.788099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:25.789702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:25.817499 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1895/3810] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:30:25.821792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:25.836583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0127f-6331-4274-8a7e-4e105305cdd1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:25.848703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:25.849331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:25.849608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:25.849878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:25.850526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:25.855806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12a00-ee8e-4957-8058-617fa7f15490 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:25.882039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1916/3811] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:30:25.887584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:25.913274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ecb3f-a63b-42b8-badc-ecbb591b2133 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:25.947674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:25.952637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:25.957515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:25.958053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] PATH_INFO: `/v3/projects/f9554c24fd4648b5baf013ca0a8cb6f0/users/3f8659994eed45e8911b841423ed1e99/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:26.045426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9554c24fd4648b5baf013ca0a8cb6f0, user_id=3f8659994eed45e8911b841423ed1e99, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:26.048155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:26.129009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1896/3812] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:25 2022] PUT /identity/v3/projects/f9554c24fd4648b5baf013ca0a8cb6f0/users/3f8659994eed45e8911b841423ed1e99/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:26.144648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:26.144988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:26.145221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:26.236747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:26.249892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] MFA Rules not processed for user `3f8659994eed45e8911b841423ed1e99`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:26.251146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:26.407938 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1917/3813] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:26.413083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:26.632840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132232b-d51f-496a-a185-0b4e2bc86238 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:26.652716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:26.653390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:26.653649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:26.654109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:26.654971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:26.657663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:26.681180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:26.683646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:26.744393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa58a8-e8bd-400b-8c33-6ed562f298f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:26.765276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:26.765932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:26.766209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:26.766481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] PATH_INFO: `/v3/projects/959827d027b742deb4585b9fa7d6b7a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:26.770269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=959827d027b742deb4585b9fa7d6b7a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:26.775929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:26.835425 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1897/3814] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:26.839696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:26.943087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959827d027b742deb4585b9fa7d6b7a0', 'request_id': 'req-0beafb24-bb0d-4059-a1ed-f15686586efb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:27.001298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61430-eb18-4a61-bbde-ba3394bf0b2a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:27.055957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959827d027b742deb4585b9fa7d6b7a0', 'request_id': 'req-0beafb24-bb0d-4059-a1ed-f15686586efb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:27.067498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959827d027b742deb4585b9fa7d6b7a0', 'request_id': 'req-0beafb24-bb0d-4059-a1ed-f15686586efb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:27.092238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:27.118285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] The token cache is being invalidate because project 959827d027b742deb4585b9fa7d6b7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:30:27.119510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:27.123185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0beafb24-bb0d-4059-a1ed-f15686586efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:30:27.149015 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1918/3815] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:30:26 2022] DELETE /identity/v3/projects/959827d027b742deb4585b9fa7d6b7a0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:27.156065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdd5d2-18f0-47f5-87d1-8382eea2c42d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.156403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdd5d2-18f0-47f5-87d1-8382eea2c42d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.157804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdd5d2-18f0-47f5-87d1-8382eea2c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.183122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:27.183762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.184046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.184322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.184961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:27.186933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:27.243159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61bdd5d2-18f0-47f5-87d1-8382eea2c42d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:27.249465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61bdd5d2-18f0-47f5-87d1-8382eea2c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:27.281728 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1919/3816] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:27.285259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.292908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.293432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.350512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1898/3817] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:26 2022] POST /identity/v3/users => generated 298 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:27.357000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:27.360297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:27.375377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:27.376825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:27.412132 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1920/3818] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:27.417419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:27.423114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d06f8-d6ab-4fdd-8532-50a26ae7779a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:27.436389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870f20-5564-43fc-b0b0-28520ddfbcb0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:27.447392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:27.448026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.448307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.448582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.449228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:27.450721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:27.451504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.451953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.452376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.453431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:30:27.453903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:27.455626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:27.457443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:27.494874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1921/3819] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:30:27.496286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:27.505619 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1899/3820] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:27.509890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:27.521496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c1020-9516-4ad9-8e3a-faab01abff84 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:27.549364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:27.551050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.551177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df7b8-314d-4b3f-a38a-0bf50d20ea51 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:27.551815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.552253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.553047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:27.556552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:27.576535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:27.581267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.581603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.582863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] PATH_INFO: `/v3/projects/0669c818dcd748beb77cef91366c0217/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.667563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669c818dcd748beb77cef91366c0217, user_id=d8ecdbee30ec4adc98d1c4cf1c5e9dcb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:27.670592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c68221-9feb-46e9-86d1-7715452c6a7b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:27.724663 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1922/3821] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:27 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:27.725646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:27.789331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1900/3822] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:27 2022] PUT /identity/v3/projects/0669c818dcd748beb77cef91366c0217/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:27.792509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:27.792794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:27.793065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:27.853971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] MFA Rules not processed for user `8667041b511a4ab3a6e93645f23ccc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:27.860288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:27.872954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:27.977067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e617-88dc-4228-ae69-c7e785dced8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.100282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1901/3823] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:28.101426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.205245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.207330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.208659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.208659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.208659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.218075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.307015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b5fd-0446-4501-8030-15860402d6b5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.324094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.325509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.325509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.325509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.327358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.329777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.366486 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1923/3824] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:27 2022] POST /identity/v3/users => generated 289 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:28.366486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.372523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1902/3825] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:28.373158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.388684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d76c7-b742-4677-9380-444da6cccc07 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.406733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.407576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.407858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.408127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.409390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.413254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.432604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b3d00-477b-424e-829f-832c48060447 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.446958 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1903/3826] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:28.450393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.458440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.459223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.459510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.459798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] PATH_INFO: `/v3/projects/0669c818dcd748beb77cef91366c0217/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.469661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669c818dcd748beb77cef91366c0217, user_id=d8ecdbee30ec4adc98d1c4cf1c5e9dcb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.479893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f25d-828f-41fd-9ba6-f98863bf9460 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.483891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2619d-ef8a-48e8-9a27-6ec41fa59066 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.504673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.506570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.507970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.507970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.507970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.510280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.529092 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1924/3827] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:28 2022] PUT /identity/v3/projects/0669c818dcd748beb77cef91366c0217/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:28.541894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.542457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.543376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.588859 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1904/3828] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:28.593547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.612508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c73be4-09b7-4570-9468-0fee750d603e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:28.618725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:28.660744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] MFA Rules not processed for user `d8ecdbee30ec4adc98d1c4cf1c5e9dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:28.664341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:28.812874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:28.813890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:28.814175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:28.814450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] PATH_INFO: `/v3/projects/9b8421af2aa3439b9f20d98ab9ded9c8/users/f6e5ac25311c4a979f5fdd0d3f02c3e1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:28.892755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8421af2aa3439b9f20d98ab9ded9c8, user_id=f6e5ac25311c4a979f5fdd0d3f02c3e1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:28.929415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc0aa7-9bb6-4e15-80f8-c3ab529caa69 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:28.938518 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1925/3829] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:30:28.956316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:28.961192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:29.069037 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1905/3830] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:28 2022] PUT /identity/v3/projects/9b8421af2aa3439b9f20d98ab9ded9c8/users/f6e5ac25311c4a979f5fdd0d3f02c3e1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:29.074686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:29.075479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:29.077468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:29.107290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:29.122883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:29.124495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:29.175472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305991-4bf9-432a-883f-4a226cf82752 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:29.405038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:29.406651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:29.413224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:29.413773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:29.425307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:29.479643 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1906/3831] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:29.550187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:29.551494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:29.683423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:29.685069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f372e37-31f4-4187-a467-02f381b25e75 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:29.727352 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1926/3832] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:30:29.747648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3a1a-8f85-4816-8d3e-13709e4d7fb4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:29.776652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:29.777286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:29.777566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:29.777841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:29.804136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:29.806877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:29.836802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1907/3833] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:36.118534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:36.119491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:36.120017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:36.196511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] MFA Rules not processed for user `f3b7ea18f94a4dfcaf5e7d3f8b934163`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:36.210998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:36.563612 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1927/3834] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:36.565229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:36.573547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:36.637641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5044290-d7d0-400f-8b93-f0b8f3556757 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:36.681454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:36.682084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:36.684885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:36.689258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:36.689258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:36.693248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:36.884439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1908/3835] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:30:36 2022] POST /identity/v3/projects => generated 377 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:36.892478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:36.928008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8de062-e4a9-4915-b7e1-387522186ce3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:37.041935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:37.072943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:37.073579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:37.073860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:37.079470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:37.080941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:37.083596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:37.234762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1928/3836] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:30:36 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:30:37.235298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:37.278439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797d74-dd43-49d2-b4f1-bea40adf50e0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:37.293474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:37.294247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:37.294660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:37.295044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:37.296003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:37.298923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:37.314070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:37.329185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:37.344486 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1909/3837] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:37.349919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05fca-a471-4c48-a3b7-c0f5c561fa50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:37.363702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:37.364825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:37.365382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:37.366733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] PATH_INFO: `/v3/projects/f801301aaf054a1eaa7066d7dc1309f5/users/2fba039929954f14a57e507e55d9a19f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:37.419626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f801301aaf054a1eaa7066d7dc1309f5, user_id=2fba039929954f14a57e507e55d9a19f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:37.425434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:37.534821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1929/3838] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:37 2022] PUT /identity/v3/projects/f801301aaf054a1eaa7066d7dc1309f5/users/2fba039929954f14a57e507e55d9a19f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:30:37.538557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:37.555057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf74f-9e18-4217-8306-6cd21e402e31 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:37.843451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:37.849340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:37.849834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:37.850433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:37.859647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:37.865223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:37.919034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:37.920247 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1910/3839] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:30:37.949210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7efcea-8bc4-4933-bc19-309380e894c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:37.996483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:37.997359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:37.997714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:37.998572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] PATH_INFO: `/v3/projects/f801301aaf054a1eaa7066d7dc1309f5/users/2fba039929954f14a57e507e55d9a19f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:38.006714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f801301aaf054a1eaa7066d7dc1309f5, user_id=2fba039929954f14a57e507e55d9a19f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:38.021560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0558ac-a1ce-4368-9fdf-8f9e2eca1a72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:38.085711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1930/3840] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:30:37 2022] PUT /identity/v3/projects/f801301aaf054a1eaa7066d7dc1309f5/users/2fba039929954f14a57e507e55d9a19f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:30:44.744939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:44.751559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:44.984703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18356cb-7c5a-43c8-9e2c-1a0af5da924e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:45.182253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:45.191670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:45.193951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:45.197358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:45.508667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:45.513654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:45.551218 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1911/3841] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:48.057204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=24,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:51.203858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a8dd-cce6-42d0-b8f5-0129a5cbee1f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:51.204882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a8dd-cce6-42d0-b8f5-0129a5cbee1f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:51.205204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a8dd-cce6-42d0-b8f5-0129a5cbee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:51.319079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2fd7a8dd-cce6-42d0-b8f5-0129a5cbee1f None None] MFA Rules not processed for user `cd37b82f85e94413b10915f48f214342`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:51.327348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fd7a8dd-cce6-42d0-b8f5-0129a5cbee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:51.676132 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1931/3842] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:53.428891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:53.431124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:53.438800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:30:53.678719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09358-46fc-457a-b80e-86b0a6909653 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:53.708687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:53.709369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:53.709590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:53.709901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:53.714385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:53.908642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:53.916508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:53.957206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1912/3843] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:30:58.672684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b245-b5fc-4304-a913-47ddcbbed363 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:58.675570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b245-b5fc-4304-a913-47ddcbbed363 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:58.675570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b245-b5fc-4304-a913-47ddcbbed363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:58.740351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8441b245-b5fc-4304-a913-47ddcbbed363 None None] MFA Rules not processed for user `f6e5ac25311c4a979f5fdd0d3f02c3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:30:58.741468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8441b245-b5fc-4304-a913-47ddcbbed363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:58.894834 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1932/3844] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:30:58.910773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:30:58.910773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:30:58.953209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3526d-367d-467e-b162-30cc47d78d21 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:30:59.011750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:30:59.012533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:30:59.013164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:30:59.013760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:30:59.070242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:30:59.078789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f74a0-7283-4dc6-b12e-85ad0355ddbd service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:30:59.160997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1913/3845] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:03.668221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259c54-26a7-4f53-8a1a-593241321a74 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:03.668892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259c54-26a7-4f53-8a1a-593241321a74 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:03.669274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259c54-26a7-4f53-8a1a-593241321a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:03.763773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90259c54-26a7-4f53-8a1a-593241321a74 None None] MFA Rules not processed for user `30654870bc994ffab886c9ad05379643`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:03.774560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90259c54-26a7-4f53-8a1a-593241321a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:03.823962 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1933/3846] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:07.777375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:07.777879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:07.777966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:07.824321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] MFA Rules not processed for user `f6e5ac25311c4a979f5fdd0d3f02c3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:07.825832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:07.868257 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1914/3847] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:07.871931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:07.872791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:07.873252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:07.947598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] MFA Rules not processed for user `2fba039929954f14a57e507e55d9a19f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:07.949091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:08.092863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:08.113891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1934/3848] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:08.125454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:08.140496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35276-592d-4d97-8b36-d9cbaef26698 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:08.150248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:08.150914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:08.151196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:08.151475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:08.246066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:08.247824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10707cf0-a0bf-430b-ad62-ffaff3414f2a service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:08.259330 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1915/3849] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:08.992509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:09.155153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668d54e-19a8-46da-bc61-b420afc9f4f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:09.160572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:09.161535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:09.162031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:09.162523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] PATH_INFO: `/v3/users/3f8659994eed45e8911b841423ed1e99` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:09.163990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8659994eed45e8911b841423ed1e99)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:09.167371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:09.440507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8659994eed45e8911b841423ed1e99'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:09.441634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8659994eed45e8911b841423ed1e99'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:09.572225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8659994eed45e8911b841423ed1e99'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:09.624626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8659994eed45e8911b841423ed1e99'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:09.625931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-106ab006-47e3-46e3-b2ac-6a4a3a3830a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8659994eed45e8911b841423ed1e99'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:09.662150 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1935/3850] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:08 2022] DELETE /identity/v3/users/3f8659994eed45e8911b841423ed1e99 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:09.666879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:09.667386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:09.667473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:09.741853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:09.755379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:09.800617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:09.952075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:09.952740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:09.953383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:09.983849 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1916/3851] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:09.983849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:09.991796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:10.016817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:10.025676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:10.160414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d30cda-53f5-4a62-b889-8429152346a5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:10.167558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:10.168587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:10.170173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:10.170738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:10.210927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:10.213295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:10.247209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1917/3852] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:10.277271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1936/3853] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:10.296981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:10.298870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:10.480099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93d54-c1a4-4064-accb-0cb23c688627 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:10.487316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:10.490870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:10.491819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:10.493141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:10.509414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:10.513604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:10.529712 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1918/3854] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:31:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:31:11.296554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:11.300806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:11.333537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379898-8d60-4edb-a456-50575a6b3316 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:11.343491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:11.345884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:11.346328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:11.350338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] PATH_INFO: `/v3/projects/f9554c24fd4648b5baf013ca0a8cb6f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:11.352038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9554c24fd4648b5baf013ca0a8cb6f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:11.354125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:11.423893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:11.666973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9554c24fd4648b5baf013ca0a8cb6f0', 'request_id': 'req-7b53267c-a80b-4f58-b284-9ef9ca168432'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:11.836089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9554c24fd4648b5baf013ca0a8cb6f0', 'request_id': 'req-7b53267c-a80b-4f58-b284-9ef9ca168432'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:11.843472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9554c24fd4648b5baf013ca0a8cb6f0', 'request_id': 'req-7b53267c-a80b-4f58-b284-9ef9ca168432'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:11.880032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] The token cache is being invalidate because project f9554c24fd4648b5baf013ca0a8cb6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:11.880032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:11.880032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:11.883987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1937/3855] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:11 2022] DELETE /identity/v3/projects/f9554c24fd4648b5baf013ca0a8cb6f0 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:11.888133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:11.901170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69867fb6-adb3-4664-9c0f-1a8ed9e6bab2 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:12.057609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:12.102235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:12.102902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:12.103181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:12.103445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] PATH_INFO: `/v3/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:12.104810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ecdbee30ec4adc98d1c4cf1c5e9dcb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:12.106766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:12.411295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ecdbee30ec4adc98d1c4cf1c5e9dcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:12.414591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ecdbee30ec4adc98d1c4cf1c5e9dcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:12.516680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ecdbee30ec4adc98d1c4cf1c5e9dcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:12.539274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ecdbee30ec4adc98d1c4cf1c5e9dcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:12.543053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26c698a6-3d52-4a93-9300-4aa30ce2f34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ecdbee30ec4adc98d1c4cf1c5e9dcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:12.588369 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1919/3856] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:11 2022] DELETE /identity/v3/users/d8ecdbee30ec4adc98d1c4cf1c5e9dcb => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:13.855496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:13.858002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:13.914480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53267c-a80b-4f58-b284-9ef9ca168432 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:14.159602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:14.161546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:14.164308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:14.166774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] PATH_INFO: `/v3/projects/0669c818dcd748beb77cef91366c0217` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:14.171596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0669c818dcd748beb77cef91366c0217)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:14.179750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:14.510082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0669c818dcd748beb77cef91366c0217', 'request_id': 'req-7f9104a3-a606-43af-a588-8005ecf36a0c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:14.653076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0669c818dcd748beb77cef91366c0217', 'request_id': 'req-7f9104a3-a606-43af-a588-8005ecf36a0c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:14.663606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0669c818dcd748beb77cef91366c0217', 'request_id': 'req-7f9104a3-a606-43af-a588-8005ecf36a0c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:14.687898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] The token cache is being invalidate because project 0669c818dcd748beb77cef91366c0217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:14.688956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:14.691291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7f9104a3-a606-43af-a588-8005ecf36a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:14.695558 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1938/3857] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:13 2022] DELETE /identity/v3/projects/0669c818dcd748beb77cef91366c0217 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:14.703810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:14.703810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:14.704360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:14.750876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:14.752306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:14.859618 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1920/3858] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:14.868982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:14.869485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:14.869485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:14.898323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:14.901590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:14.916802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:14.917437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1939/3859] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:14.929761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7f8a3-a0e9-40fc-b3e0-8f3290190ba5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:14.960163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:14.960803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:14.963000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:14.963290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:14.964871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:14.966138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:14.967912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:15.047940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:15.055408 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1921/3860] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:31:15.060648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665e9cc-8430-44f7-87b8-febc70434bc0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:15.071181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:15.071806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:15.072086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:15.072357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:15.073726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:15.076589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:15.334011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1940/3861] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:15 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:15.338263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:15.356721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacfaf8-456c-4fb3-9e5e-793f987cca58 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:15.549812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:15.565726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:15.567114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:15.570350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:15.570867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:15.571708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:15.574902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:15.727166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1922/3862] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:15 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:15.732187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:15.738436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:15.749052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fb544-dc26-4529-8d17-4b87e9ef34e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:15.761651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:15.762279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:15.762637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:15.763676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:15.767603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:15.767603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:15.789449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1941/3863] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:15.794672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:15.808831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea311c-95b9-42b0-b6aa-30a37ed2a90d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:15.819515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:15.820887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:15.821171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:15.821445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:15.822107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:15.824752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1a0aa-fd5b-4d36-a442-c0ce34ae408a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:15.851697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1923/3864] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:15.855972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:15.874582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2663-3199-4b88-84bc-ad3d41f4a63d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:15.884768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:15.884768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:15.884768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:15.884768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] PATH_INFO: `/v3/projects/c5c44fa298c0458a942cdb6353c22e77/users/d9583bf1202c4e65bc13b96d8b1c6171/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:15.928851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c44fa298c0458a942cdb6353c22e77, user_id=d9583bf1202c4e65bc13b96d8b1c6171, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:15.934201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.036088 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1942/3865] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:15 2022] PUT /identity/v3/projects/c5c44fa298c0458a942cdb6353c22e77/users/d9583bf1202c4e65bc13b96d8b1c6171/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:31:16.048731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a40d0-b48e-4893-a181-4b254132c8a9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.049062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a40d0-b48e-4893-a181-4b254132c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.049283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a40d0-b48e-4893-a181-4b254132c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.085497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bd1a40d0-b48e-4893-a181-4b254132c8a9 None None] MFA Rules not processed for user `d9583bf1202c4e65bc13b96d8b1c6171`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:16.086934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bd1a40d0-b48e-4893-a181-4b254132c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:16.214039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1924/3866] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:16.218561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:16.331029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eadc3-4521-4052-b23f-db6de2de1646 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:16.337618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:16.338537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.339148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.339496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.340251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:16.342701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.383000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.383298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.383579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.414495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:16.416603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:16.501889 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1925/3867] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:16.506283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1943/3868] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:16 2022] POST /identity/v3/projects => generated 377 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:31:16.510418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:16.519884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54440-d2c2-4cb1-bdd1-f643d64d51ed None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:16.628294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:16.629257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.629730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.630191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.631211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:16.633701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.721076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1926/3869] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:16 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:31:16.727091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:16.740859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196687c2-2412-4c7c-9008-a4dca67939fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:16.747408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:16.748594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.749376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.750003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.751785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:16.753739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.772178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1944/3870] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:16.776406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:16.791183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55141a-dfbc-46b4-94a5-d3c84fb420da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:16.804758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:16.806225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.806507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.808459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.809123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:16.811542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32af104-15b0-4ff5-a60a-10f96d943f92 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.846593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:16.848095 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1927/3871] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:16.871991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16f2b-5e27-4b1a-8739-13a45309096a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:16.871991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:16.871991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.871991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.872553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] PATH_INFO: `/v3/projects/0df26fdea97e4aa7b00405599784784a/users/5c17e4bf3e604fb48557b0ca89d0b2af/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:16.889260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df26fdea97e4aa7b00405599784784a, user_id=5c17e4bf3e604fb48557b0ca89d0b2af, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:16.892805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:16.985291 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1945/3872] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:16 2022] PUT /identity/v3/projects/0df26fdea97e4aa7b00405599784784a/users/5c17e4bf3e604fb48557b0ca89d0b2af/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:16.996483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:16.996886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:16.997216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:17.028673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] MFA Rules not processed for user `5c17e4bf3e604fb48557b0ca89d0b2af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:17.029992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:17.141707 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1928/3873] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:17.147400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:17.265896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcc41a-bb65-4d05-9293-25ddc6d8f04d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:17.272641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:17.273524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:17.274214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:17.274732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:17.275825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:17.278644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:17.410047 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1946/3874] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:17 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:17.414858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:17.431551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cbef5-7b3f-45b0-b60b-47dd87224d89 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:17.551061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:17.551680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:17.551975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:17.552242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:17.552881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:17.557729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:17.596332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:17.688175 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1929/3875] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:17 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:17.691955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:17.730060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f51f0-ba91-4b3d-b343-7c88cf79fcd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:17.732512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:17.733369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:17.733970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:17.734399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:17.735319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:17.737965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:17.752765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1947/3876] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:17.758359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:17.774365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0960826-bec0-4d48-990e-c2e459de02ec admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:17.793280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:17.794810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:17.795831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:17.796313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] PATH_INFO: `/v3/projects/c51a4cc9e71741659c366d6e413d1a11/users/c2f89b2a709d427ab2b2e144a3125d23/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:17.828162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51a4cc9e71741659c366d6e413d1a11, user_id=c2f89b2a709d427ab2b2e144a3125d23, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:17.836565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:17.940943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1930/3877] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:17 2022] PUT /identity/v3/projects/c51a4cc9e71741659c366d6e413d1a11/users/c2f89b2a709d427ab2b2e144a3125d23/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:31:17.944957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:17.957269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd04ee-4e20-4511-99f9-32c64624405b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:18.034664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:18.035325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:18.035635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:18.035896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:18.036570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:18.038223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75704221-adbd-4bb1-9f9b-c7e359fc6e44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:18.053406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1948/3878] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:18.058211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:18.085464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:18.088145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5ecff-506c-47fd-8fcc-375175f77c58 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:18.111875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:18.113761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:18.114661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:18.115048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] PATH_INFO: `/v3/projects/c51a4cc9e71741659c366d6e413d1a11/users/c2f89b2a709d427ab2b2e144a3125d23/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:18.118684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51a4cc9e71741659c366d6e413d1a11, user_id=c2f89b2a709d427ab2b2e144a3125d23, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:18.123058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:18.138854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1931/3879] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:18 2022] PUT /identity/v3/projects/c51a4cc9e71741659c366d6e413d1a11/users/c2f89b2a709d427ab2b2e144a3125d23/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:18.150531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:18.151346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:18.152110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:18.195166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] MFA Rules not processed for user `c2f89b2a709d427ab2b2e144a3125d23`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:18.199364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:18.357190 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1949/3880] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:18.369972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:18.378866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:18.451219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12ae39-f933-43d7-9c54-8020431fddbe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:18.455412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:18.456021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:18.456313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:18.456585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:18.549997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:18.549997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:18.549997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1932/3881] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:19.921262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:22.265394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:22.281857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385941f7-ae8c-4d30-bd70-3866efa1cbda None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:22.295007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:22.299412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:22.299992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:22.300478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:22.427125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:22.429014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:22.447292 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1950/3882] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:24.656527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:24.674132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e49fd-d66b-4089-a024-d37f8464cf81 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:24.679106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:24.680106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:24.683425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:24.684033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:24.750249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:24.755006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:24.802505 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1933/3883] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:25.883583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:25.885088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:25.902754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:26.105509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c85ca7-5763-4fba-9712-d4853428ddc5 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:26.121703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:26.122594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:26.123007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:26.123346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:26.125295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:26.126924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:26.128826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:26.140050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:26.142357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:26.155914 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1951/3884] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:26.265695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d20a7c-dfce-4b58-8c9c-5a8687bf2b51 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:26.273115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:26.274177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:26.274638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:26.275088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] PATH_INFO: `/v3/users/d8b3cf194d6345a1ad9209a65f24ebcb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:26.276560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b3cf194d6345a1ad9209a65f24ebcb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:26.278835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:26.314877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:26.664496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b3cf194d6345a1ad9209a65f24ebcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:26.665712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b3cf194d6345a1ad9209a65f24ebcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:26.744822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b3cf194d6345a1ad9209a65f24ebcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:26.760470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b3cf194d6345a1ad9209a65f24ebcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:26.761588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3933e5ea-b1fb-4b94-ae4d-4078663164ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b3cf194d6345a1ad9209a65f24ebcb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:26.782801 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1934/3885] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:26 2022] DELETE /identity/v3/users/d8b3cf194d6345a1ad9209a65f24ebcb => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:27.231984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:27.252116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346eb3-6e44-4f09-ab7d-ae0775c89f09 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:27.395185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:27.395981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:27.396263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:27.398410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] PATH_INFO: `/v3/projects/47a4702527e949e7912331b45c5fb2d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:27.398808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a4702527e949e7912331b45c5fb2d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:27.404222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:27.698056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a4702527e949e7912331b45c5fb2d7', 'request_id': 'req-824ad97a-c634-44cc-815f-acc78fd44233'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:27.788722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a4702527e949e7912331b45c5fb2d7', 'request_id': 'req-824ad97a-c634-44cc-815f-acc78fd44233'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:27.794977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:27.798882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a4702527e949e7912331b45c5fb2d7', 'request_id': 'req-824ad97a-c634-44cc-815f-acc78fd44233'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:27.820154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] The token cache is being invalidate because project 47a4702527e949e7912331b45c5fb2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:27.820658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:27.821750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-824ad97a-c634-44cc-815f-acc78fd44233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:27.823577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1952/3886] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:27 2022] DELETE /identity/v3/projects/47a4702527e949e7912331b45c5fb2d7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:27.829122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:27.829700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:27.829700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:27.940575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:27.944236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:28.022316 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1935/3887] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:28.031195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.031490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.031791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.060038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:28.061832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:28.071393 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1953/3888] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:28.075701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.086473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106319f5-06a1-40c4-97e0-dd98529ccffe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.093317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.093962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.095324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.095615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.097155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:28.097463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.099168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.116094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1936/3889] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:31:28.117502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.131835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103d285-b424-407e-9dba-4bd8b35321c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.140764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.143642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.144597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.144948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.151099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.151099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.310847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1954/3890] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:28 2022] POST /identity/v3/projects => generated 399 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:28.313421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.335348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06907-c375-402d-9ba4-407e1d9a31c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.427433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:28.446728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.447413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.447771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.448184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.449857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.456121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.628087 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1937/3891] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:28 2022] POST /identity/v3/users => generated 300 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:28.631880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.648458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acb0f-82cf-409e-ab19-591651e3a484 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.659071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.659954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.661221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.662434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.666759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.670599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.705628 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1955/3892] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:28.709638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.726830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b788058-b924-44d3-a991-51bafe277f45 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.743059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.744615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.759648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.760687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.763307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.768149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101b549-dc8f-4d76-b891-7595da8818e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.792289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1938/3893] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:28.795181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:28.830652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a36a4-4759-4d8e-8ba8-d7cf360a5449 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:28.841971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:28.842754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.842937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.843219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] PATH_INFO: `/v3/projects/6f03b31fe2a945fbb76a1be8fc5abdfb/users/8c5d440469ac40c2a39eaa5aef2119a7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:28.879341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f03b31fe2a945fbb76a1be8fc5abdfb, user_id=8c5d440469ac40c2a39eaa5aef2119a7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:28.889435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:28.985565 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1956/3894] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:28 2022] PUT /identity/v3/projects/6f03b31fe2a945fbb76a1be8fc5abdfb/users/8c5d440469ac40c2a39eaa5aef2119a7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:28.990524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:28.991111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:28.991111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:29.027678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:29.029254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:29.196786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1939/3895] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:29.234420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:29.237066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:29.454844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2341-9753-4e40-974e-8fc52b4616cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:29.467356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:29.467994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:29.468277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:29.468552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:29.505377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:29.509080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28755e7f-fba2-400e-ba7b-71b7dd14f7e2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:29.525389 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1957/3896] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:38.619412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:38.621176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:38.645145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247cfe-f580-4ad4-ad80-88d5cd4dde94 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:38.657781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:38.658653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:38.659194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:38.659565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] PATH_INFO: `/v3/users/d9583bf1202c4e65bc13b96d8b1c6171` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:38.662506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9583bf1202c4e65bc13b96d8b1c6171)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:38.665457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:38.950771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9583bf1202c4e65bc13b96d8b1c6171'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:38.954754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9583bf1202c4e65bc13b96d8b1c6171'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:39.046924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9583bf1202c4e65bc13b96d8b1c6171'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:39.071443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9583bf1202c4e65bc13b96d8b1c6171'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:39.073240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9583bf1202c4e65bc13b96d8b1c6171'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:39.107139 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1940/3897] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:38 2022] DELETE /identity/v3/users/d9583bf1202c4e65bc13b96d8b1c6171 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:39.112192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:39.113225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:39.113665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:39.157162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:39.165151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:39.303627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:39.319784 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1958/3898] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:39.373226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:39.374535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:39.514700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:39.522099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c4cc3-5ac4-4de9-a18c-4d846b9df6ed admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:39.528334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:39.529269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:39.529648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:39.530019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:39.543064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:39.544870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:39.566749 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1941/3899] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:41.101124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:41.102823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:41.254381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11c8f8-8d84-4bfc-b95d-7abc00c10389 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:41.268909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:41.289298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:41.289298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:41.289298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:41.289298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:41.350741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:41.352343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:41.362810 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1959/3900] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:41.421776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:41.424381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:41.441355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbcf4-84db-48c3-938f-b1b0b76e458c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:41.455817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:41.457494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:41.457948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:41.458377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] PATH_INFO: `/v3/projects/c5c44fa298c0458a942cdb6353c22e77` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:41.459799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c44fa298c0458a942cdb6353c22e77)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:41.463151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:41.785398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c44fa298c0458a942cdb6353c22e77', 'request_id': 'req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:41.891975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c44fa298c0458a942cdb6353c22e77', 'request_id': 'req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:41.912954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c44fa298c0458a942cdb6353c22e77', 'request_id': 'req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:41.940387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] The token cache is being invalidate because project c5c44fa298c0458a942cdb6353c22e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:41.940889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:41.941662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:41.944353 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1942/3901] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:41 2022] DELETE /identity/v3/projects/c5c44fa298c0458a942cdb6353c22e77 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:41.948294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:41.961793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2c65b-9a59-405d-b7f0-ae0b80c3d0fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:42.050595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:42.051419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:42.051922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:42.052431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] PATH_INFO: `/v3/users/5c17e4bf3e604fb48557b0ca89d0b2af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:42.053790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c17e4bf3e604fb48557b0ca89d0b2af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:42.055749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:42.315182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:42.316648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:42.330124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36c42-c1e7-4df9-99ae-dd56a7c67acb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:42.334983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:42.335754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:42.336071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:42.336344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] PATH_INFO: `/v3/users/5400400f5ecc4db28f887ac684c58d16` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:42.337460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5400400f5ecc4db28f887ac684c58d16)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:42.339548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:42.448157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:42.469381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c17e4bf3e604fb48557b0ca89d0b2af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.469381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c17e4bf3e604fb48557b0ca89d0b2af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.635298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c17e4bf3e604fb48557b0ca89d0b2af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.652361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c17e4bf3e604fb48557b0ca89d0b2af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.653094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c17e4bf3e604fb48557b0ca89d0b2af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.668437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1960/3902] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:41 2022] DELETE /identity/v3/users/5c17e4bf3e604fb48557b0ca89d0b2af => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:42.706768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5400400f5ecc4db28f887ac684c58d16'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.706768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5400400f5ecc4db28f887ac684c58d16'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.825113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5400400f5ecc4db28f887ac684c58d16'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.848757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5400400f5ecc4db28f887ac684c58d16'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.850455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5400400f5ecc4db28f887ac684c58d16'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:42.899078 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1943/3903] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:42 2022] DELETE /identity/v3/users/5400400f5ecc4db28f887ac684c58d16 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:43.689025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:43.690543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:43.877204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8b3f-6eb1-4612-9d82-993088d5d6b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:43.976158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:43.976903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:43.977317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:43.978409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] PATH_INFO: `/v3/projects/0df26fdea97e4aa7b00405599784784a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:43.979993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df26fdea97e4aa7b00405599784784a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:43.986687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:43.999624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:44.019160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.072448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09b4f-6b60-4122-b6c2-8181265efbc3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:44.106187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:44.107134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.107794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.108219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] PATH_INFO: `/v3/projects/347b92c73e4e4feba2748ccade2dd609` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.111022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] RBAC: Authorizing `identity:delete_project(project_id=347b92c73e4e4feba2748ccade2dd609)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:44.113596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:44.210237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df26fdea97e4aa7b00405599784784a', 'request_id': 'req-4cdc67ca-ae1e-4163-a335-25f4df333787'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.284545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:44.307784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347b92c73e4e4feba2748ccade2dd609', 'request_id': 'req-27fe2416-eda2-4993-af82-de15a3c7599e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.315296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df26fdea97e4aa7b00405599784784a', 'request_id': 'req-4cdc67ca-ae1e-4163-a335-25f4df333787'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.322760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df26fdea97e4aa7b00405599784784a', 'request_id': 'req-4cdc67ca-ae1e-4163-a335-25f4df333787'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.344150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] The token cache is being invalidate because project 0df26fdea97e4aa7b00405599784784a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:44.346991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.348974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.353632 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1961/3904] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:43 2022] DELETE /identity/v3/projects/0df26fdea97e4aa7b00405599784784a => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:44.354874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:44.356475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.447686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347b92c73e4e4feba2748ccade2dd609', 'request_id': 'req-27fe2416-eda2-4993-af82-de15a3c7599e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.459599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347b92c73e4e4feba2748ccade2dd609', 'request_id': 'req-27fe2416-eda2-4993-af82-de15a3c7599e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.466013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:44.484175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] The token cache is being invalidate because project 347b92c73e4e4feba2748ccade2dd609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:44.485127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.485963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27fe2416-eda2-4993-af82-de15a3c7599e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:44.488105 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1944/3905] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:43 2022] DELETE /identity/v3/projects/347b92c73e4e4feba2748ccade2dd609 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:44.489659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e7d6-cd8a-4a1a-af99-f0536177008e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.490010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e7d6-cd8a-4a1a-af99-f0536177008e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.490347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e7d6-cd8a-4a1a-af99-f0536177008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.524715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc67ca-ae1e-4163-a335-25f4df333787 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:44.552617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e894e7d6-cd8a-4a1a-af99-f0536177008e None None] MFA Rules not processed for user `8c5d440469ac40c2a39eaa5aef2119a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:44.553924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e894e7d6-cd8a-4a1a-af99-f0536177008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.662324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:44.663374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.663821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.664259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] PATH_INFO: `/v3/users/c2f89b2a709d427ab2b2e144a3125d23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.665727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f89b2a709d427ab2b2e144a3125d23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:44.669194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:44.735934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1945/3906] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:44.737580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f60d-448c-4444-a3e7-698d84dba761 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.738045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f60d-448c-4444-a3e7-698d84dba761 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.738472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f60d-448c-4444-a3e7-698d84dba761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.778769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-92f2f60d-448c-4444-a3e7-698d84dba761 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:44.780220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92f2f60d-448c-4444-a3e7-698d84dba761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.809147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1946/3907] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:44.810789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74287b33-0bea-498e-b949-772d0526d609 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.811094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74287b33-0bea-498e-b949-772d0526d609 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.811372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74287b33-0bea-498e-b949-772d0526d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.854745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-74287b33-0bea-498e-b949-772d0526d609 None None] MFA Rules not processed for user `8c5d440469ac40c2a39eaa5aef2119a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:44.856036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-74287b33-0bea-498e-b949-772d0526d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.869154 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1947/3908] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:44.871332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:44.871660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:44.871926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:44.901273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:44.902939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:44.912914 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1948/3909] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:44.913818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:44.915184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:45.028065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773421-406f-4f03-ad6c-91e82d9af6bd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.037002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.037635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.037923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.038194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.047695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.049440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.059323 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1949/3910] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:45.060152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.070960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3d5be-68fc-4698-9b74-d9d1566d288f service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.075765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.076438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.076813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.077206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.077918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:45.078228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.080404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.092351 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1950/3911] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:31:45.098671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.110331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3477-f3c3-424d-81f0-95589b155ec7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.118398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.119127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.119575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.119715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.120330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.122059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f89b2a709d427ab2b2e144a3125d23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:45.122523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.123260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f89b2a709d427ab2b2e144a3125d23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:45.218537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f89b2a709d427ab2b2e144a3125d23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:45.233923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f89b2a709d427ab2b2e144a3125d23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:45.235338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f89b2a709d427ab2b2e144a3125d23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:45.255125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1962/3912] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:44 2022] DELETE /identity/v3/users/c2f89b2a709d427ab2b2e144a3125d23 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:45.299629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1951/3913] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:45 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:31:45.303954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.305478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:45.393686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f727-2060-426f-8131-9a82499374ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.453229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.453888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.454171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.454468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.455204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.457177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.710075 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1963/3914] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:45 2022] POST /identity/v3/users => generated 284 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:45.712041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.726578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0f33-4c9e-4523-88dd-e60b11de9543 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.731411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.732020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.732305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.732870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.733261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.735617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.746306 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1952/3915] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:45.756332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.785344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70ca4-e672-4bc8-9949-7dc77efcf51e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.802673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.808199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.809002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.810163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.812915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.814931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:45.842744 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1964/3916] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:45.845463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:45.870867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e964a-3e1c-4424-b0af-42623b847ed6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:45.889266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:45.890000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:45.890496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:45.891399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] PATH_INFO: `/v3/projects/4fbb89daa56846be91cc0118fb2e7b99/users/763e2752fd774e37886ff2f629896e61/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:45.940401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbb89daa56846be91cc0118fb2e7b99, user_id=763e2752fd774e37886ff2f629896e61, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:45.953820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba1c3-35f4-4137-a881-6da62d20f514 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:46.021318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:46.023474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:46.045748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1953/3917] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:45 2022] PUT /identity/v3/projects/4fbb89daa56846be91cc0118fb2e7b99/users/763e2752fd774e37886ff2f629896e61/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:46.050398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.051023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.056273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68535f-12c5-49e6-99f5-736302a28e62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:46.066354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.117240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:46.119308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:46.211312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:46.213388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.213621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.213897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] PATH_INFO: `/v3/projects/c51a4cc9e71741659c366d6e413d1a11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.215384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51a4cc9e71741659c366d6e413d1a11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:46.228223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:46.234063 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1954/3918] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:46.242305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:46.244084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:46.336179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e9a5-3e0b-4d3a-9bd5-4c37725269d8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:46.346917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:46.348089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.348577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.349019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.372400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:46.374045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d809c-b85c-4172-8243-3dae180b0ce3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:46.401324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1955/3919] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:46.478712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51a4cc9e71741659c366d6e413d1a11', 'request_id': 'req-c29b0ec7-003d-4531-bd77-57a7849789d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:46.674745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51a4cc9e71741659c366d6e413d1a11', 'request_id': 'req-c29b0ec7-003d-4531-bd77-57a7849789d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:46.687412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51a4cc9e71741659c366d6e413d1a11', 'request_id': 'req-c29b0ec7-003d-4531-bd77-57a7849789d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:46.729490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] The token cache is being invalidate because project c51a4cc9e71741659c366d6e413d1a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:46.730758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:46.732685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c29b0ec7-003d-4531-bd77-57a7849789d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:46.735249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1965/3920] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:46 2022] DELETE /identity/v3/projects/c51a4cc9e71741659c366d6e413d1a11 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:46.749084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.749309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.749586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.784328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:46.788245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:46.885004 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1956/3921] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:46.893458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.893747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.894033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.920604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:46.921943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:46.932694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1966/3922] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:46.938270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:46.949801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781ce1f-f942-4e3a-85e0-86c8cf11da12 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:46.955599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:46.956512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.956795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.957069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.957800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:46.958124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:46.960097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:46.978759 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1957/3923] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:31:46.980152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:46.991809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16d18c-30fd-402b-b112-a4766caf62c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:46.997877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:46.998353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:46.998656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:46.998940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:46.999612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.002144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.150722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1967/3924] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:46 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:47.153413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:47.168557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989bd7f-0f40-478f-9014-66053f80f2f7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:47.303372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:47.304297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.304740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.305202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.306014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.309229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.539528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1958/3925] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:47 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:47.543856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:47.556668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc541-449c-4848-8694-824fa602769c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:47.561997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:47.562706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.563534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.563806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.564436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.566541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.585011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1968/3926] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:31:47.597658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:47.612388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9bc-fcca-4df3-83d7-8127c9699a2f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:47.618353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:47.618755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.619087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.619357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.620145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.621748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.636649 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1959/3927] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:47.641566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:47.669104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024077c1-9f70-451d-aba1-8b3bec46a5ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:47.684530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:47.687301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.687620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.691102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] PATH_INFO: `/v3/projects/7ac8bf60ce094749bf7f84d989791213/users/cc77ae21c18340358f970664518185c1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.716951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:47.720085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:47.736451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac8bf60ce094749bf7f84d989791213, user_id=cc77ae21c18340358f970664518185c1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.740050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1390d3-7993-408b-bd8d-7374758e002d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.759495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553c03-728a-460d-9082-7cb2b23f0294 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:47.778409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:47.779389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.779389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.779804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] PATH_INFO: `/v3/users/8667041b511a4ab3a6e93645f23ccc47` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.781859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8667041b511a4ab3a6e93645f23ccc47)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:47.784720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:47.891538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1969/3928] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:47 2022] PUT /identity/v3/projects/7ac8bf60ce094749bf7f84d989791213/users/cc77ae21c18340358f970664518185c1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:47.898758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:47.899009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:47.899258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:47.934930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] MFA Rules not processed for user `cc77ae21c18340358f970664518185c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:47.936294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:48.013823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1970/3929] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:48.018941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.074275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8667041b511a4ab3a6e93645f23ccc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.075344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8667041b511a4ab3a6e93645f23ccc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.097166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1772-aa37-41f8-afea-dd48cda06cdf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.101866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.102461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.157242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.157242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:48.157242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:48.157242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:48.227863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8667041b511a4ab3a6e93645f23ccc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.241536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8667041b511a4ab3a6e93645f23ccc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.242254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8667041b511a4ab3a6e93645f23ccc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.259603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1960/3930] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:47 2022] DELETE /identity/v3/users/8667041b511a4ab3a6e93645f23ccc47 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:48.320853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1971/3931] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:31:48.321985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.323629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:48.425443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5036-7019-408a-8cd5-1f7addf570b3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.525428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.526074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.526355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.526666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:48.527296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:48.529224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:48.579543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.581233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:48.600456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca252-d279-47b3-ad51-2886d5d05e61 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.615342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.616067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.616348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.616666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] PATH_INFO: `/v3/projects/43da78e418a64ac6839d09f984ff9bdd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:48.618447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=43da78e418a64ac6839d09f984ff9bdd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:48.620588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:48.778840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1961/3932] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:48 2022] POST /identity/v3/users => generated 293 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:48.778840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.792164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c8d7c-b9c3-4a93-a993-f2fbf9bf6377 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.796866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:48.813183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.815182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.815182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.815419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:48.817613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:48.822560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:48.827477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43da78e418a64ac6839d09f984ff9bdd', 'request_id': 'req-0415c186-2b45-4658-ba0c-336c5f54dccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:48.843047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1962/3933] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:31:48.849246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.874967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a661a6-bdda-4495-88ad-e0dc97e6c534 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.946601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.947245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.947522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.949808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:48.949808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:48.952287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:48.966306 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1963/3934] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:31:48.970724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:48.984875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e988fa-c6fd-4db7-9e1e-a3de31a946e9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:48.990212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:48.990926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:48.991222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:48.991477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] PATH_INFO: `/v3/projects/ac8f12f503c7486cb5f92937b1f6d679/users/816b109aa7ab45e585d2f2943195e767/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.007952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8f12f503c7486cb5f92937b1f6d679, user_id=816b109aa7ab45e585d2f2943195e767, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.011060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1987dbe-88de-4671-8f52-99b3c0f95098 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:49.012337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43da78e418a64ac6839d09f984ff9bdd', 'request_id': 'req-0415c186-2b45-4658-ba0c-336c5f54dccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:49.019219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43da78e418a64ac6839d09f984ff9bdd', 'request_id': 'req-0415c186-2b45-4658-ba0c-336c5f54dccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:49.034250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] The token cache is being invalidate because project 43da78e418a64ac6839d09f984ff9bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:49.034445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:49.035176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415c186-2b45-4658-ba0c-336c5f54dccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:49.040294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1972/3935] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:48 2022] DELETE /identity/v3/projects/43da78e418a64ac6839d09f984ff9bdd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:31:49.042120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e4e2-062a-4865-9c73-737b570b4f20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.042543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e4e2-062a-4865-9c73-737b570b4f20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.042936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596e4e2-062a-4865-9c73-737b570b4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.064491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:49.084178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7596e4e2-062a-4865-9c73-737b570b4f20 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:49.085408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7596e4e2-062a-4865-9c73-737b570b4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:49.097232 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1973/3936] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:49.104649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.105108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.105663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.129529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:49.131178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:49.139639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1974/3937] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:49.145091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:49.155015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5f18-aeae-4a02-a03d-08dae9f85322 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:49.161108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:49.161785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.162090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.162361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.163041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:49.163345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.165140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:49.180321 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1975/3938] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:31:49.190120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:49.200682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46e9f-9162-4fd0-b13a-e0267aaf9121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:49.206518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:49.207167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.207448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.207720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.208380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.210468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:49.229114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1964/3939] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:48 2022] PUT /identity/v3/projects/ac8f12f503c7486cb5f92937b1f6d679/users/816b109aa7ab45e585d2f2943195e767/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:49.365117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.365117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.365117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.399046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] MFA Rules not processed for user `816b109aa7ab45e585d2f2943195e767`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:49.400392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:49.485972 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1965/3940] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:49.486999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:49.488640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:49.560348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf9eb2-1165-4f0e-bc11-0d9979c94f8c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:49.567246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:49.568222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.568508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.568782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.569453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.571519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:49.648218 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1976/3941] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/projects => generated 395 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:49.653242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:49.757999 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1966/3942] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:49.762176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:49.856998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56710092-314c-4f54-bc76-ff74e2d21517 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:49.881271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:49.882147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.882531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.882940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.883969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.885989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:49.911774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a127c-306d-4836-b96c-e6bfcbf35d3b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:49.929285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:49.932255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:49.932552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:49.934227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:49.935117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:49.937469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.071958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1977/3943] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/users => generated 298 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:50.082780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.089257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a65eb-284f-4ca4-b4fa-064d42896f73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.097117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.097748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.098102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.098498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.100189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.102744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.114317 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1967/3944] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:49 2022] POST /identity/v3/users => generated 299 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:31:50.119127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.124537 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1978/3945] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:31:50.125562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.145057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3bf5-5a60-4f33-b311-39dd8b60d1b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.158580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba66c-682d-4052-9d1b-2c6cb5b827f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.161025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.161914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.162197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.162471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.163194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.164882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.165032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.165661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.165969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.166243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.167194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.168910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.184266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1979/3946] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:50.193799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1968/3947] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:50.202267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.203721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.223985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a4a36-deb6-4458-aa41-e35e10abb532 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.224920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdab9-1d13-4661-99b5-9bd972c04f1c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.230854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.231556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.233681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.233681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] PATH_INFO: `/v3/projects/03cb8e8f5cfc4cefaa24121342d595a0/users/1f9f9a80f8ab48189e96208f836f219d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.233924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.233924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.233924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.235336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] PATH_INFO: `/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4/users/5b9671a0abea4f628cb2f9c9e4d51f29/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.250838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cb8e8f5cfc4cefaa24121342d595a0, user_id=1f9f9a80f8ab48189e96208f836f219d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.254019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742c9d-89f5-445a-b781-527edd161cdc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.258319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaffe471b7c94f1dac53a4f3564ef1b4, user_id=5b9671a0abea4f628cb2f9c9e4d51f29, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.261249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.372975 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1980/3948] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:50 2022] PUT /identity/v3/projects/03cb8e8f5cfc4cefaa24121342d595a0/users/1f9f9a80f8ab48189e96208f836f219d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:50.386978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.391587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.391587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.436243 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1969/3949] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:50 2022] PUT /identity/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4/users/5b9671a0abea4f628cb2f9c9e4d51f29/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:50.447072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:50.447072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.449878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.526279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082e2e-761b-419f-83bc-4a4225c79e85 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.537455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.538161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.538686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.539025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.539770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.541496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c03ddd-3617-4f3f-b2b1-e1a7a70b8825 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.556106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1970/3950] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:50.559468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1981/3951] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:50.561171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.561529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.562004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.563321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.588751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb44bd-3fc4-4ae6-9fc1-cc0a2175bd3b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.589154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:50.590601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.594092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.594904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.595253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.595595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] PATH_INFO: `/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4/users/5b9671a0abea4f628cb2f9c9e4d51f29/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.597778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaffe471b7c94f1dac53a4f3564ef1b4, user_id=5b9671a0abea4f628cb2f9c9e4d51f29, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.600889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242ba1d-6eab-4125-8bf6-971843970271 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.607888 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1971/3952] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:50.617001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.618506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.626463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1982/3953] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:50 2022] PUT /identity/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4/users/5b9671a0abea4f628cb2f9c9e4d51f29/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:50.636814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.637102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.637443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.683302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] MFA Rules not processed for user `5b9671a0abea4f628cb2f9c9e4d51f29`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:50.686305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.760581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866564be-8b5b-4512-9e98-3e786e5148eb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.815249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1983/3954] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:50.833312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:50.835457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.883837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.885477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.885477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.885477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.910087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b67356-a6a9-4e25-9eb7-6e2295a9b852 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:50.914379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:50.915144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:50.915430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:50.915819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:50.918296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:50.976426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:50.976426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793976d-f611-4e0c-9207-1c03e0aef19f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:50.992265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1972/3955] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:31:51.036282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81b33-d104-47cc-b073-72b600c38c34 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:51.036679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81b33-d104-47cc-b073-72b600c38c34 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:51.037271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81b33-d104-47cc-b073-72b600c38c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:51.045979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:51.047760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acc9d-9208-4083-9e62-7604a1e641b2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:51.062909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1984/3956] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:51.077082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e3d81b33-d104-47cc-b073-72b600c38c34 None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:51.079144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e3d81b33-d104-47cc-b073-72b600c38c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:51.107175 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1973/3957] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:51.139859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f3a04-56de-4ba1-ba85-f8c33299d7af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:51.141914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f3a04-56de-4ba1-ba85-f8c33299d7af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:51.142530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f3a04-56de-4ba1-ba85-f8c33299d7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:51.168418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c40f3a04-56de-4ba1-ba85-f8c33299d7af None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:51.169839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c40f3a04-56de-4ba1-ba85-f8c33299d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:51.182543 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1985/3958] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:51.215452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:51.221652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:51.221652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:51.238476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:51.239914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:51.248000 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1974/3959] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:51.283941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af33-3fb1-43bc-8aed-54f4397ffd45 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:51.285790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af33-3fb1-43bc-8aed-54f4397ffd45 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:51.286324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af33-3fb1-43bc-8aed-54f4397ffd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:51.322072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36a1af33-3fb1-43bc-8aed-54f4397ffd45 None None] MFA Rules not processed for user `1f9f9a80f8ab48189e96208f836f219d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:51.323319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36a1af33-3fb1-43bc-8aed-54f4397ffd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:51.337311 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1986/3960] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:51.370746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:51.550995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4bc1-722b-4e1c-8ce5-abab45655a65 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:51.564848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:51.565532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:51.565816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:51.566089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] PATH_INFO: `/v3/users/1f9f9a80f8ab48189e96208f836f219d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:51.567905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9f9a80f8ab48189e96208f836f219d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:51.570435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:51.844189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9f9a80f8ab48189e96208f836f219d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:51.849756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9f9a80f8ab48189e96208f836f219d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:51.969621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9f9a80f8ab48189e96208f836f219d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:51.999333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9f9a80f8ab48189e96208f836f219d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:52.000171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9f9a80f8ab48189e96208f836f219d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:52.044199 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1975/3961] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:31:51 2022] DELETE /identity/v3/users/1f9f9a80f8ab48189e96208f836f219d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:52.049486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:52.050745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:52.059488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:52.148612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:52.150083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:52.294884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1987/3962] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:52.305992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:52.307914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:52.386532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:52.409886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51bb3b-598b-4b2f-81b5-adba3e24abfe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:52.415995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:52.417731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:52.418340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:52.418938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:52.432052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:52.434815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb936d-6dad-4c59-a95a-e6a5b535a2ea service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:52.446891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1976/3963] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:52.584120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:53.307018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:53.308206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:53.332012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a1d3-0e79-4a41-bb3f-dad082c8bb09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:53.337964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:53.338856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:53.339772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:53.340235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] PATH_INFO: `/v3/projects/03cb8e8f5cfc4cefaa24121342d595a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:53.342440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cb8e8f5cfc4cefaa24121342d595a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:53.346339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:53.572303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cb8e8f5cfc4cefaa24121342d595a0', 'request_id': 'req-7705c321-74be-4d32-8bb6-bae3c4e4b853'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:53.719535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cb8e8f5cfc4cefaa24121342d595a0', 'request_id': 'req-7705c321-74be-4d32-8bb6-bae3c4e4b853'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:53.740316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cb8e8f5cfc4cefaa24121342d595a0', 'request_id': 'req-7705c321-74be-4d32-8bb6-bae3c4e4b853'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:53.767816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] The token cache is being invalidate because project 03cb8e8f5cfc4cefaa24121342d595a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:31:53.768192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:53.769999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7705c321-74be-4d32-8bb6-bae3c4e4b853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:31:53.773619 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1988/3964] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:31:53 2022] DELETE /identity/v3/projects/03cb8e8f5cfc4cefaa24121342d595a0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:31:53.778720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:53.779293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:53.779406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:53.819514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:53.821307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:53.915049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:53.972774 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1977/3965] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:53.979621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:53.984044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:53.984044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.024766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:54.026937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:54.041768 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1989/3966] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:54.046257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.056276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4e603-9970-48ee-89e8-0ae65e0235b9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.061556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.062512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.063026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.063505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.064383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:31:54.064917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.066772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.084111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1978/3967] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:31:54.085899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.097064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b127759-070a-4b43-956f-c3ba5fb7061c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.103139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.104018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.104918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.104918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.106659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.118581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.246934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1990/3968] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:31:54 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:54.248492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.267407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283cdf9-ff5c-4800-bbba-5a7a376ebfc6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.358890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.360429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.360710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.360986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.361621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.363723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.543816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.550604 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1979/3969] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:31:54 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:31:54.559450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93110a14-5a1e-437b-bc5c-fe87cbae25a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.582096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.583046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:54.584201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.584815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.585159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.586005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.591603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.604985 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1991/3970] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:31:54.609195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.622722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b62ac7-30df-486f-b933-16869094a6d6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.635362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.636110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.637108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.637469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.638199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.639958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.655636 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1980/3971] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:31:54.660294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.675762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8887-1f73-4008-9bcb-b2c8a2f220c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:54.698365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:54.698365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.698365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.698365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] PATH_INFO: `/v3/projects/cb2d0f5bfa3d4d239451f01a955c457b/users/97c10c25bd8f4d51a9858b7770504c65/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.719139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2d0f5bfa3d4d239451f01a955c457b, user_id=97c10c25bd8f4d51a9858b7770504c65, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:54.724709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7d45-fc08-4282-8958-895e3c37ea11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:54.853417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:54.855693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:54.870937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1992/3972] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:31:54 2022] PUT /identity/v3/projects/cb2d0f5bfa3d4d239451f01a955c457b/users/97c10c25bd8f4d51a9858b7770504c65/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:31:54.879325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:54.879750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:54.880120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:54.905856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:54.907446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:54.960159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb559a-9a7e-497c-95e1-ff35c15876f4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:55.029076 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1993/3973] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:31:55.041057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:55.044285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:55.052387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:55.053633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:55.054076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:55.054535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:55.056802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:55.183382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc72403-9f83-4fab-b032-fc301114a2c4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:55.195503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:55.196142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:55.198901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:55.198901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:55.219165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:55.220625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:55.222728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2529ce-7167-4287-a7e4-33b0eeabc079 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:55.226709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:55.247654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1994/3974] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:55.256578 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1981/3975] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:56.253729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:57.361075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:57.372402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2f19-3c60-430d-8253-3e99ee3522ee service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:57.376761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:57.377384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:57.377661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:57.377931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:57.380404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:57.478420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:57.482104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:57.497875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb18f3f-1571-4d39-95b7-ca02a4d48a96 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:57.497875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb18f3f-1571-4d39-95b7-ca02a4d48a96 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:57.497875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb18f3f-1571-4d39-95b7-ca02a4d48a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:57.515368 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1995/3976] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:57.517574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:57.576457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-adb18f3f-1571-4d39-95b7-ca02a4d48a96 None None] MFA Rules not processed for user `763e2752fd774e37886ff2f629896e61`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:31:57.577865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-adb18f3f-1571-4d39-95b7-ca02a4d48a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:57.768725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1982/3977] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:31:57.780571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:31:57.782796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:31:57.963402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248387-2e10-48a6-927e-71230ebf8c38 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:31:57.971194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:31:57.972150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:31:57.973238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:31:57.973806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:31:57.998534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:31:58.001415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:31:58.034116 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1996/3978] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:31:58.189953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:59.629356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:31:59.827666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:00.545118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:01.418762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:02.064503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:02.371888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:02.667531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c99c78-7402-4769-ad3f-531bf539a41a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:02.667927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c99c78-7402-4769-ad3f-531bf539a41a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:02.668298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c99c78-7402-4769-ad3f-531bf539a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:02.689800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f0c99c78-7402-4769-ad3f-531bf539a41a None None] MFA Rules not processed for user `763e2752fd774e37886ff2f629896e61`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:02.692258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f0c99c78-7402-4769-ad3f-531bf539a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:02.700281 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1983/3979] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:04.439177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:04.455965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e129e8-df48-4f6e-b3a7-77ad4451978a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:04.463938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:04.464580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:04.464866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:04.465144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:04.471948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:04.492841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:04.494579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:04.529095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1997/3980] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:04.840180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:04.840711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:04.840711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:04.891178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] MFA Rules not processed for user `97c10c25bd8f4d51a9858b7770504c65`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:04.892815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:04.916148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:05.026314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1984/3981] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:05.036544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:05.037953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:05.060797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4c88-d433-42c6-8f03-caed7cdcd4b8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:05.069931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:05.070642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:05.070929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:05.071204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:05.080748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:05.084387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:05.096610 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1998/3982] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:06.767650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:06.796653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba346-8af1-46b2-8e21-c3e24a39e61b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:06.822238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:06.822913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:06.823194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:06.823491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:06.830594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:06.861560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:06.865109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f72c36-878c-4ff9-abf4-a5dbada938ba service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:06.919304 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1985/3983] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:10.830020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:10.832060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:10.856205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695a07-3014-43f2-bcc1-5ece2c74ab44 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:10.868322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:10.869216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:10.869672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:10.870098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] PATH_INFO: `/v3/users/cc77ae21c18340358f970664518185c1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:10.875520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc77ae21c18340358f970664518185c1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:10.878064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:11.225280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc77ae21c18340358f970664518185c1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:11.226501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc77ae21c18340358f970664518185c1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:11.349522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc77ae21c18340358f970664518185c1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:11.377656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc77ae21c18340358f970664518185c1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:11.379244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc77ae21c18340358f970664518185c1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:11.393574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:11.412073 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1999/3984] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:10 2022] DELETE /identity/v3/users/cc77ae21c18340358f970664518185c1 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:11.419438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:11.422244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:11.422738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:11.474565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:11.476105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:11.611670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1986/3985] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:11.621627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:11.625506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:11.841676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085908e-7b6a-4f37-8531-7c6511432568 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:11.886122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:11.894866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:11.905338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:11.905338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:11.938881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:11.940356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:11.976040 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2000/3986] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:32:13.402323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:13.403856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:13.433292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f708f5b-1402-4018-9a36-fc3e211a4d92 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:13.436144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:13.436947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:13.437889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:13.439417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] PATH_INFO: `/v3/projects/7ac8bf60ce094749bf7f84d989791213` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:13.442571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac8bf60ce094749bf7f84d989791213)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:13.444673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:13.658249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac8bf60ce094749bf7f84d989791213', 'request_id': 'req-244041ee-3ac3-457e-a9d4-72b2367a8562'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:13.794892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac8bf60ce094749bf7f84d989791213', 'request_id': 'req-244041ee-3ac3-457e-a9d4-72b2367a8562'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:13.802053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac8bf60ce094749bf7f84d989791213', 'request_id': 'req-244041ee-3ac3-457e-a9d4-72b2367a8562'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:13.822169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] The token cache is being invalidate because project 7ac8bf60ce094749bf7f84d989791213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:13.822466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:13.823172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-244041ee-3ac3-457e-a9d4-72b2367a8562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:13.825012 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1987/3987] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:13 2022] DELETE /identity/v3/projects/7ac8bf60ce094749bf7f84d989791213 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:13.829327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:13.841350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73309ef-cb67-46c1-bde8-08bdd699fad9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:13.922884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:13.923809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:13.924151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:13.924702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] PATH_INFO: `/v3/users/816b109aa7ab45e585d2f2943195e767` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:13.926307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816b109aa7ab45e585d2f2943195e767)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:13.928705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:13.985860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:13.986141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:13.986672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:14.011203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] MFA Rules not processed for user `665c53f7214245a083bcabeb29eaa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:14.012414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:14.070185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:14.101169 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1988/3988] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:32:14.287758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816b109aa7ab45e585d2f2943195e767'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:14.288882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816b109aa7ab45e585d2f2943195e767'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:14.389118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816b109aa7ab45e585d2f2943195e767'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:14.414632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816b109aa7ab45e585d2f2943195e767'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:14.415482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816b109aa7ab45e585d2f2943195e767'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:14.434772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2001/3989] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:13 2022] DELETE /identity/v3/users/816b109aa7ab45e585d2f2943195e767 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:15.095477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:15.098059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:15.113853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de616a-a52e-4b46-81d1-b10ae0d5592e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:15.216288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:15.217504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:15.218313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:15.218831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] PATH_INFO: `/v3/projects/ac8f12f503c7486cb5f92937b1f6d679` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:15.220917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8f12f503c7486cb5f92937b1f6d679)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:15.224053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:15.372906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8f12f503c7486cb5f92937b1f6d679', 'request_id': 'req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.510540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8f12f503c7486cb5f92937b1f6d679', 'request_id': 'req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.517922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8f12f503c7486cb5f92937b1f6d679', 'request_id': 'req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.543770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] The token cache is being invalidate because project ac8f12f503c7486cb5f92937b1f6d679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:15.544170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.544908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.550224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1989/3990] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:15 2022] DELETE /identity/v3/projects/ac8f12f503c7486cb5f92937b1f6d679 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:15.553370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:15.553370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:15.569610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d6c2c-9740-4f13-b89b-03f1173918f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:15.584373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:15.643677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:15.644406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:15.644735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:15.645646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] PATH_INFO: `/v3/users/5b9671a0abea4f628cb2f9c9e4d51f29` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:15.647327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9671a0abea4f628cb2f9c9e4d51f29)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:15.649734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:15.708749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:15.716448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:15.730412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7dab9-bbe0-4e71-81ae-20d1eb7da566 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:15.735984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:15.736701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:15.736986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:15.737284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] PATH_INFO: `/v3/users/97c10c25bd8f4d51a9858b7770504c65` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:15.738483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c10c25bd8f4d51a9858b7770504c65)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:15.740692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:15.930388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9671a0abea4f628cb2f9c9e4d51f29'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:15.931537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9671a0abea4f628cb2f9c9e4d51f29'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.017902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9671a0abea4f628cb2f9c9e4d51f29'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.041954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9671a0abea4f628cb2f9c9e4d51f29'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.043309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89d19440-f42c-48d2-a1f3-774cac3fd0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9671a0abea4f628cb2f9c9e4d51f29'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.045044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c10c25bd8f4d51a9858b7770504c65'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.045990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c10c25bd8f4d51a9858b7770504c65'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.064140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2002/3991] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:15 2022] DELETE /identity/v3/users/5b9671a0abea4f628cb2f9c9e4d51f29 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:16.065407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:16.065672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:16.065948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:16.087120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] MFA Rules not processed for user `f3b7ea18f94a4dfcaf5e7d3f8b934163`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:16.088439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.148824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c10c25bd8f4d51a9858b7770504c65'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.155000 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2003/3992] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:16.156578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:16.157899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.160513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:16.171169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c10c25bd8f4d51a9858b7770504c65'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.172795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5bdbc69c-d744-44e2-aa95-8795c5c6d038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c10c25bd8f4d51a9858b7770504c65'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:16.190696 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1990/3993] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:15 2022] DELETE /identity/v3/users/97c10c25bd8f4d51a9858b7770504c65 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:16.191971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:16.194585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:16.194585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:16.227306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] MFA Rules not processed for user `f3b7ea18f94a4dfcaf5e7d3f8b934163`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:16.228651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.284022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053b3e-cd74-4e27-81a6-74e8db435e35 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:16.326676 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1991/3994] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:16.375309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:16.379688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:16.379688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:16.379688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:16.389228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.410731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:16.413970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:16.431491 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2004/3995] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:16.752024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:16.753606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.762074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:16.764309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:16.915263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ff17-4186-4991-aff0-70efe2c2f9bb service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:16.931408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:16.932062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:16.932344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:16.932617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] PATH_INFO: `/v3/projects/cb2d0f5bfa3d4d239451f01a955c457b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:16.935845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2d0f5bfa3d4d239451f01a955c457b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:16.937849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:16.944970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec83651-20d9-491d-b77b-e1e21c287028 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:16.960233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:16.961999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:16.961999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:16.961999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] PATH_INFO: `/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:16.963983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaffe471b7c94f1dac53a4f3564ef1b4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:16.966098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.102422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2d0f5bfa3d4d239451f01a955c457b', 'request_id': 'req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.119796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaffe471b7c94f1dac53a4f3564ef1b4', 'request_id': 'req-da007493-4b02-472b-93d6-b714204bdc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.172404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2d0f5bfa3d4d239451f01a955c457b', 'request_id': 'req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.183329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2d0f5bfa3d4d239451f01a955c457b', 'request_id': 'req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.192482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] The token cache is being invalidate because project cb2d0f5bfa3d4d239451f01a955c457b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:17.192482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.193285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8499fb2d-d1c1-46ec-8947-10fc1c9252a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.200263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2005/3996] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:16 2022] DELETE /identity/v3/projects/cb2d0f5bfa3d4d239451f01a955c457b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:17.201927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a867-f84c-48e5-aefa-ced1b82b2c47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.203074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a867-f84c-48e5-aefa-ced1b82b2c47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.203460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a867-f84c-48e5-aefa-ced1b82b2c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.228280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27d9a867-f84c-48e5-aefa-ced1b82b2c47 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:17.230200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27d9a867-f84c-48e5-aefa-ced1b82b2c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:17.314688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaffe471b7c94f1dac53a4f3564ef1b4', 'request_id': 'req-da007493-4b02-472b-93d6-b714204bdc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.321403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaffe471b7c94f1dac53a4f3564ef1b4', 'request_id': 'req-da007493-4b02-472b-93d6-b714204bdc47'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.340486 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2006/3997] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:17.344324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.344618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.344890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.349198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] The token cache is being invalidate because project aaffe471b7c94f1dac53a4f3564ef1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:17.351941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.351941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da007493-4b02-472b-93d6-b714204bdc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:17.351941 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1992/3998] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:16 2022] DELETE /identity/v3/projects/aaffe471b7c94f1dac53a4f3564ef1b4 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:17.356901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf45-8c24-4648-af05-82c3d8820915 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.357191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf45-8c24-4648-af05-82c3d8820915 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.357470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf45-8c24-4648-af05-82c3d8820915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.392169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:17.394069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:17.397824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9214cf45-8c24-4648-af05-82c3d8820915 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:17.399135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9214cf45-8c24-4648-af05-82c3d8820915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:17.408374 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2007/3999] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:17.415040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.418543 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1993/4000] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:17.426426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.426790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.427046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.433213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffa1f7-8347-4a98-b8c0-515653d6c45a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.442752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.447934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.448696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.449212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.455279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:32:17.455279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.455279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.471665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:17.473152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:17.480997 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2008/4001] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:32:17.482259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.496167 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1994/4002] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:17.504611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.506322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d3cf-9e45-4f19-969c-59c38de8c31d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.512136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.512950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.513421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.514068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.515498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.516423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc9e3c-a035-4f26-af5a-2ead04824520 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.517701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.532086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.532991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.535724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.535724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.535724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:32:17.535724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.536828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.583311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1995/4003] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:32:17.589014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.615985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c7527-3396-4b43-9ca4-5abda84bd9ef admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.623139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.623760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.624042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.625011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.625603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.627588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.682456 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2009/4004] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:17.683853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.787387 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1996/4005] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:17.788626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:17.821974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038060-009c-43fb-a7e7-35b4758f43e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.922007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52ce5-344e-4a79-bac0-c46b5d409bfc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:17.934582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.953451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.953451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.953451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.953451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.953451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:17.975560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:17.976166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:17.976508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:17.976834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:17.977619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:17.979619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.036335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:18.123691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1997/4006] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:32:18.128688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.142109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5beec0-68fa-4cc3-8f14-207cf9771603 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.149001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.150046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.150846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.151346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.153368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.155532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.170807 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2010/4007] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:17 2022] POST /identity/v3/users => generated 292 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:18.177167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.201954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578472b-5889-4871-b621-64a103574b01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.203998 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1998/4008] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:18.205455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.217865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.222838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.222838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.222838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.222838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.226453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.228185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35ac8-322e-49f6-9ddf-dfde20f0592a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.241237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.241954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.242302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.242886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.243800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.248463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.251441 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2011/4009] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:18.254155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.283311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 1999/4010] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:18.287294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fd72f-6383-4c0a-b3e5-dfbb36973a7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.288683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.295902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.296563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.296840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.297108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.297745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.299435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.327851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3dda6-95bd-4e2f-9d47-0219ce4b3fbc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.341217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.347594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.348146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.348678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] PATH_INFO: `/v3/projects/5e848a817562466195952317ce6d07ee/users/2896c07121bf44ef96db42bbeaec2b72/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.353626 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2012/4011] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:18.354518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.373723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7872058-04ab-4e40-9268-72e187b1e8f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.377496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e848a817562466195952317ce6d07ee, user_id=2896c07121bf44ef96db42bbeaec2b72, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.380726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1e73a-896d-4015-a8e1-64b7c809cc62 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.387328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:18.388397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.388553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.388715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] PATH_INFO: `/v3/projects/a3454e482fb74b7dbe4002d1f366073f/users/bba74db4b7434fd2957fbd0c42d21d4b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.419959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3454e482fb74b7dbe4002d1f366073f, user_id=bba74db4b7434fd2957fbd0c42d21d4b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:18.423525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bac49-1856-4564-9efa-d133c6585a44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:18.492671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2000/4012] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:18 2022] PUT /identity/v3/projects/5e848a817562466195952317ce6d07ee/users/2896c07121bf44ef96db42bbeaec2b72/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:32:18.504924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.505864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.507015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.562865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2013/4013] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:18 2022] PUT /identity/v3/projects/a3454e482fb74b7dbe4002d1f366073f/users/bba74db4b7434fd2957fbd0c42d21d4b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:18.569683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:18.569910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:18.571034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:18.612535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] MFA Rules not processed for user `2896c07121bf44ef96db42bbeaec2b72`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:18.616242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:18.644699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:18.649366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:18.680368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:18.828399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2001/4014] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:18.834370 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2014/4015] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:18.852788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.854515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:18.863962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:18.867293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:18.992844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259b5c-2d5b-43e3-963a-00cbbac620e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:18.999004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127234-5ff6-4590-a84c-9b918f8b3eea None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:19.006433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:19.007090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:19.007369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:19.007650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:19.008062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:19.008697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:19.008980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:19.009254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:19.024245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:19.025567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:19.032597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:19.034065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:19.050996 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2015/4016] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:32:19.059490 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2002/4017] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:20.303024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:21.213117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:21.513308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:21.528074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067074-d35f-48b3-8118-46e35a355318 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:21.537434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:21.538046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:21.538319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:21.538684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:21.540474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:21.552074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:21.553910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:21.565823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2016/4018] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:21.630290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:21.631746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:21.645072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb9276-5e8d-4737-b232-55e5bc432890 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:21.653463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:21.654545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:21.655086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:21.655418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:21.657515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:21.670415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:21.671997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:21.681626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2003/4019] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:22.381953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:22.396793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8fd2e-e69f-42c7-b9eb-7b98d1a6ae32 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:22.405941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:22.406779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:22.407061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:22.407541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:22.409472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:22.548405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:22.551047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:22.575848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2017/4020] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:23.240343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:23.242129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:23.276581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225014d-801f-49af-bea9-dff7d80cfdf9 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:23.297552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:23.315273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:23.315628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:23.318888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] PATH_INFO: `/v3/users/8c5d440469ac40c2a39eaa5aef2119a7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:23.323826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5d440469ac40c2a39eaa5aef2119a7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:23.346488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:23.737441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5d440469ac40c2a39eaa5aef2119a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:23.739657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5d440469ac40c2a39eaa5aef2119a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:23.834680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5d440469ac40c2a39eaa5aef2119a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:23.858533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5d440469ac40c2a39eaa5aef2119a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:23.859561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3e9e7d8-c659-4598-9e49-0229bbd4e2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5d440469ac40c2a39eaa5aef2119a7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:23.888035 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2004/4021] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:23 2022] DELETE /identity/v3/users/8c5d440469ac40c2a39eaa5aef2119a7 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:24.490721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:24.501340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d54529-8ed9-4358-acf1-211a6206cd44 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:24.511980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:24.601173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:24.601835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:24.602116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:24.602531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] PATH_INFO: `/v3/projects/6f03b31fe2a945fbb76a1be8fc5abdfb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:24.603994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f03b31fe2a945fbb76a1be8fc5abdfb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:24.607032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:24.783750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f03b31fe2a945fbb76a1be8fc5abdfb', 'request_id': 'req-28178362-9bcc-48b8-8478-5794c1ac1d91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:24.887478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f03b31fe2a945fbb76a1be8fc5abdfb', 'request_id': 'req-28178362-9bcc-48b8-8478-5794c1ac1d91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:24.902378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f03b31fe2a945fbb76a1be8fc5abdfb', 'request_id': 'req-28178362-9bcc-48b8-8478-5794c1ac1d91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:24.921837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] The token cache is being invalidate because project 6f03b31fe2a945fbb76a1be8fc5abdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:24.922368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:24.923547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28178362-9bcc-48b8-8478-5794c1ac1d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:24.929720 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2018/4022] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:24 2022] DELETE /identity/v3/projects/6f03b31fe2a945fbb76a1be8fc5abdfb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:24.930971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:24.931804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:24.932248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:24.982862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:24.984135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:25.116356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2005/4023] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:25.124010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.125089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.125466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.165709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:25.168550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:25.197629 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2019/4024] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:25.203403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.223574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:25.240537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf89ec-4453-408d-8d1b-f4873fd08883 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.254266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.260519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.260519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.260519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.260519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:32:25.261084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.267546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:25.301753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2006/4025] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:32:25.305967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.324932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4c6a-fdfd-47e6-9bc0-96cb71ef2c6e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.331085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.331919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.332487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.333027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.333629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.335591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:25.464576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2020/4026] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:25 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:25.474948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.483842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6e7db-a5a6-43f8-8f63-1ddfaf511631 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.595623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.596673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.597166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.597938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.598950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.603832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:25.784312 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2007/4027] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:25 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:25.784878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.798344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954c34d-0914-409f-a38d-1eef377037c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.816364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.816364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.816364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.816364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.816944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.829100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:25.847270 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2021/4028] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:32:25.852779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.863447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff558dc-a5a4-4709-8fad-33ef6ad53426 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.886662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.887498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.887944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.888381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.889197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.897316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b09a6-205d-4d4e-9c70-35a52d6d3485 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:25.924119 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2008/4029] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:25.927301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:25.941297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c99bb-2ffa-4769-a28b-2c643093feb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:25.946905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:25.947842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:25.948526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:25.949045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] PATH_INFO: `/v3/projects/efc68414d731416a871b7a389bfe70ca/users/d1d14f15051c4bcc838b7e5c3fd2bfe0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:25.972388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc68414d731416a871b7a389bfe70ca, user_id=d1d14f15051c4bcc838b7e5c3fd2bfe0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:25.976215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:26.103306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2022/4030] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:25 2022] PUT /identity/v3/projects/efc68414d731416a871b7a389bfe70ca/users/d1d14f15051c4bcc838b7e5c3fd2bfe0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:26.106973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:26.107446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:26.107720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:26.163810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:26.165532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:26.212546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:26.240619 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2009/4031] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:26.258275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:26.258275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:26.363878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3b0e7-ce21-4744-9057-2f13e5c3babd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:26.368733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e652575-1047-4621-bf65-83053000289d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:26.369731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652575-1047-4621-bf65-83053000289d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:26.370463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652575-1047-4621-bf65-83053000289d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:26.371046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e652575-1047-4621-bf65-83053000289d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:26.385631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e652575-1047-4621-bf65-83053000289d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:26.389474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e652575-1047-4621-bf65-83053000289d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:26.434720 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2023/4032] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:27.164295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:27.165764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:27.185472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc287-cf1f-4925-bf9e-bdd61c81a8f7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:27.198263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:27.202576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:27.204544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:27.205008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] PATH_INFO: `/v3/users/2896c07121bf44ef96db42bbeaec2b72` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:27.218779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2896c07121bf44ef96db42bbeaec2b72)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:27.221205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:27.508966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:27.538504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2896c07121bf44ef96db42bbeaec2b72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:27.539533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2896c07121bf44ef96db42bbeaec2b72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:27.733394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2896c07121bf44ef96db42bbeaec2b72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:27.748007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:27.759395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2896c07121bf44ef96db42bbeaec2b72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:27.760443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2896c07121bf44ef96db42bbeaec2b72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:27.783907 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2010/4033] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:27 2022] DELETE /identity/v3/users/2896c07121bf44ef96db42bbeaec2b72 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:27.788648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:27.789153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:27.789596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:27.815272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:27.816705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:27.897084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2024/4034] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:27.946914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:27.948606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:28.082528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b396-74d3-4ef0-ad0d-825e587af24d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:28.086710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:28.087299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:28.087627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:28.087911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:28.128476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:28.129712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f8d53-45d2-4378-bdff-c6c78581a1fc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:28.166136 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2011/4035] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:30.462150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:30.462824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:30.485405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1cc5b-ecbd-4237-9498-ed500b18695d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:30.493195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:30.494345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:30.494868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:30.496177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] PATH_INFO: `/v3/projects/5e848a817562466195952317ce6d07ee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:30.498189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e848a817562466195952317ce6d07ee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:30.501261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:30.792290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e848a817562466195952317ce6d07ee', 'request_id': 'req-79cd1007-75ad-45d6-8ab6-6398a1e62a37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:30.898082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e848a817562466195952317ce6d07ee', 'request_id': 'req-79cd1007-75ad-45d6-8ab6-6398a1e62a37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:30.907927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e848a817562466195952317ce6d07ee', 'request_id': 'req-79cd1007-75ad-45d6-8ab6-6398a1e62a37'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:30.937290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] The token cache is being invalidate because project 5e848a817562466195952317ce6d07ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:30.937923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:30.939072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79cd1007-75ad-45d6-8ab6-6398a1e62a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:30.940826 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2025/4036] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:30 2022] DELETE /identity/v3/projects/5e848a817562466195952317ce6d07ee => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:30.946396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:30.947417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:30.947861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:30.991847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:30.995687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:31.189669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.189669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.190018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.190587 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2012/4037] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:31.226597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:31.228494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:31.246168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2026/4038] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:32:31.251707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:31.271790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b825-b9d1-49ae-bb8a-0ab17fa36d32 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:31.283479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:31.284381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.284881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.285347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.286647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:32:31.287167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:31.288971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b266-52b6-423b-8e17-de4660a728ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:31.329335 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2013/4039] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:32:31.330597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:31.364883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ad9fe-c4b4-4905-bf15-12f4452d484b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:31.382769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:31.384038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.384703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.385196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.386036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:31.392179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:31.415982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:31.469809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99838-1a8b-4fc7-9843-1ab28fd0d525 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.470100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99838-1a8b-4fc7-9843-1ab28fd0d525 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.470581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99838-1a8b-4fc7-9843-1ab28fd0d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.527866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2027/4040] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:31 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:31.532811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:31.548459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ccb99838-1a8b-4fc7-9843-1ab28fd0d525 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:31.550418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccb99838-1a8b-4fc7-9843-1ab28fd0d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:31.665382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:31.672826 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2014/4041] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:31.688912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.689797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.690273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.752908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d4722-1cd1-4153-a079-14ab1dfb56f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:31.779933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:31.784136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:31.797791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:31.798797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.799327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.799789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.800221 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2015/4042] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:32:31.800925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:31.805916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:31.814738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:31.816213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:31.936041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2028/4043] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:31 2022] POST /identity/v3/users => generated 293 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:31.938727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:31.964184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5a202-291f-4ef4-a60d-8d9fb758557e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:31.977968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:31.978592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:31.978946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:31.979243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:31.981980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:31.991161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:32.008580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689116e0-2d74-4c5b-a5a6-be4ef96b176b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:32.016395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2029/4044] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:32.020290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:32.030752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:32.031455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:32.031921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:32.033383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:32.035600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e11f-aad9-4132-9da6-53acc39a737b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:32.043986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:32.044696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:32.045063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:32.045412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:32.046144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:32.048068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:32.066007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2030/4045] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:32:32.066257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:32.067144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:32.070742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83d5b9-29c7-45b0-811b-dec3dbb58abc service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:32.080219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98dcd7-b767-4cf7-b5e8-ea2ba8ecaead admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:32.087466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:32.088097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:32.088376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:32.088652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] PATH_INFO: `/v3/projects/19b81519fa2e43debac8033425a663a1/users/ca1f7b60fca44d3cba4f9641f84a67bc/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:32.094126 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2016/4046] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:32:32.106319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b81519fa2e43debac8033425a663a1, user_id=ca1f7b60fca44d3cba4f9641f84a67bc, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:32.112911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:32.218603 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2031/4047] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:32 2022] PUT /identity/v3/projects/19b81519fa2e43debac8033425a663a1/users/ca1f7b60fca44d3cba4f9641f84a67bc/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:32.220586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:32.220971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:32.221341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:32.298218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] MFA Rules not processed for user `ca1f7b60fca44d3cba4f9641f84a67bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:32.299778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:32.465940 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2017/4048] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:32.470139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:32.612895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ecc0b-5d24-41ca-9ec7-c4b6869b923a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:32.633555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:32.640216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:32.640216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:32.640216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:32.641284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:32.653228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:32.831331 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2032/4049] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:32 2022] POST /identity/v3/projects => generated 387 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:32:32.835730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:32.856715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a282836-882e-4cd1-80c3-c0ad0eadc8e3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:33.042178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:33.043650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:33.043650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:33.044194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:33.045162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:33.051796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:33.167351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:33.174865 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2018/4050] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:32 2022] POST /identity/v3/users => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:33.178933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:33.200678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d9d2-dc3e-4590-a7d7-390b16c58a27 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:33.207696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:33.208522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:33.208973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:33.209422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:33.210501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:33.212454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384437e-5955-42b2-b859-aa34353f9506 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:33.240459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:33.240891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2033/4051] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:33.253063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3e6d-ddf0-47ba-9f87-687dbcc8d555 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:33.272295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:33.273010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:33.273292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:33.273566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] PATH_INFO: `/v3/projects/48798d4b15b9498f8d7971b7a620a897/users/940ed219a54a4b2f8243f81cf42395a0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:33.307601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48798d4b15b9498f8d7971b7a620a897, user_id=940ed219a54a4b2f8243f81cf42395a0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:33.311756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:33.434681 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2019/4052] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:33 2022] PUT /identity/v3/projects/48798d4b15b9498f8d7971b7a620a897/users/940ed219a54a4b2f8243f81cf42395a0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:32:33.444967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:33.445390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:33.446146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:33.487088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:33.520348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] MFA Rules not processed for user `940ed219a54a4b2f8243f81cf42395a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:33.521593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:33.653762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2034/4053] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:33.695825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:33.698047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:33.922542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4ae5-1aee-4957-8150-e26504e0cb1f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:33.928897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:33.929528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:33.929810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:33.930127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:33.940081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:33.941906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378077d-a5e2-436e-bc95-46bc409f464d service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:33.954592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2020/4054] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:32:38.026169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:38.234577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45cae-0790-4e74-b169-c0a7e3e13f4b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:38.254283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:38.255988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:38.256344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:38.257604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] PATH_INFO: `/v3/users/ca1f7b60fca44d3cba4f9641f84a67bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:38.260967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1f7b60fca44d3cba4f9641f84a67bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:38.265453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:38.636010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1f7b60fca44d3cba4f9641f84a67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:38.637651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1f7b60fca44d3cba4f9641f84a67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:38.749659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1f7b60fca44d3cba4f9641f84a67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:38.797643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1f7b60fca44d3cba4f9641f84a67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:38.798787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1f7b60fca44d3cba4f9641f84a67bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:38.852324 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2035/4055] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:38 2022] DELETE /identity/v3/users/ca1f7b60fca44d3cba4f9641f84a67bc => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:38.857501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:38.858042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:38.858688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:38.883328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:38.885016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:39.038129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2021/4056] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:39.086972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:39.088585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:39.191414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:39.283835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc4e6e-afd3-4f66-9262-824c235d2018 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:39.292166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:39.296488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:39.296955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:39.297390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:39.325925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:39.346328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956a89-e154-4b67-b5c0-56711de8288d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:39.356773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2036/4057] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:39.885002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:39.888483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:40.108978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:40.124913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067dc8e-1e0f-45f0-a620-b410829b7946 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:40.134209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:40.135338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:40.136168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:40.136574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:40.138666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:40.155556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:40.157904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:40.173364 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2022/4058] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:41.414906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:41.415497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:41.415497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:41.491237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] MFA Rules not processed for user `d1d14f15051c4bcc838b7e5c3fd2bfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:41.499412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:41.690889 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2037/4059] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:41.817685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:41.844099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a102a8f-29a9-4959-91a0-42f46107c885 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:41.857163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:41.858601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:41.859095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:41.859546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:41.878788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:41.879843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:41.880942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:41.881685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:41.899997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd087ba-302f-4511-8df6-d519344d5bba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:41.916738 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2023/4060] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:41.935662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:41.940789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:41.940789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:41.940789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] PATH_INFO: `/v3/projects/19b81519fa2e43debac8033425a663a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:41.943483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b81519fa2e43debac8033425a663a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:41.949801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:42.113533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b81519fa2e43debac8033425a663a1', 'request_id': 'req-940fef81-19bf-4816-bbef-f33164ce0cbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.212966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b81519fa2e43debac8033425a663a1', 'request_id': 'req-940fef81-19bf-4816-bbef-f33164ce0cbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.231907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b81519fa2e43debac8033425a663a1', 'request_id': 'req-940fef81-19bf-4816-bbef-f33164ce0cbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.270494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] The token cache is being invalidate because project 19b81519fa2e43debac8033425a663a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:42.272919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.274076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.278992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2038/4061] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:41 2022] DELETE /identity/v3/projects/19b81519fa2e43debac8033425a663a1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:42.282940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:42.299126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680a91-8119-4179-8d9c-37aa96d03885 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:42.424919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:42.425614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:42.425897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:42.426523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] PATH_INFO: `/v3/users/940ed219a54a4b2f8243f81cf42395a0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:42.428123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940ed219a54a4b2f8243f81cf42395a0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:42.430869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:42.683863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940ed219a54a4b2f8243f81cf42395a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.687108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940ed219a54a4b2f8243f81cf42395a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.794948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940ed219a54a4b2f8243f81cf42395a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.822453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940ed219a54a4b2f8243f81cf42395a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.824344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e37710da-d233-4b6a-9244-799dc932e623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940ed219a54a4b2f8243f81cf42395a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:42.865227 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2024/4062] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:32:42 2022] DELETE /identity/v3/users/940ed219a54a4b2f8243f81cf42395a0 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:44.434290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:44.435504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:44.459793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fef81-19bf-4816-bbef-f33164ce0cbb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:44.579371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:44.640682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:44.642007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:44.642534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:44.643009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] PATH_INFO: `/v3/projects/48798d4b15b9498f8d7971b7a620a897` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:44.644720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48798d4b15b9498f8d7971b7a620a897)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:44.647226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:44.789620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48798d4b15b9498f8d7971b7a620a897', 'request_id': 'req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:44.821666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24ef-1d70-412b-973d-4ddec5f5cb56 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:44.822460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24ef-1d70-412b-973d-4ddec5f5cb56 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:44.822460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24ef-1d70-412b-973d-4ddec5f5cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:44.870532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dceb24ef-1d70-412b-973d-4ddec5f5cb56 None None] MFA Rules not processed for user `d1d14f15051c4bcc838b7e5c3fd2bfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:44.874311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dceb24ef-1d70-412b-973d-4ddec5f5cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:44.874823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48798d4b15b9498f8d7971b7a620a897', 'request_id': 'req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:44.886196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48798d4b15b9498f8d7971b7a620a897', 'request_id': 'req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:44.915253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] The token cache is being invalidate because project 48798d4b15b9498f8d7971b7a620a897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:32:44.916693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:44.923146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a84d77ac-1aa1-46b8-bd74-bb6f7394966d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:32:44.924718 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2039/4063] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:32:44 2022] DELETE /identity/v3/projects/48798d4b15b9498f8d7971b7a620a897 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:44.931029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:44.931824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:44.932207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:44.971434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:44.973205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:44.993667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:45.020924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2025/4064] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:32:45.137804 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2040/4065] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:45.140052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.141502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.141502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.183635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:45.184883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:45.210528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2026/4066] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:45.212675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.226386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fab9d6-e658-449c-8672-5f8230827c1f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.242218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.242954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.243241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.243514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.244285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:32:45.244533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:45.246144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:45.277911 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2041/4067] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:32:45.283210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.307541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23bbc1-e5ce-4aea-9278-01eb349c2ff0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.330257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.331661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.332273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.332700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.337919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:45.337919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:45.471320 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2027/4068] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:45 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:45.476317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.492989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3b368-a6ff-4d7b-93ca-ea124bdcc69b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.627960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.629046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.629336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.629613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.630666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:45.632724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:45.769303 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2042/4069] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:45 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:45.773382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.788902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b1d3b-5b51-4b64-92cc-b730386a8d3a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.802835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.803464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.803751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.803998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.804830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:45.807154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:45.833588 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2028/4070] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:45.837774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.853944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64009cbe-aad6-4b14-8bff-6b26858953db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.874264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.875359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.880259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.880259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.880259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:45.885736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bfcf4-a45e-4f93-afb3-b92725da44c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:45.909336 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2043/4071] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:45.910739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:45.942190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078779d4-0151-4e98-aa7f-6f3ff714170f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:45.965641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:45.966376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:45.968054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:45.968054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] PATH_INFO: `/v3/projects/da2900e549fb492ca43d1f78c9216c7b/users/2f846830062542eb82747dc1d2ed2e14/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:45.993595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2900e549fb492ca43d1f78c9216c7b, user_id=2f846830062542eb82747dc1d2ed2e14, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:46.002256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:46.138140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2029/4072] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:45 2022] PUT /identity/v3/projects/da2900e549fb492ca43d1f78c9216c7b/users/2f846830062542eb82747dc1d2ed2e14/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:46.143638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c669-c5f1-47a7-b66a-e31cd5934312 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:46.143972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c669-c5f1-47a7-b66a-e31cd5934312 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:46.144245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c669-c5f1-47a7-b66a-e31cd5934312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:46.179001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28e0c669-c5f1-47a7-b66a-e31cd5934312 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:46.183618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28e0c669-c5f1-47a7-b66a-e31cd5934312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:46.260837 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2044/4073] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:46.276720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:46.278471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:46.383231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dce57-2450-45f5-99bb-7b59705dccd6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:46.390678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:46.392087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:46.392569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:46.393138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:46.407083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:46.409595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:46.424773 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2030/4074] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:46.474937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:48.683674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:48.684362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:48.684362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:48.766134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] MFA Rules not processed for user `2f846830062542eb82747dc1d2ed2e14`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:48.775988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:48.910555 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2045/4075] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:48.915640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:48.930279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974be98-716d-4acb-8e6b-f2403e5f1548 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:48.935302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:48.936849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:48.937137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:48.937408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:48.938211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:48.940152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.059298 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2031/4076] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:32:48 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:49.061072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.074638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923267b-8103-48b6-a29d-7c05f696c8fa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.171636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.172471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.172844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.173216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.173981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.176308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.313313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2046/4077] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:32:49 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:32:49.317028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.331496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bc7b7-377e-41e1-8c3d-4ec392bf49f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.339240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.340227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.341178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.341625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.343111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.345728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.361823 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2032/4078] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:49.366335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.379317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2021f-0934-41f7-873b-2e1250353e96 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.387975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.388756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.389124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.389454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] PATH_INFO: `/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca/users/eb91f9209e0a4427a1018c8a2ee1fb3e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.414225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eec7fbc6b04f6baaacc4b96c2807ca, user_id=eb91f9209e0a4427a1018c8a2ee1fb3e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.418291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.423734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:49.526605 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2047/4079] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:49 2022] PUT /identity/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca/users/eb91f9209e0a4427a1018c8a2ee1fb3e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:49.530399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.546697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30345d-1259-4cfb-b0db-63e21d13fd5a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.593807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.596133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:49.651193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.651809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.652145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.652419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.653901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.656426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.674779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2033/4080] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:32:49.675962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:49.684202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:49.699892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b2069-a46c-4073-bc7d-fb5470248743 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.728110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.729293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.731747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.732248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] PATH_INFO: `/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca/users/eb91f9209e0a4427a1018c8a2ee1fb3e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.743138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56eec7fbc6b04f6baaacc4b96c2807ca, user_id=eb91f9209e0a4427a1018c8a2ee1fb3e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.747693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda8b4-6084-4c26-b91c-8db002475d89 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.781062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2034/4081] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:32:49 2022] PUT /identity/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca/users/eb91f9209e0a4427a1018c8a2ee1fb3e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:32:49.797022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa5bbc-c365-4bce-adee-5efaef5a48c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:49.884546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:49.885421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:49.885929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:49.886404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:49.888552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:49.904143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:49.905949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:49.919795 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2048/4082] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:32:52.587829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827ec8-6eac-48b6-81cc-9765ee130ed7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:52.587829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827ec8-6eac-48b6-81cc-9765ee130ed7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:52.587829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827ec8-6eac-48b6-81cc-9765ee130ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:52.634812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-28827ec8-6eac-48b6-81cc-9765ee130ed7 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:52.636248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28827ec8-6eac-48b6-81cc-9765ee130ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:52.751386 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2035/4083] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:53.089094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:53.195572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88fd02-8fd0-4ddb-9458-9682b26117a7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:53.199799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:53.201134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:53.202137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:53.202585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:53.204902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:53.214101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:32:53.220279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:53.221733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d4dd9-3c56-46d4-b135-b4603b91fac0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:53.239819 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2049/4084] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:32:53.490388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:53.523030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:53.523030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:53.576846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] MFA Rules not processed for user `eb91f9209e0a4427a1018c8a2ee1fb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:53.578032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:53.830253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2036/4085] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:53.834051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:53.834335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:53.834604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:53.883371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] MFA Rules not processed for user `2f846830062542eb82747dc1d2ed2e14`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:32:53.891349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:32:54.071753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2050/4086] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:32:54.301603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:32:54.323967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7796-949d-4359-adaf-bafa360bb143 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:32:54.352864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:32:54.355035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:32:54.355437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:32:54.355806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:32:54.382949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:32:54.384652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:32:54.427907 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2037/4087] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:03.937906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:03.939343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:03.952790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace018b7-f238-41b0-bd2f-72a6ed937fef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:03.957019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:03.959080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:03.959080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:03.959080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:03.960750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:04.027475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:04.028910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:04.041407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2051/4088] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:33:04.412636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:05.122075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:05.133983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e3e1-0e77-41e7-b62c-7410f3ef6c1e service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:05.141656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:05.142723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:05.143234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:05.143698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:05.148675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:05.304206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:05.306308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:05.319134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2038/4089] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:09.435121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:09.438224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:09.454033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332743db-be52-47f0-8700-41843cfeae01 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:09.459137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:09.459767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:09.460047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:09.460346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] PATH_INFO: `/v3/users/665c53f7214245a083bcabeb29eaa8e0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:09.461589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] RBAC: Authorizing `identity:delete_user(user_id=665c53f7214245a083bcabeb29eaa8e0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:09.463564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:09.586919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665c53f7214245a083bcabeb29eaa8e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:09.587606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665c53f7214245a083bcabeb29eaa8e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:09.662736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665c53f7214245a083bcabeb29eaa8e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:09.676982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665c53f7214245a083bcabeb29eaa8e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:09.677736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b888493e-caba-4eab-93b2-2a5fe55bcbec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665c53f7214245a083bcabeb29eaa8e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:09.692214 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2052/4090] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:33:09 2022] DELETE /identity/v3/users/665c53f7214245a083bcabeb29eaa8e0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:10.037972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:10.058032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657d4af-69bd-4f3d-b31c-cc7b71d84b27 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:10.191992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:10.193041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.193708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.194156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] PATH_INFO: `/v3/projects/0a884faf44f643a8aad30311a24dbec0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.196619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a884faf44f643a8aad30311a24dbec0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:10.199229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:10.348447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a884faf44f643a8aad30311a24dbec0', 'request_id': 'req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:10.461423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a884faf44f643a8aad30311a24dbec0', 'request_id': 'req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:10.470438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a884faf44f643a8aad30311a24dbec0', 'request_id': 'req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:10.484288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] The token cache is being invalidate because project 0a884faf44f643a8aad30311a24dbec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:33:10.484718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:10.485525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bb7c50ab-d67f-48a7-b68a-946bfd3a0038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:10.487414 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2039/4091] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:33:10 2022] DELETE /identity/v3/projects/0a884faf44f643a8aad30311a24dbec0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:10.492553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.493089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.493214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.504048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:10.516322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:10.517584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:10.608484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2053/4092] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:10.616146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.616440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.616712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.646944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:10.648724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:10.659317 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2040/4093] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:10.663913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:10.675652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d1fb-552f-4c52-b979-5553a0f8d6aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:10.680780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:10.681392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.681675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.681951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.682700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:33:10.682973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:10.684809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:10.699738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2054/4094] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:33:10.705360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:10.717764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6d411-7134-45f0-a968-9e82da14c97c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:10.723637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:10.724301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.724530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.724799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.725438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:10.731295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:10.754509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:10.848713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2041/4095] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:10.850104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:10.865281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434e805-7263-4b73-b465-e575232ff0a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:10.952607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:10.954271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:10.954271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:10.954271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:10.956162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:10.959212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:11.070426 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2055/4096] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:33:10 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:11.074469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:11.085989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637fb86-91d2-4a5f-ae4b-7bbeb4bcd410 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:11.102658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:11.102658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:11.102658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:11.102658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:11.103137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:11.103137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:11.107651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2042/4097] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:33:11.111684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:11.125173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06ed54-422b-4084-88b4-bf86923e9d61 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:11.131165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:11.131814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:11.132093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:11.132364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:11.133043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:11.134658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a812f-e903-4421-b126-11d7737e56de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:11.146773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2056/4098] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:11.151302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:11.162586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55945-9914-4d49-af2b-b4e5e96d461c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:11.169063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:11.170215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:11.170542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:11.170847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] PATH_INFO: `/v3/projects/bee27b21a034473eb695f8cb5f3f725e/users/e3d740f6381348a49968c91b787d2d45/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:11.187813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee27b21a034473eb695f8cb5f3f725e, user_id=e3d740f6381348a49968c91b787d2d45, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:11.190559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:11.265069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2043/4099] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:33:11 2022] PUT /identity/v3/projects/bee27b21a034473eb695f8cb5f3f725e/users/e3d740f6381348a49968c91b787d2d45/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:11.271574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161502-0b2f-4cc2-a601-f04421f9b273 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:11.272133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161502-0b2f-4cc2-a601-f04421f9b273 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:11.272655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9161502-0b2f-4cc2-a601-f04421f9b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:11.296757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9161502-0b2f-4cc2-a601-f04421f9b273 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:11.298562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9161502-0b2f-4cc2-a601-f04421f9b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:11.419431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2057/4100] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:11.429407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:11.431554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:11.535114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2725f9-5397-413c-a206-a7f9bb18ac89 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:11.541641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:11.542974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:11.544165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:11.545317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:11.573457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:11.575620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0824ea-3226-46fc-82cc-1b9a03a49e55 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:11.593827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2044/4101] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:13.133991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:13.134478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:13.134581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:13.292216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] MFA Rules not processed for user `30654870bc994ffab886c9ad05379643`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:13.297158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:13.301626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:13.396386 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2058/4102] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:19.238895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:19.239419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:19.239680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:19.275037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:19.276174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:19.278034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:19.283040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:19.314992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d85f9-3923-4416-adf8-091a6c8c491b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:19.320991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:19.323331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:19.323879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:19.324806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] PATH_INFO: `/v3/users/d1d14f15051c4bcc838b7e5c3fd2bfe0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:19.328841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d14f15051c4bcc838b7e5c3fd2bfe0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:19.329786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:19.387104 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2045/4103] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:19.636433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d14f15051c4bcc838b7e5c3fd2bfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:19.637260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d14f15051c4bcc838b7e5c3fd2bfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:19.722648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d14f15051c4bcc838b7e5c3fd2bfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:19.774313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d14f15051c4bcc838b7e5c3fd2bfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:19.778558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccb8187c-586f-40f5-89ca-2e053d0832d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d14f15051c4bcc838b7e5c3fd2bfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:19.822319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2059/4104] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:33:19 2022] DELETE /identity/v3/users/d1d14f15051c4bcc838b7e5c3fd2bfe0 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:20.232566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:20.267941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32201f9-be7a-472c-95cc-5a5b18d5acba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:20.426662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:20.428239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:20.428599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:20.428875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] PATH_INFO: `/v3/projects/efc68414d731416a871b7a389bfe70ca` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:20.430068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc68414d731416a871b7a389bfe70ca)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:20.433461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:20.449642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:20.594775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc68414d731416a871b7a389bfe70ca', 'request_id': 'req-5d811405-a976-4642-a4fb-6ce979b7ac6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:20.696090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc68414d731416a871b7a389bfe70ca', 'request_id': 'req-5d811405-a976-4642-a4fb-6ce979b7ac6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:20.714704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc68414d731416a871b7a389bfe70ca', 'request_id': 'req-5d811405-a976-4642-a4fb-6ce979b7ac6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:20.743674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] The token cache is being invalidate because project efc68414d731416a871b7a389bfe70ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:33:20.743964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:20.744620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5d811405-a976-4642-a4fb-6ce979b7ac6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:20.747023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2046/4105] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:33:20 2022] DELETE /identity/v3/projects/efc68414d731416a871b7a389bfe70ca => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:20.752446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:20.758666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:20.758666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:20.812045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:20.815420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:20.965016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2060/4106] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:20.973381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:20.973650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:20.973924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.007152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:21.009231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.025635 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2047/4107] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:21.029988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.042393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108752e-f3a6-4a26-91d7-f7069a443b98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.050838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.051731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.052112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.052482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.053398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:33:21.053804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.055770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.082088 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2061/4108] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:33:21.086800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.106086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554e9a3-6c2e-4084-b34e-794648b55892 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.121457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.125509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.125634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.126690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.130862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.136443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf35c6-a58d-40d5-84b4-32b49c514b59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.264073 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2048/4109] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:33:21 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:21.266803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.280124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc09ee-b2f8-4602-9b39-3a9e14e098d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.296202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:21.366317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.366990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.367269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.367537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.368603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.372269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.399006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17423-ccbd-47c5-82c3-c517246ba48f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.399539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17423-ccbd-47c5-82c3-c517246ba48f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.399539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17423-ccbd-47c5-82c3-c517246ba48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.459890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-36f17423-ccbd-47c5-82c3-c517246ba48f None None] MFA Rules not processed for user `e3d740f6381348a49968c91b787d2d45`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:21.461245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-36f17423-ccbd-47c5-82c3-c517246ba48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.518787 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2062/4110] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:33:21 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:21.524887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.547426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf909b1-5d14-4367-b4c1-e85ab2066ce1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.571861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.578839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.578839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.578839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.578839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.578839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.599239 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2063/4111] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:21.603904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.612509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2049/4112] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:33:21.627917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb7bb-9945-4b20-a5dd-405902b898c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.628378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.628613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.628916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.633334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.641478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.641818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.642037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.643704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.645329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.674841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] MFA Rules not processed for user `e3d740f6381348a49968c91b787d2d45`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:21.674841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.679575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2064/4113] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:21.679575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.680880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.692715 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2050/4114] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:33:21.694311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.727113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12d1c-8595-4def-9b12-3a5cb399538a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.734563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.735551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.735901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.736279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] PATH_INFO: `/v3/projects/77df1a191e7d46cdbc64b53f0ad985b9/users/d987718cdcfd4f3aa06cacb2e33dcca1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.758491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77df1a191e7d46cdbc64b53f0ad985b9, user_id=d987718cdcfd4f3aa06cacb2e33dcca1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.761237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5935d4c-c387-4c8e-acaf-7b7bd18f74b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.806249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc1d89-c18c-48cc-bf73-37bc302126ff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.822133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.823232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.823891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.824528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.828827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.846759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:21.848382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:21.862323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2065/4115] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:21.863374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:21.865316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.881549 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2051/4116] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:33:21 2022] PUT /identity/v3/projects/77df1a191e7d46cdbc64b53f0ad985b9/users/d987718cdcfd4f3aa06cacb2e33dcca1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:21.884886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773dcb9-3a35-4701-91f9-08d256497d28 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:21.886416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.886726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.887137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:21.931308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:21.933086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:21.966054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:21.976702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:21.977529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:21.977805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:21.978240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:22.012601 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2052/4117] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:22.025372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:22.027352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:22.084992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:22.087268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd802cd-af62-4d4d-ac98-c1a5d117ca01 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:22.102327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca4eb-bcf5-4bc9-ab38-da924decbcfe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:22.103511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2066/4118] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:22.106401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:22.107373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:22.107984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:22.108543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:22.118874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:22.120971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527617f-05fb-491f-aba4-bb997b202c8e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:22.223710 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2053/4119] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:33:23.726135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:23.936535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d722c9-b072-403e-a722-b9ac4db9c394 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:23.936819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d722c9-b072-403e-a722-b9ac4db9c394 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:23.937121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d722c9-b072-403e-a722-b9ac4db9c394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:23.956086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38d722c9-b072-403e-a722-b9ac4db9c394 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:23.957371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d722c9-b072-403e-a722-b9ac4db9c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:24.021855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2067/4120] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:27.986469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c25d1-416b-4df7-95bc-a109b600b940 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:27.987759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c25d1-416b-4df7-95bc-a109b600b940 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:27.988644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c25d1-416b-4df7-95bc-a109b600b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:28.022969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-412c25d1-416b-4df7-95bc-a109b600b940 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:28.022969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-412c25d1-416b-4df7-95bc-a109b600b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:28.034667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2054/4121] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:28.925304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee58-87e5-49f5-84ee-ca15be59ff65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:28.926151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee58-87e5-49f5-84ee-ca15be59ff65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:28.926606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee58-87e5-49f5-84ee-ca15be59ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:28.963912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-603fee58-87e5-49f5-84ee-ca15be59ff65 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:28.965586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-603fee58-87e5-49f5-84ee-ca15be59ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:28.989119 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2068/4122] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:30.702875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22839-b932-4b5c-ab66-5ddf089c195b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:30.703424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22839-b932-4b5c-ab66-5ddf089c195b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:30.703424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22839-b932-4b5c-ab66-5ddf089c195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:30.748201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-25a22839-b932-4b5c-ab66-5ddf089c195b None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:30.749476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-25a22839-b932-4b5c-ab66-5ddf089c195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:30.775871 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2055/4123] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:32.487579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd80d-63ee-475b-8c3a-22b9c021599f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:32.488106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd80d-63ee-475b-8c3a-22b9c021599f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:32.488790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befd80d-63ee-475b-8c3a-22b9c021599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:32.535252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9befd80d-63ee-475b-8c3a-22b9c021599f None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:32.536781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9befd80d-63ee-475b-8c3a-22b9c021599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:32.555807 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2069/4124] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:33.020402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:33.021019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:33.021199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:33.069250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:33.070487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:33.175179 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2056/4125] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:33.179849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbf24-1f09-43f0-83c6-861eaf70056a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:33.180219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbf24-1f09-43f0-83c6-861eaf70056a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:33.180589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dbf24-1f09-43f0-83c6-861eaf70056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:33.260317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d6dbf24-1f09-43f0-83c6-861eaf70056a None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:33.261681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d6dbf24-1f09-43f0-83c6-861eaf70056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:33.271179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2070/4126] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:33.549096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:33.567259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a96a2-e3cb-44ba-ab7a-70d1c34c80d1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:33.574464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:33.585008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:33.585008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:33.585008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:33.585757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:33.587017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315f7a4-c30a-4e63-b5a4-9f8dc9ca925d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:33.597976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2057/4127] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:33.948605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e4c6-4154-44e1-b0c7-adaa7cc0b511 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:33.949534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e4c6-4154-44e1-b0c7-adaa7cc0b511 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:33.949992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317e4c6-4154-44e1-b0c7-adaa7cc0b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:33.975254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9317e4c6-4154-44e1-b0c7-adaa7cc0b511 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:33.977008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9317e4c6-4154-44e1-b0c7-adaa7cc0b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:33.990930 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2071/4128] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:35.269396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd54e-5ecf-4fc8-9f81-1764053bfed9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:35.270091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd54e-5ecf-4fc8-9f81-1764053bfed9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:35.270091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd54e-5ecf-4fc8-9f81-1764053bfed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:35.304373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-051fd54e-5ecf-4fc8-9f81-1764053bfed9 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:35.306384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-051fd54e-5ecf-4fc8-9f81-1764053bfed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:35.327724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2058/4129] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:36.218711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:36.219297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:36.219572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:36.242207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:36.243487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:36.252293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2072/4130] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:37.803657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:37.804956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:37.805440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:37.834832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:37.841583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:37.856820 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2059/4131] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:42.259108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:42.261398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:42.276894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29907-c1d9-4a8e-9db7-f296b8e26b23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:42.282526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:42.283328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:42.283616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:42.283905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] PATH_INFO: `/v3/users/2f846830062542eb82747dc1d2ed2e14` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:42.285524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f846830062542eb82747dc1d2ed2e14)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:42.287831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:42.543535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f846830062542eb82747dc1d2ed2e14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:42.545167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f846830062542eb82747dc1d2ed2e14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:42.640292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f846830062542eb82747dc1d2ed2e14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:42.662720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f846830062542eb82747dc1d2ed2e14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:42.663565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f846830062542eb82747dc1d2ed2e14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:42.665704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:42.692370 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2073/4132] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:33:42 2022] DELETE /identity/v3/users/2f846830062542eb82747dc1d2ed2e14 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:43.218659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:43.234339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0c57-d1e2-49d0-9f44-f00cf4ac91a9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:43.260552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:43.324845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:43.328261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:43.328261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:43.328261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] PATH_INFO: `/v3/projects/da2900e549fb492ca43d1f78c9216c7b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:43.328261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2900e549fb492ca43d1f78c9216c7b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:43.330977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:43.469364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2900e549fb492ca43d1f78c9216c7b', 'request_id': 'req-9156c915-8c3f-4fd8-929b-00d7af6df7c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.548313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2900e549fb492ca43d1f78c9216c7b', 'request_id': 'req-9156c915-8c3f-4fd8-929b-00d7af6df7c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.556971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2900e549fb492ca43d1f78c9216c7b', 'request_id': 'req-9156c915-8c3f-4fd8-929b-00d7af6df7c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.571678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] The token cache is being invalidate because project da2900e549fb492ca43d1f78c9216c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:33:43.571964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.572838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.575197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2060/4133] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:33:43 2022] DELETE /identity/v3/projects/da2900e549fb492ca43d1f78c9216c7b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:43.579019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:43.580560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:43.595354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7938965-8a73-4cbe-b458-e55425aa6be8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:43.673741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:43.674404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:43.674695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:43.675173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] PATH_INFO: `/v3/users/eb91f9209e0a4427a1018c8a2ee1fb3e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:43.676316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb91f9209e0a4427a1018c8a2ee1fb3e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:43.678242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:43.934911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb91f9209e0a4427a1018c8a2ee1fb3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:43.938880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb91f9209e0a4427a1018c8a2ee1fb3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:44.041107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb91f9209e0a4427a1018c8a2ee1fb3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:44.063648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb91f9209e0a4427a1018c8a2ee1fb3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:44.064997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-466fd37b-ec51-4b97-bf5a-b872c6677294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb91f9209e0a4427a1018c8a2ee1fb3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:44.097389 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2074/4134] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:33:43 2022] DELETE /identity/v3/users/eb91f9209e0a4427a1018c8a2ee1fb3e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:44.643224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:44.646607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:44.676563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c915-8c3f-4fd8-929b-00d7af6df7c2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:44.775109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:44.775769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:44.776165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:44.776443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] PATH_INFO: `/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:44.777614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56eec7fbc6b04f6baaacc4b96c2807ca)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:44.780121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:44.917930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56eec7fbc6b04f6baaacc4b96c2807ca', 'request_id': 'req-5cccf9bf-ee08-47c4-94df-190f58181b49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:44.927405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:44.989736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63474b5-db0d-412c-af12-50f7b4b44657 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:44.990602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63474b5-db0d-412c-af12-50f7b4b44657 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:44.990978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63474b5-db0d-412c-af12-50f7b4b44657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.027255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d63474b5-db0d-412c-af12-50f7b4b44657 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:45.028653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56eec7fbc6b04f6baaacc4b96c2807ca', 'request_id': 'req-5cccf9bf-ee08-47c4-94df-190f58181b49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:45.029093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d63474b5-db0d-412c-af12-50f7b4b44657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:45.038748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56eec7fbc6b04f6baaacc4b96c2807ca', 'request_id': 'req-5cccf9bf-ee08-47c4-94df-190f58181b49'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:45.052765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] The token cache is being invalidate because project 56eec7fbc6b04f6baaacc4b96c2807ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:33:45.053076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:45.053883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cccf9bf-ee08-47c4-94df-190f58181b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:33:45.056289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2061/4135] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:33:44 2022] DELETE /identity/v3/projects/56eec7fbc6b04f6baaacc4b96c2807ca => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:45.061195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.061529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.061904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.087677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:45.089008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:45.106261 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2075/4136] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:33:45.150738 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2062/4137] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:45.158985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.163969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.163969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.180071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:45.181268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:45.190090 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2076/4138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:45.194514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.205337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdc46-f6dc-48ca-8535-f0af27140823 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.210024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.210755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.210935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.211204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.211847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:33:45.212151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.213747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.225481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2063/4139] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:33:45.231323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.240790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf9464-6213-4f7e-8061-0917bdaf301e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.245788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.246393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.246704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.248148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.248890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.250870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.255797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:45.350457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2077/4140] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:33:45 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:45.354869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.366493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d483394-3df7-4b8e-9be4-ffc8fa9e1ef8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.433796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.434982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.435268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.435588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.436180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.439101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.577592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2064/4141] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:33:45 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:33:45.581694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.591852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053481b8-775b-4043-8d66-53fed7e1899c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.596468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.597064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.597343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.597612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.598526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.600310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.611024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2078/4142] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:45.615482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.627805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717a0a-e2fb-4ce8-856f-a95597840dc6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.633325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.633943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.634221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.634491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.635179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.636772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6155c-130e-432f-a7ec-532d5cc15e1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.649210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2065/4143] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:45.656012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:45.670396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39f6b-1d97-444c-8d68-f49a23bac6f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:45.682384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:45.683088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.683363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.683631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] PATH_INFO: `/v3/projects/f33b5f8b089e42e48449695fa2e58c94/users/74841477be3a432c96159bd8f463d02d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.710065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33b5f8b089e42e48449695fa2e58c94, user_id=74841477be3a432c96159bd8f463d02d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:45.731872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:45.829242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2079/4144] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:33:45 2022] PUT /identity/v3/projects/f33b5f8b089e42e48449695fa2e58c94/users/74841477be3a432c96159bd8f463d02d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:45.830862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfbba-c498-4408-8ed8-2dca6f28193e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:45.831382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfbba-c498-4408-8ed8-2dca6f28193e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:45.831860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfbba-c498-4408-8ed8-2dca6f28193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:45.863123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8f0cfbba-c498-4408-8ed8-2dca6f28193e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:45.864359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8f0cfbba-c498-4408-8ed8-2dca6f28193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:45.954157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:46.007731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2066/4145] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:46.056316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:46.058330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:46.067771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:46.068075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:46.068316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:46.109054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:46.110687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:46.188083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a0c-d6aa-4ceb-9964-d1777ef8a73c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:46.192044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:46.192658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:46.192931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:46.193201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:46.205151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:46.206591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e35d9-2490-491a-8b56-ac2fd89defd8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:46.223407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2080/4146] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:46.228291 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2067/4147] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:50.410420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d773-8ecc-460f-ab83-5e976350957f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:50.411023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d773-8ecc-460f-ab83-5e976350957f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:50.411023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6d773-8ecc-460f-ab83-5e976350957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:50.444188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9be6d773-8ecc-460f-ab83-5e976350957f None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:50.452381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9be6d773-8ecc-460f-ab83-5e976350957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:50.602473 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2081/4148] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:52.088958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:52.091737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:52.251632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc2f89-29dd-49e0-86a8-3e2c6301cf32 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:52.258262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:52.261283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:52.261283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:52.261283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:52.261833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:52.284203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:52.290538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:52.299083 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2068/4149] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:52.542306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b9e2-2ed6-413c-b3ec-25f0b966069e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:52.547127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b9e2-2ed6-413c-b3ec-25f0b966069e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:52.547127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b9e2-2ed6-413c-b3ec-25f0b966069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:52.594963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a92b9e2-2ed6-413c-b3ec-25f0b966069e None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:52.596653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a92b9e2-2ed6-413c-b3ec-25f0b966069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:52.618420 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2082/4150] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:52.869987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:52.891229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2519c-c69d-4666-8658-a7344cb956cc service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:52.903019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:52.903597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:52.906264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:52.906264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:52.908534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:52.921987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:52.923638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:52.938693 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2069/4151] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:33:56.087553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.088170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.088347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.158546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] MFA Rules not processed for user `74841477be3a432c96159bd8f463d02d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:33:56.158546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:33:56.210232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:56.253373 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2083/4152] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:33:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:33:56.253869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.266099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f9cf0-a458-43bb-97fa-a93fda9e9e64 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.272620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:56.273541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.274002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.274445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.275437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:56.277787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:56.386878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2070/4153] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:33:56 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:56.391561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.417180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85defce-76e8-4aed-9c27-1a3b969528c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.511745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:56.512391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.512883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.513472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.514512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:56.516829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:56.645093 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2084/4154] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:33:56 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:33:56.645629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.658001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2654-098f-4e2a-96a3-f31c135c79bc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.664289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:56.664908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.665177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.665649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.667671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:56.669712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:56.683294 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2071/4155] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:33:56.685225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.706000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55be4-1105-4444-9c8d-d3d53c408729 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.713117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:56.717500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.717781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.718088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] PATH_INFO: `/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90/users/73b9a84d26714d11b7994a560c10aab5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.743056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5108f142dad4fb59d3a59d2a1e03b90, user_id=73b9a84d26714d11b7994a560c10aab5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:56.749277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:56.827599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2085/4156] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:33:56 2022] PUT /identity/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90/users/73b9a84d26714d11b7994a560c10aab5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:33:56.831645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.848542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2195-3e62-447c-9dba-8ecf7f23f02c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.890477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:33:56.928448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:56.929311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:56.929656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:56.930033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:56.930789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:56.932521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:56.976088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:33:56.983841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae7e9-3482-4751-aed7-d12acfcf6777 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:33:56.984707 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2072/4157] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:33:57.003858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:33:57.005743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:33:57.006103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:33:57.006452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] PATH_INFO: `/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90/users/73b9a84d26714d11b7994a560c10aab5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:33:57.010334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5108f142dad4fb59d3a59d2a1e03b90, user_id=73b9a84d26714d11b7994a560c10aab5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:33:57.015686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:33:57.046919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2086/4158] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:33:56 2022] PUT /identity/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90/users/73b9a84d26714d11b7994a560c10aab5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:03.152295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:03.163520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:03.191583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa0593-43cf-4efa-a96f-0a7a845f5dc5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:03.305302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:03.306939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:03.307445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:03.308488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] PATH_INFO: `/v3/users/763e2752fd774e37886ff2f629896e61` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:03.311241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] RBAC: Authorizing `identity:delete_user(user_id=763e2752fd774e37886ff2f629896e61)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:03.314265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:03.548930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763e2752fd774e37886ff2f629896e61'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:03.549959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763e2752fd774e37886ff2f629896e61'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:03.611476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763e2752fd774e37886ff2f629896e61'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:03.644423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763e2752fd774e37886ff2f629896e61'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:03.646299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05555b3-62bc-4875-93f1-9cb6f95d179b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763e2752fd774e37886ff2f629896e61'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:03.690854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2073/4159] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:34:03 2022] DELETE /identity/v3/users/763e2752fd774e37886ff2f629896e61 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:04.364112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:04.365862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:04.390853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471bbff-7037-4265-ba7f-50d0c6f7b269 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:04.585005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:04.585005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:04.585005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:04.585005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] PATH_INFO: `/v3/projects/4fbb89daa56846be91cc0118fb2e7b99` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:04.586031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbb89daa56846be91cc0118fb2e7b99)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:04.586031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:04.768035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:04.793189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbb89daa56846be91cc0118fb2e7b99', 'request_id': 'req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:04.881006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbb89daa56846be91cc0118fb2e7b99', 'request_id': 'req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:04.895288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbb89daa56846be91cc0118fb2e7b99', 'request_id': 'req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:04.913941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] The token cache is being invalidate because project 4fbb89daa56846be91cc0118fb2e7b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:34:04.914527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:04.915662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db553d4b-fc1d-4e4f-a9ed-02827df6f21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:04.918768 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2087/4160] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:34:04 2022] DELETE /identity/v3/projects/4fbb89daa56846be91cc0118fb2e7b99 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:04.924241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:04.924738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:04.924868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:04.952900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:04.954019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:05.042859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:05.059150 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2074/4161] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:34:05.067351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.068044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.068489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.094534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:05.095866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:05.110896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.119182 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2088/4162] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:05.124083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bda24f-0be9-4093-af65-09f7c21b15d1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.129102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.129663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.130195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.130572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.131452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:34:05.132252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.134648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:05.148625 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2075/4163] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:34:05.175397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.186497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29445b-74b1-44d8-9b6e-005e926455ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.193310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.194039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.194304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.194584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.195249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.197276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:05.313119 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2089/4164] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:34:05 2022] POST /identity/v3/projects => generated 395 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:34:05.317053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.331205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80f2f8-a0bc-4a80-8196-1d5cbbebb252 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.512674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.513421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.513802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.514230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.515023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.521127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:05.735231 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2076/4165] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:34:05 2022] POST /identity/v3/users => generated 298 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:34:05.739053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.755250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613d3b-e769-49cb-947d-2446ed8117d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.768477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.769736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.770191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.770733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.771830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.773745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:05.796344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.815512 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2090/4166] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:34:05.821259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2de2-3689-49ac-8df1-14a4cc17e1dd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.826296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.827188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.827776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.828220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.829061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.831607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab406c-63be-447e-a570-f682c538f087 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:05.854666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2077/4167] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:34:05.857549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:05.871609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec95cc-d587-442f-ab5c-be130c18c800 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:05.892252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:05.893249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:05.893698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:05.894293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] PATH_INFO: `/v3/projects/1c6eca2de689463199406ed01c224117/users/787e0bd0cabe4f61a30016baa29a083a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:05.916851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6eca2de689463199406ed01c224117, user_id=787e0bd0cabe4f61a30016baa29a083a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:05.921503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:06.002462 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2091/4168] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:34:05 2022] PUT /identity/v3/projects/1c6eca2de689463199406ed01c224117/users/787e0bd0cabe4f61a30016baa29a083a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:06.008217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a485-5a0e-4927-8429-56946b4269fe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:06.008712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a485-5a0e-4927-8429-56946b4269fe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:06.008712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a485-5a0e-4927-8429-56946b4269fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:06.037315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-58d6a485-5a0e-4927-8429-56946b4269fe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:06.038610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-58d6a485-5a0e-4927-8429-56946b4269fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:06.145831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2078/4169] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:06.166390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:06.168967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:06.264714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907b19-6bdf-49c2-b317-a7eea8465acf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:06.268580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:06.269287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:06.269614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:06.269954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:06.281322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:06.283874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cff64-e7b5-4524-9b76-b9c76fc8ef60 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:06.295561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2092/4170] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:06.663177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:06.663848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:06.664765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:06.689778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] MFA Rules not processed for user `bba74db4b7434fd2957fbd0c42d21d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:06.691463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:06.804925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2079/4171] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca2f2-68b7-4a3c-9b6b-3096f2c7f7bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca2f2-68b7-4a3c-9b6b-3096f2c7f7bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca2f2-68b7-4a3c-9b6b-3096f2c7f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cbfca2f2-68b7-4a3c-9b6b-3096f2c7f7bf None None] MFA Rules not processed for user `73b9a84d26714d11b7994a560c10aab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbfca2f2-68b7-4a3c-9b6b-3096f2c7f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:12.215794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:12.218221 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2093/4172] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:12.223580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:12.226016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:12.237431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:12.359538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d551775-273f-42bb-bf25-8f6849c7a02c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:12.366911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:12.367478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:12.367863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:12.368230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:12.370136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:12.451662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:12.453896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa131a2-895b-410a-81b0-e97b81e018ed service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:12.464975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2080/4173] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:16.945738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6f699-5944-48f7-b952-c0369d564ea8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:16.946707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6f699-5944-48f7-b952-c0369d564ea8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:16.947168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6f699-5944-48f7-b952-c0369d564ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:16.971366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7e6f699-5944-48f7-b952-c0369d564ea8 None None] MFA Rules not processed for user `e3d740f6381348a49968c91b787d2d45`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:16.973305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7e6f699-5944-48f7-b952-c0369d564ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:17.073966 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2094/4174] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:18.330464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6ca6-0085-45b5-8353-2e38f5dc28e2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:18.330962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6ca6-0085-45b5-8353-2e38f5dc28e2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:18.331112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e6ca6-0085-45b5-8353-2e38f5dc28e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:18.393973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4c4e6ca6-0085-45b5-8353-2e38f5dc28e2 None None] MFA Rules not processed for user `74841477be3a432c96159bd8f463d02d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:18.395979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c4e6ca6-0085-45b5-8353-2e38f5dc28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:18.461144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2081/4175] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:19.341358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:19.342403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:19.342848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:19.374359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] MFA Rules not processed for user `787e0bd0cabe4f61a30016baa29a083a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:19.375987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:19.486866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2095/4176] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:19.492808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:19.493308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:19.493580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:19.537017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] MFA Rules not processed for user `787e0bd0cabe4f61a30016baa29a083a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:19.538756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:19.555668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2082/4177] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:19.670379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:19.699371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd691e5-68ba-42db-bde1-a1a142ee1759 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:19.711245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:19.712290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:19.712774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:19.713242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:19.735603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:19.737790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:19.756276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2096/4178] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:20.160742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:20.177550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff6cd-79aa-40c4-aa69-20e83fc61436 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:20.201467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:20.202093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:20.202368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:20.202643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:20.216118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:20.245287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:20.246850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:20.283061 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2083/4179] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:23.754982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:23.754982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:23.770797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2606b62-2446-4440-ab76-5f29e555c134 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:23.776489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:23.778062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:23.778444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:23.778948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] PATH_INFO: `/v3/users/30654870bc994ffab886c9ad05379643` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:23.780147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30654870bc994ffab886c9ad05379643)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:23.782365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:24.067413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30654870bc994ffab886c9ad05379643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:24.068313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30654870bc994ffab886c9ad05379643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:24.246946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30654870bc994ffab886c9ad05379643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:24.258242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:24.268585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30654870bc994ffab886c9ad05379643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:24.269391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30654870bc994ffab886c9ad05379643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:24.291481 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2097/4180] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:34:23 2022] DELETE /identity/v3/users/30654870bc994ffab886c9ad05379643 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:25.188113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:25.207121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1949b-932a-4259-b7d0-75fe2df05609 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:25.374945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:25.375602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:25.375880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:25.376193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] PATH_INFO: `/v3/projects/09237d89bedc478eb238f3773402c209` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:25.378075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09237d89bedc478eb238f3773402c209)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:25.380038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:25.407390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:25.605613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09237d89bedc478eb238f3773402c209', 'request_id': 'req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:25.721735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09237d89bedc478eb238f3773402c209', 'request_id': 'req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:25.728461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09237d89bedc478eb238f3773402c209', 'request_id': 'req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:25.741522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] The token cache is being invalidate because project 09237d89bedc478eb238f3773402c209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:34:25.741816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:25.742524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:25.748111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2084/4181] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:34:25 2022] DELETE /identity/v3/projects/09237d89bedc478eb238f3773402c209 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:25.751055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:25.753828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:25.781588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1a9e3-c4e9-46ab-aedb-acc4c0753af8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:25.876622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:25.877474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:25.877754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:25.878081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] PATH_INFO: `/v3/users/cd37b82f85e94413b10915f48f214342` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:25.880325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd37b82f85e94413b10915f48f214342)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:25.882452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:26.273433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd37b82f85e94413b10915f48f214342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:26.273993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd37b82f85e94413b10915f48f214342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:26.406305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd37b82f85e94413b10915f48f214342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:26.421531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd37b82f85e94413b10915f48f214342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:26.422318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a54a7e6-a735-4b05-829c-7c76a9683c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd37b82f85e94413b10915f48f214342'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:26.437440 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2098/4182] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:34:25 2022] DELETE /identity/v3/users/cd37b82f85e94413b10915f48f214342 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:26.842136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:26.847041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:26.863536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0466fa5-5e9c-4ca0-a3c8-7c2240e23165 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:26.960734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:26.961389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:26.961855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:26.962079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] PATH_INFO: `/v3/projects/0ea272789b824c52a47571857e565611` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:26.963637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea272789b824c52a47571857e565611)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:26.966277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:27.154566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea272789b824c52a47571857e565611', 'request_id': 'req-e0bae2ae-4702-4607-941f-6551a2d4b1f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:27.253296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea272789b824c52a47571857e565611', 'request_id': 'req-e0bae2ae-4702-4607-941f-6551a2d4b1f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:27.267718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea272789b824c52a47571857e565611', 'request_id': 'req-e0bae2ae-4702-4607-941f-6551a2d4b1f1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:27.301967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] The token cache is being invalidate because project 0ea272789b824c52a47571857e565611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:34:27.302302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:27.307440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e0bae2ae-4702-4607-941f-6551a2d4b1f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:27.310681 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2085/4183] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:34:26 2022] DELETE /identity/v3/projects/0ea272789b824c52a47571857e565611 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:27.315808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:27.316303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:27.316555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:27.358111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:27.359644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:27.440364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:27.458912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2099/4184] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:27.463577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:27.463868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:27.464657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:27.492264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:27.493476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:27.505773 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2086/4185] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:34:27.507148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:27.518098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4eeac-668b-4b98-9d0c-4adf2979e17e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:27.526929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:27.529128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:27.529128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:27.530808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:27.531687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:34:27.532071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:27.534157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:27.557391 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2100/4186] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:34:27.561310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:27.577108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a9f7-5e68-4214-8736-d56742923a67 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:27.584849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:27.585825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:27.586422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:27.586889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:27.599154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:27.605091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:27.792125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2087/4187] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:34:27 2022] POST /identity/v3/projects => generated 393 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:34:27.797025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:27.812777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffbb8-3e9c-41b2-9c37-1a396b3ae506 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:27.906209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:27.906860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:27.907142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:27.907411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:27.908050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:27.910172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:28.041766 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2101/4188] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:34:27 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:34:28.044564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:28.057083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd323493-e418-4759-b3be-3fd9adb3e09f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:28.063062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:28.063840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.064255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.064680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.065463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:28.067262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:28.068968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:28.079220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2088/4189] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:34:28.083141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:28.095683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787547a4-0c48-479e-b96a-1c4e5f773540 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:28.100943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:28.104547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.104547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.104547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.104547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:28.106932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff93bd-beaa-436b-9567-905eda946bcf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:28.119865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2102/4190] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:34:28.124341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:28.135119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9ab03-a436-4409-a2be-b25fd20abf25 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:28.141341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:28.142010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.142456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.142764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] PATH_INFO: `/v3/projects/1c8354eb07834845be5e454dde238e3f/users/d85d2573c62244d484e60938a9780f5d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.159604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8354eb07834845be5e454dde238e3f, user_id=d85d2573c62244d484e60938a9780f5d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:28.162374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:28.290830 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2089/4191] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:34:28 2022] PUT /identity/v3/projects/1c8354eb07834845be5e454dde238e3f/users/d85d2573c62244d484e60938a9780f5d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:34:28.319768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab25d1-23e3-4065-9d04-8f9a752f336b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.324882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab25d1-23e3-4065-9d04-8f9a752f336b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.324882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab25d1-23e3-4065-9d04-8f9a752f336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.358916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7ab25d1-23e3-4065-9d04-8f9a752f336b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:28.367481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7ab25d1-23e3-4065-9d04-8f9a752f336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:28.473513 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2103/4192] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:28.488226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:28.490515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:28.573137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be496a74-8088-4481-9eda-886e5d7f43bb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:28.578875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:28.579496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.579777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.580059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.591017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:28.604503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ab0d4-c95c-4f49-99c0-63ef11e092b5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:28.604795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2090/4193] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:28.687739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:28.688189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:28.688465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:28.708995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:28.710173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:28.807175 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2104/4194] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:33.722236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a5b-6abd-4843-b65b-23049d4d5caa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:33.723115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a5b-6abd-4843-b65b-23049d4d5caa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:33.723534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a5b-6abd-4843-b65b-23049d4d5caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:33.774562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4dfe6a5b-6abd-4843-b65b-23049d4d5caa None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:33.776493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4dfe6a5b-6abd-4843-b65b-23049d4d5caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:33.888428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2091/4195] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:34.061607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:34.063093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:34.083932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:34.181515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3617d-442e-4cc7-9724-8332d0a1b03b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:34.190326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:34.192455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:34.192944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:34.193443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:34.205732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:34.207689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e264d8-db89-4764-b79e-d5f2958370b0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:34.223928 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2105/4196] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:34:40.092973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:40.093879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:40.094346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:40.160990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] MFA Rules not processed for user `d85d2573c62244d484e60938a9780f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:40.162264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:40.286356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:40.301684 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2092/4197] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:40.302592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:40.303091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:40.303183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:40.331464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] MFA Rules not processed for user `d85d2573c62244d484e60938a9780f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:40.332669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:40.339817 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2106/4198] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:34:40.354181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:40.356288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:40.466888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0d49-92b7-4c51-9bfa-558d4293afe2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:40.473787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:40.474421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:40.474781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:40.475043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:40.484043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:40.486081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:40.500936 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2093/4199] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:44.642998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:44.645015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:44.677362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385c9b9-1e8a-4d24-8619-8c9b0d0b3b8d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:44.689908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:44.693700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:44.696151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:44.697309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:44.708420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:44.852299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:44.853770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:44.897084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2107/4200] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:51.132288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=34 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:52.630650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:52.632295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:52.649415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefdb7-494b-46b7-b2ad-958c6856834d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:52.655433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:52.656177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:52.656524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:52.656867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] PATH_INFO: `/v3/users/787e0bd0cabe4f61a30016baa29a083a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:52.658101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] RBAC: Authorizing `identity:delete_user(user_id=787e0bd0cabe4f61a30016baa29a083a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:52.660125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:53.064302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787e0bd0cabe4f61a30016baa29a083a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:53.065437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787e0bd0cabe4f61a30016baa29a083a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:53.191989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787e0bd0cabe4f61a30016baa29a083a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:53.262560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787e0bd0cabe4f61a30016baa29a083a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:53.263589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfee82c2-2c9f-4ab5-aca2-8b526795912d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787e0bd0cabe4f61a30016baa29a083a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:53.356555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2094/4201] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:34:52 2022] DELETE /identity/v3/users/787e0bd0cabe4f61a30016baa29a083a => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:53.957074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:53.969675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9744b6-58d6-4f2b-b933-d7e5c2546924 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.044744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.045722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.045983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.046250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] PATH_INFO: `/v3/projects/1c6eca2de689463199406ed01c224117` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.047524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6eca2de689463199406ed01c224117)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.049484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.234337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:54.247060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6eca2de689463199406ed01c224117', 'request_id': 'req-ea4114cb-8151-4b76-a851-528b97e7ed11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:54.342307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6eca2de689463199406ed01c224117', 'request_id': 'req-ea4114cb-8151-4b76-a851-528b97e7ed11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:54.348612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6eca2de689463199406ed01c224117', 'request_id': 'req-ea4114cb-8151-4b76-a851-528b97e7ed11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:54.360604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] The token cache is being invalidate because project 1c6eca2de689463199406ed01c224117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:34:54.360894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:54.361632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea4114cb-8151-4b76-a851-528b97e7ed11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:34:54.363145 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2108/4202] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:34:53 2022] DELETE /identity/v3/projects/1c6eca2de689463199406ed01c224117 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:54.368498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.368928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.369257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.388948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:54.390235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:54.463088 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2095/4203] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:54.470576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.470902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.471170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.491428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:54.492538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:54.501838 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2109/4204] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:54.505778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.515671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12c08f-989b-41b6-898c-d64a85c28cd2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.520694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.521346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.521629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.521903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.522564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:34:54.522906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.524566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.536794 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2096/4205] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:34:54.540885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.551033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ab7f-5bf4-44a8-993b-17997fea4b2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.556613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.557205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.558047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.558338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.559006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.560895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.691096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2110/4206] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:34:54 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:34:54.701145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.707448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6cfac-61f5-4343-8e3b-7c0ff709aa1a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.746393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.748477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:54.772774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.773520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.774117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.774117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.774794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.777460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.785800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:54.846798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dccfb3-693a-4452-b059-f4cad828283a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.852915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.853528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.853804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.854187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.856023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:54.857625 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2097/4207] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:34:54 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:34:54.862384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.871192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.872786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.873606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0804b-e748-4c01-b137-3fe194005f98 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.880223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.880553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.880887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.881221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.881928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.884355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.884776 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2111/4208] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:34:54.899481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2098/4209] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:34:54.904642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.921519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e3d2-0bf6-44f8-8549-6d31f3a316f4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.926563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.927337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.927678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.928065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.928826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.930527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc969f-fe59-4e36-b36f-b39e0baf5a5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:54.946805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2112/4210] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:34:54.952093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:54.962772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011a582-a620-4203-a23d-739552a08338 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:54.970561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:54.972405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:54.972405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:54.972405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] PATH_INFO: `/v3/projects/aae0d94684834c1b8ec0992b5f3c0b31/users/1dec54b7eb6d4f45994772930b14431b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:54.988598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae0d94684834c1b8ec0992b5f3c0b31, user_id=1dec54b7eb6d4f45994772930b14431b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:54.991420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:55.077107 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2099/4211] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:34:54 2022] PUT /identity/v3/projects/aae0d94684834c1b8ec0992b5f3c0b31/users/1dec54b7eb6d4f45994772930b14431b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:34:55.082378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:55.082894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:55.083099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:55.112260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:55.113899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:55.196514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:34:55.216659 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2113/4212] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:55.226472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:55.228338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:55.287289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26196c27-0983-4c31-aac4-3b0239409b74 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:55.292911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:55.292911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:55.292911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:55.292911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:55.303222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:55.304725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c909922-100f-47d9-9a1c-6b259031ecaa service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:55.315134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2100/4213] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:56.662742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:56.815249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edf6c1-afa9-42b0-97d2-2f8a3bdf609d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:56.824709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:56.826009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:56.826560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:56.827067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:56.829342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:56.846783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:56.848682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fdae9-b680-47c3-9dfa-4c76cda2b45e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:56.863223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2114/4214] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:57.127680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a35d8-79c1-48dc-8e3f-158ac10cc469 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:57.128499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a35d8-79c1-48dc-8e3f-158ac10cc469 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:57.128948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a35d8-79c1-48dc-8e3f-158ac10cc469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:57.169430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2b0a35d8-79c1-48dc-8e3f-158ac10cc469 None None] MFA Rules not processed for user `1dec54b7eb6d4f45994772930b14431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:57.188579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2b0a35d8-79c1-48dc-8e3f-158ac10cc469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:57.294881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2101/4215] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:57.306007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:57.307226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:57.307226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:57.327528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] MFA Rules not processed for user `1dec54b7eb6d4f45994772930b14431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:57.329014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:57.341944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2115/4216] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:57.351642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549c0a-626c-459c-be00-64c5e0d25d6e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:57.351957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549c0a-626c-459c-be00-64c5e0d25d6e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:57.352427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549c0a-626c-459c-be00-64c5e0d25d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:57.374643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91549c0a-626c-459c-be00-64c5e0d25d6e None None] MFA Rules not processed for user `1dec54b7eb6d4f45994772930b14431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:57.375915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91549c0a-626c-459c-be00-64c5e0d25d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:57.383541 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2102/4217] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:34:57.394311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:34:57.395888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:57.477980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f0eec-e22e-49ff-b58b-2dd48c25a204 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:34:57.484871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:34:57.485650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:57.486000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:57.486325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:57.495567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:34:57.497226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8282c1-2988-455d-aff6-4cf4dead4fdb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:34:57.522346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2116/4218] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:34:58.642971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4493-2979-4f94-87ee-2b37fbb899dd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:34:58.643989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4493-2979-4f94-87ee-2b37fbb899dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:34:58.644460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c4493-2979-4f94-87ee-2b37fbb899dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:34:58.680815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-221c4493-2979-4f94-87ee-2b37fbb899dd None None] MFA Rules not processed for user `1dec54b7eb6d4f45994772930b14431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:34:58.682929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-221c4493-2979-4f94-87ee-2b37fbb899dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:34:58.694830 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2103/4219] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:00.014108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:00.014706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:00.014706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:00.055795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] MFA Rules not processed for user `1dec54b7eb6d4f45994772930b14431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:00.057040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:00.077622 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2117/4220] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:01.783498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:01.784023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:01.784134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:01.822289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:01.825534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:01.863850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:01.929100 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2104/4221] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:03.503023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:03.505494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:03.600577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:03.683821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc0201-e0a7-4bc2-852b-b675e4def064 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:03.695430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:03.696157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:03.696326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:03.696862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:03.700884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:03.725688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:03.727747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:03.767152 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2118/4222] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:35:04.038581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:04.050428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067d40-9073-4900-a02b-ce19344f5f25 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:04.055010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:04.056025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:04.056548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:04.057692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:04.060113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:04.094873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:04.097544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a577fb6-b70e-49b9-9df6-5a941d8829e3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:04.110811 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2105/4223] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:35:04.370062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:04.371805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:04.387950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe152-2558-4273-93d2-38e563be5322 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:04.392178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:04.392959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:04.393193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:04.393517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:04.397289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:04.414944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:04.416642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aad3e3-0d7a-4f7f-925c-172d0a5c07a7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:04.440670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2119/4224] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:35:07.120589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:07.121086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:07.121160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:07.185327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] MFA Rules not processed for user `d85d2573c62244d484e60938a9780f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:07.187963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:07.328000 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2106/4225] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:09.175966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814651-689f-47e2-9210-2fdde527f9e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:09.178292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814651-689f-47e2-9210-2fdde527f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:09.184286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814651-689f-47e2-9210-2fdde527f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:09.225683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6d814651-689f-47e2-9210-2fdde527f9e8 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:09.227002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d814651-689f-47e2-9210-2fdde527f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:09.305496 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2120/4226] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:35:09.323811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:09.326037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:09.481194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c9917-0cbd-4414-b754-4dd0ba823cff None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:09.491820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:09.496161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:09.496161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:09.496161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:09.503834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:09.506026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66039bb3-a29e-42e9-abc9-c9a4d99bbfba service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:09.519567 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2107/4227] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:35:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:35:19.296437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=43 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:19.513558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=73 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:20.920629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b09b-ed3d-44f8-8f30-0e461a20dbf4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:20.921467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b09b-ed3d-44f8-8f30-0e461a20dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:20.921569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b09b-ed3d-44f8-8f30-0e461a20dbf4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:20.923006 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2121/4228] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:35:20.929484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3a68-6fa6-45bd-a03e-64e66a7acb5d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:20.930027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3a68-6fa6-45bd-a03e-64e66a7acb5d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:20.930136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3a68-6fa6-45bd-a03e-64e66a7acb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:20.988724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70bf3a68-6fa6-45bd-a03e-64e66a7acb5d None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:20.990326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70bf3a68-6fa6-45bd-a03e-64e66a7acb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:20.997123 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2108/4229] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:21.013581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b09b-ed3d-44f8-8f30-0e461a20dbf4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:21.031201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b09b-ed3d-44f8-8f30-0e461a20dbf4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:21.035095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:21.035937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:21.036282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:21.036624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:21.060026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:21.061646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8d8de-2b5f-4a15-b37c-8806167364b0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:21.072519 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2122/4230] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:35:30.986161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:31.067766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:34.998777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:35.005595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:35.005595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:35.168509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:35.169718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:35.178267 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2109/4231] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:39.391828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a371-bdae-4497-8673-74a130484716 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:39.392400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a371-bdae-4497-8673-74a130484716 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:39.392476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a371-bdae-4497-8673-74a130484716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:39.419154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f269a371-bdae-4497-8673-74a130484716 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:39.420397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f269a371-bdae-4497-8673-74a130484716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:39.430241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2123/4232] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:39.469803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:39.487078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806e107-af1e-4ebb-9d11-09cef73db590 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:39.494177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:39.494870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:39.495239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:39.495511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:39.507535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:39.509789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:39.524024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2110/4233] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:35:43.528496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a371-bdae-4497-8673-74a130484716 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:43.530461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f269a371-bdae-4497-8673-74a130484716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:43.547248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a371-bdae-4497-8673-74a130484716 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:43.553367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:43.553975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:43.554265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:43.554577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:43.556372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:43.575386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:43.577039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:43.597380 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2124/4234] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:35:43.658040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:43.659515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:43.675125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdd397-bdb7-4029-904b-a24e2d7b5f37 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:43.679793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:43.680555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:43.680831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:43.681099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] PATH_INFO: `/v3/users/e3d740f6381348a49968c91b787d2d45` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:43.682822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d740f6381348a49968c91b787d2d45)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:43.684753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:43.841967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d740f6381348a49968c91b787d2d45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:43.842644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d740f6381348a49968c91b787d2d45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:43.930991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d740f6381348a49968c91b787d2d45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:43.944282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d740f6381348a49968c91b787d2d45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:43.944964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-22c8035c-b211-4a6b-a0c2-15cb1829351c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d740f6381348a49968c91b787d2d45'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:43.957695 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2111/4235] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:35:43 2022] DELETE /identity/v3/users/e3d740f6381348a49968c91b787d2d45 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:35:44.246351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:44.258220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759687-7eee-414a-934a-de04abbbcb79 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:44.362764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:44.363481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:44.364019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:44.364296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] PATH_INFO: `/v3/projects/bee27b21a034473eb695f8cb5f3f725e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:44.365527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee27b21a034473eb695f8cb5f3f725e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:44.367521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:44.543357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee27b21a034473eb695f8cb5f3f725e', 'request_id': 'req-86139e27-26a5-4084-a22d-184ca7b42e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:44.651085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee27b21a034473eb695f8cb5f3f725e', 'request_id': 'req-86139e27-26a5-4084-a22d-184ca7b42e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:44.657424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee27b21a034473eb695f8cb5f3f725e', 'request_id': 'req-86139e27-26a5-4084-a22d-184ca7b42e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:44.669618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] The token cache is being invalidate because project bee27b21a034473eb695f8cb5f3f725e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:35:44.669924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:44.670571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86139e27-26a5-4084-a22d-184ca7b42e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:35:44.672629 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2125/4236] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:35:44 2022] DELETE /identity/v3/projects/bee27b21a034473eb695f8cb5f3f725e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:35:44.677536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:44.678386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:44.678386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:44.697635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:44.699464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:44.764596 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2112/4237] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:44.772411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:44.772692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:44.772962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:44.794609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:44.795829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:44.804244 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2126/4238] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:44.808973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:44.818691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0be567-17a3-4715-95f0-f584aa2a844c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:44.823886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:44.824487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:44.824765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:44.825324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:44.825863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:35:44.826223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:44.827879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:44.840880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2113/4239] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:35:44.845056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:44.854391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cafea9-7d41-43d4-9c75-412e08f6e5e0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:44.860682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:44.860808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:44.861064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:44.861307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:44.862001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:44.865448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:44.950207 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2127/4240] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:35:44 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:35:44.954124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:44.964665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b764e-8ef7-497d-aa35-f73774455d98 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:45.001365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:45.020167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:45.020813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.021134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.021403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.022018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:45.023955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:45.176967 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2114/4241] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:35:44 2022] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:35:45.181185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:45.193980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69353a3c-b66b-45b4-affb-d612f0d2ad47 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:45.199865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:45.201633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.201633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.201633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.202136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:45.204300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:45.217422 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2128/4242] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:35:45.222005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:45.234854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca88c4-6548-432a-83dd-83d3281aa1a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:45.240179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:45.240961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.241382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.241805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.242699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:45.244702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d2bd-c0cc-442e-b68b-be292cdd374a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:45.257066 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2115/4243] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:35:45.262389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:45.272600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee58ac-d238-4087-85aa-19a33ca10934 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:45.277796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:45.278454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.278766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.279039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] PATH_INFO: `/v3/projects/e20a3493240b40d6809af74076868849/users/3ccdada6311943a899bd5b709ee9c8ce/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.295292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a3493240b40d6809af74076868849, user_id=3ccdada6311943a899bd5b709ee9c8ce, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:45.298446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:45.374790 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2129/4244] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:35:45 2022] PUT /identity/v3/projects/e20a3493240b40d6809af74076868849/users/3ccdada6311943a899bd5b709ee9c8ce/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:35:45.384535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded364-f704-4549-89b9-b74e76fad960 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.384822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded364-f704-4549-89b9-b74e76fad960 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.385099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded364-f704-4549-89b9-b74e76fad960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.423004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e2ded364-f704-4549-89b9-b74e76fad960 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:45.424247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2ded364-f704-4549-89b9-b74e76fad960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:45.490913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2116/4245] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:45.502544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:45.504589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:45.514862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:45.569050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14786f19-081c-42c2-8fc6-0c32841f835e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:45.572862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:45.573991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:45.574269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:45.574538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:45.584610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:45.586069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:45.598762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2130/4246] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:35:55.131084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:55.131610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:55.131848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:55.176877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] MFA Rules not processed for user `3ccdada6311943a899bd5b709ee9c8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:35:55.178224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:35:55.433270 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2117/4247] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:35:55.439536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:55.464850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0930f7-137a-4c5c-ae88-80ce23ec1176 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:55.495961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:55.500119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:55.501854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:55.502353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:55.503358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:55.508652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:55.762397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:55.774108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2131/4248] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:35:55 2022] POST /identity/v3/projects => generated 403 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:35:55.784413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf5412-7341-4ed7-b3b4-5975ab73d174 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:55.865439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:35:55.916436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:55.917071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:55.917355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:55.917623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:55.918269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:55.920245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:56.034813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2118/4249] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:35:55 2022] POST /identity/v3/users => generated 302 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:35:56.038752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:56.059255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb634-aabd-4c15-a0a8-e8527cdcd960 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:56.066457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:56.067456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:56.067754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:56.068043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:56.068690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:56.070306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:56.085671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2132/4250] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:35:56.089962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:56.101396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133492c9-e14d-499a-a9a5-a92cc8b601a6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:56.110997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:56.112419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:56.112419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:56.112419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:56.112972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:56.116360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ac92-ee46-4384-83fe-8a15f7cef955 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:56.133803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:35:56.134816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2119/4251] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:35:56.149048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ae34-41d4-4271-b5a5-ce3c6343d05d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:35:56.154016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:35:56.154847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:35:56.155136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:35:56.155445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] PATH_INFO: `/v3/projects/8a3cd2b97d464492986984f7dd98df36/users/6db254031b3b4e9987ffe238f9577854/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:35:56.175456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3cd2b97d464492986984f7dd98df36, user_id=6db254031b3b4e9987ffe238f9577854, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:35:56.178817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492df016-0a9c-42bc-83a7-7a1be65ba081 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:35:56.256625 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2133/4252] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:35:56 2022] PUT /identity/v3/projects/8a3cd2b97d464492986984f7dd98df36/users/6db254031b3b4e9987ffe238f9577854/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:04.105766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f951-8ee9-4026-911f-c44628e89849 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:04.106357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f951-8ee9-4026-911f-c44628e89849 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:04.106357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f951-8ee9-4026-911f-c44628e89849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:04.140789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a5c7f951-8ee9-4026-911f-c44628e89849 None None] MFA Rules not processed for user `6db254031b3b4e9987ffe238f9577854`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:04.142025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a5c7f951-8ee9-4026-911f-c44628e89849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:04.230889 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2120/4253] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:04.234739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:04.235609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:04.236087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:04.311910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] MFA Rules not processed for user `3ccdada6311943a899bd5b709ee9c8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:04.313237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:04.425342 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2134/4254] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:36:04.557580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:04.557861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:04.562482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:04.591126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:04.592557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:04.679026 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2121/4255] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:04.891296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:04.893539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:05.029536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:05.102683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb374-9e22-47ef-a34c-88fce8747511 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:05.111303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:05.112740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:05.113094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:05.113351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:05.122784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:05.124444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:05.138152 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2135/4256] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:04 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:14.657802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:15.170910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=20 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:27.796498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:27.798248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:27.815779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f47b86-618c-4efa-8f41-27c66f7f673d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:27.821515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:27.822944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:27.823294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:27.823633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:27.832593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:27.834447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:27.844173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2122/4257] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:27 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:31.689189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:31.692428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:31.914053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddc76d-71b3-4aa2-8905-5af2f5b5b9f4 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:31.926806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:31.927617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:31.928041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:31.928610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:31.929964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:31.932715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:31.933403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:31.965046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:31.972052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d08eb-a0f9-448f-baa0-f146302de75a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:31.999965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2136/4258] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:32.073159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c370d-966c-40d8-b452-761a1dfe03fe service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:32.091561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:32.095022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:32.096682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:32.097274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] PATH_INFO: `/v3/users/1dec54b7eb6d4f45994772930b14431b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:32.101770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dec54b7eb6d4f45994772930b14431b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:32.109157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:32.321113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:32.321397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:32.321669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:32.346706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] MFA Rules not processed for user `d987718cdcfd4f3aa06cacb2e33dcca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:32.348212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:32.355316 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2137/4259] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:36:32.403895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dec54b7eb6d4f45994772930b14431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:32.404574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dec54b7eb6d4f45994772930b14431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:32.481097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dec54b7eb6d4f45994772930b14431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:32.503360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dec54b7eb6d4f45994772930b14431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:32.505584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dec54b7eb6d4f45994772930b14431b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:32.531642 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2123/4260] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:31 2022] DELETE /identity/v3/users/1dec54b7eb6d4f45994772930b14431b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:33.275992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:33.303196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1fc55-54b7-4ce9-9d2a-ec328a5f1f5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:33.446344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:33.456173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:33.456475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:33.456850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] PATH_INFO: `/v3/projects/aae0d94684834c1b8ec0992b5f3c0b31` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:33.459292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae0d94684834c1b8ec0992b5f3c0b31)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:33.461404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:33.684930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae0d94684834c1b8ec0992b5f3c0b31', 'request_id': 'req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:33.766074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae0d94684834c1b8ec0992b5f3c0b31', 'request_id': 'req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:33.773695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae0d94684834c1b8ec0992b5f3c0b31', 'request_id': 'req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:33.778926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:33.780900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:33.789361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] The token cache is being invalidate because project aae0d94684834c1b8ec0992b5f3c0b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:33.792585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:33.792585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6ecac5b-ab7d-4c63-a3d5-a24f252f984b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:33.792585 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2138/4261] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:33 2022] DELETE /identity/v3/projects/aae0d94684834c1b8ec0992b5f3c0b31 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:33.796899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26beb19-139d-4b51-9f82-7350eb10c5f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:33.797185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26beb19-139d-4b51-9f82-7350eb10c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:33.797458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26beb19-139d-4b51-9f82-7350eb10c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:33.804600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9544ef-20bc-43e6-a74f-dc3f25310093 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:33.840108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c26beb19-139d-4b51-9f82-7350eb10c5f2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:33.841099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c26beb19-139d-4b51-9f82-7350eb10c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:33.860968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:33.932470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2139/4262] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:33.949429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:33.950106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:33.950459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:33.974977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:33.975620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:33.975903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:33.976337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] PATH_INFO: `/v3/users/bba74db4b7434fd2957fbd0c42d21d4b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:33.977774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba74db4b7434fd2957fbd0c42d21d4b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:33.979986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:33.987026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:34.006011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:34.007910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:34.023189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2140/4263] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:34.026396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.036559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178141a-0497-402f-b23b-8102f0c9b989 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.046761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.047396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.048022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.048199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.048861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:36:34.049166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.051551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.072656 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2141/4264] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:34.081198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.088871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8e704-e129-4b3b-8c57-cad6e574101a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.094847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.095503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.095786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.096059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.096703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.098920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.248906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2142/4265] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:34 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:34.252170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba74db4b7434fd2957fbd0c42d21d4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.253098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba74db4b7434fd2957fbd0c42d21d4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.253712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.258570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:34.327682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba74db4b7434fd2957fbd0c42d21d4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.341752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba74db4b7434fd2957fbd0c42d21d4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.342081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562db32c-dca6-4767-858c-d6f1b573e818 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.343079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba74db4b7434fd2957fbd0c42d21d4b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.348534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.349232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.349520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.349795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.350537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.352642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.359014 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2124/4266] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:33 2022] DELETE /identity/v3/users/bba74db4b7434fd2957fbd0c42d21d4b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:34.441130 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2143/4267] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:34 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:36:34.445676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.533383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a806d-fb1b-4dad-bde6-434b53279dfa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.541354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.543035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.543194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.543481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.544167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.545795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.575777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2125/4268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:34.585197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.591618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcba31-664e-423f-9330-f05186b4fa14 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.598433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.599229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.599650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.600018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.600779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.602526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.616452 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2144/4269] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:34.617805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.629400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246caf-f114-4d62-bf7e-05be4451db3d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.635983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.636807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.637175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.637624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] PATH_INFO: `/v3/projects/24a512ed75fe47988b588b5fe104c853/users/c1f6dc86d8094a53ac0e58c3a59e7e5c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.652857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a512ed75fe47988b588b5fe104c853, user_id=c1f6dc86d8094a53ac0e58c3a59e7e5c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.655677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8264-055f-4040-b16d-61627c459b03 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.700922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.704396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:34.720159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17affd-4025-4cbb-bbd1-dd9917d1a592 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.728974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:34.728974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.728974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.728974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] PATH_INFO: `/v3/projects/a3454e482fb74b7dbe4002d1f366073f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.730143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3454e482fb74b7dbe4002d1f366073f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:34.732716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:34.756079 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2126/4270] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:34 2022] PUT /identity/v3/projects/24a512ed75fe47988b588b5fe104c853/users/c1f6dc86d8094a53ac0e58c3a59e7e5c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:34.760827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.761224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.761637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.784880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:34.792852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:34.852546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:34.858719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:34.861696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3454e482fb74b7dbe4002d1f366073f', 'request_id': 'req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.874974 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2127/4271] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:34.884002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:34.886173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:34.919803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3454e482fb74b7dbe4002d1f366073f', 'request_id': 'req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.927435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3454e482fb74b7dbe4002d1f366073f', 'request_id': 'req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.948029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] The token cache is being invalidate because project a3454e482fb74b7dbe4002d1f366073f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:34.948763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.949362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15bf1d7a-2bd4-4dba-aec8-98fd90d53acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:34.951430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2145/4272] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:34 2022] DELETE /identity/v3/projects/a3454e482fb74b7dbe4002d1f366073f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:34.960067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:34.960067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:34.960067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:34.980788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88473cb3-1c47-4b8c-9f1a-96edf18cdeb4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:34.991399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:34.994688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:35.075571 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2146/4273] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:35.075768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.075768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.075768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.075768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.076140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.076140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:35.078181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:35.084405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd0327-c8a3-4a4d-bb3a-b7a0219843a0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.094787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.095630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33051b9-947f-4e25-a8a2-d6bfb512ebee service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.102537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.104560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.104845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.105119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] PATH_INFO: `/v3/users/d85d2573c62244d484e60938a9780f5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.106484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85d2573c62244d484e60938a9780f5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.107620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2128/4274] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:36:35.109055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.109338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.109611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.116160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.144402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:35.146023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:35.160891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2129/4275] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:35.161802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.171663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd63c4d-bc04-4509-a2f8-ced71d83af20 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.178896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.179697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.179863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.180296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.180966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:36:35.181289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.182973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.195449 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2130/4276] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:35.200317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.215225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d490a-7998-4b24-8506-245ca9368372 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.215351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.215876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.216153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.216419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.217035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.218965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.334011 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2131/4277] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:35 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:36:35.338320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.427673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682778f-436d-4391-8533-9b5df9edbd89 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.437210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85d2573c62244d484e60938a9780f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:35.437655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.437933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.438254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85d2573c62244d484e60938a9780f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:35.438388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.438688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.439386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.441762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.548533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85d2573c62244d484e60938a9780f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:35.574233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85d2573c62244d484e60938a9780f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:35.576119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85d2573c62244d484e60938a9780f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:35.594649 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2147/4278] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:35 2022] DELETE /identity/v3/users/d85d2573c62244d484e60938a9780f5d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:35.663939 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2132/4279] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:35 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:35.668332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.670454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:35.801750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cad02-3500-48f0-ab1c-2332ba7a281d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.814403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.815136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.815415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.816086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.817205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.819191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.832189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2148/4280] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:35.836119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.843444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:35.851183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19004a-29b2-4cd0-8740-9f1b1c92c5b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.858061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.858763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.859242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.859688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.866669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.866669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1889bda-5fae-4193-a6d3-2768eaaa5bd0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.875305 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2133/4281] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:35.879619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:35.892523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb022d-dbb7-4be0-9b5d-c08417f35bad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:35.899214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:35.900593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:35.901123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:35.901617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] PATH_INFO: `/v3/projects/1865b04058b844e9a2c131dc1703ddb3/users/752860792f754829a94314d555321ac1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:35.924546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1865b04058b844e9a2c131dc1703ddb3, user_id=752860792f754829a94314d555321ac1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:35.927739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:35.937856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:36.041099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2149/4282] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:35 2022] PUT /identity/v3/projects/1865b04058b844e9a2c131dc1703ddb3/users/752860792f754829a94314d555321ac1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:36.052114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:36.052400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:36.052683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:36.117623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] MFA Rules not processed for user `752860792f754829a94314d555321ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:36.120116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:36.278817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2134/4283] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:36.291505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:36.293799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:36.453337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174353c-06f6-4381-a3e8-e8a848711e19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:36.465422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:36.466066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:36.466347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:36.466647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:36.485760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:36.487279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41909823-7d0e-42de-a3c6-b2fb2f755bef service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:36.503916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2150/4284] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:36.604714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:36.606735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:36.758781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65b390-c627-4952-b665-dd91d4ff2d0d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:36.763968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:36.764836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:36.765209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:36.765578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] PATH_INFO: `/v3/projects/1c8354eb07834845be5e454dde238e3f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:36.766991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8354eb07834845be5e454dde238e3f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:36.769014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:36.919067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8354eb07834845be5e454dde238e3f', 'request_id': 'req-79920e7c-3d41-4760-a7df-9d14fd4a2af0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:36.994719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8354eb07834845be5e454dde238e3f', 'request_id': 'req-79920e7c-3d41-4760-a7df-9d14fd4a2af0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:37.004608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8354eb07834845be5e454dde238e3f', 'request_id': 'req-79920e7c-3d41-4760-a7df-9d14fd4a2af0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:37.026035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] The token cache is being invalidate because project 1c8354eb07834845be5e454dde238e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:37.026776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:37.027269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79920e7c-3d41-4760-a7df-9d14fd4a2af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:37.029646 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2135/4285] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:36 2022] DELETE /identity/v3/projects/1c8354eb07834845be5e454dde238e3f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:37.036528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.036813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.037277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.074102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:37.075633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:37.175425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2151/4286] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:37.183533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.184258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.184734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.207935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:37.209234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:37.221874 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2136/4287] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:37.223813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.261116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655547-6836-4b64-8e37-fc586143d3b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.266430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.267284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.267592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.267975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.268707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:36:37.269074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.270921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:37.302536 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2152/4288] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:37.306892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.318421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e374a-13e2-4859-b98f-d8a0fc5f07ea None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.326353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.327258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.327729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.328168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.329049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.331465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:37.370864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:37.486707 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2137/4289] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:37 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:37.493839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.510630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118698-96af-4636-8c03-329a012fb65f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.646046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.646815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.647228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.647602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.648413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.651225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:37.778331 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2153/4290] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:37 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:37.782979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.798666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e7a-76fa-4b0a-bbd4-8d149c732628 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.810546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.810546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.810546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.810546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.811050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.817613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:37.859353 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2138/4291] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:37.860215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.872423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7cd0-b156-46c4-8c00-2cf84445efa5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.880229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.881068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.881520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.881946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.882804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.885661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e703d1-8351-4360-8cc9-b846f3091bd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:37.900568 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2154/4292] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:36:37.905830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:37.929003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca21a-cc53-422a-b8df-d6939e1a981c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:37.938805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:37.940951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:37.941408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:37.941993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] PATH_INFO: `/v3/projects/c69b0c9162c040f7a413446fe6dacb53/users/bd851df5114d4ca1a3aa2233cde813a9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:37.965565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69b0c9162c040f7a413446fe6dacb53, user_id=bd851df5114d4ca1a3aa2233cde813a9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:37.969321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:38.073409 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2139/4293] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:37 2022] PUT /identity/v3/projects/c69b0c9162c040f7a413446fe6dacb53/users/bd851df5114d4ca1a3aa2233cde813a9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:38.078730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:38.078960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:38.079285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:38.098270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:38.125817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:38.127782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:38.279750 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2155/4294] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:38.292883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:38.294859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:38.375344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165117b-96e9-47da-a36a-b177495d3447 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:38.378814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:38.379472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:38.379757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:38.380014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:38.395185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:38.397712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:38.422512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2140/4295] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:44.292077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:44.309941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:44.462725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd92a-e5b9-4139-9d57-e018da07ea97 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:44.466803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:44.467426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:44.467885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:44.468457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:44.473191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:44.657209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:44.658977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:44.673899 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2156/4296] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:46.096247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:46.097885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:46.123145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ad37-1677-468f-b093-afbf245bb32d service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:46.130528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:46.131593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:46.134190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:46.134813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] PATH_INFO: `/v3/users/3ccdada6311943a899bd5b709ee9c8ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:46.136421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ccdada6311943a899bd5b709ee9c8ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:46.139461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:46.386320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccdada6311943a899bd5b709ee9c8ce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:46.387298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccdada6311943a899bd5b709ee9c8ce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:46.479933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccdada6311943a899bd5b709ee9c8ce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:46.504929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccdada6311943a899bd5b709ee9c8ce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:46.505878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccdada6311943a899bd5b709ee9c8ce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:46.539197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2141/4297] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:46 2022] DELETE /identity/v3/users/3ccdada6311943a899bd5b709ee9c8ce => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:46.915059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:46.922585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:46.949461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a87994-a9c5-4929-8540-be0259f9880f service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:47.085068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:47.085982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:47.086264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:47.086544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] PATH_INFO: `/v3/projects/e20a3493240b40d6809af74076868849` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:47.089413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20a3493240b40d6809af74076868849)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:47.094724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:47.215152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20a3493240b40d6809af74076868849', 'request_id': 'req-9a4baca2-8ab4-483a-8440-529a9346c3ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.279225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20a3493240b40d6809af74076868849', 'request_id': 'req-9a4baca2-8ab4-483a-8440-529a9346c3ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.294410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20a3493240b40d6809af74076868849', 'request_id': 'req-9a4baca2-8ab4-483a-8440-529a9346c3ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.361088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] The token cache is being invalidate because project e20a3493240b40d6809af74076868849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:47.361740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.362948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a4baca2-8ab4-483a-8440-529a9346c3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.369489 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2157/4298] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:46 2022] DELETE /identity/v3/projects/e20a3493240b40d6809af74076868849 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:47.372643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:47.374098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:47.396053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa87397-632c-4482-9183-3ca4b2d5b7e5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:47.461670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:47.522913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:47.524208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:47.525170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:47.525585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] PATH_INFO: `/v3/users/6db254031b3b4e9987ffe238f9577854` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:47.527048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db254031b3b4e9987ffe238f9577854)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:47.530645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:47.700423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db254031b3b4e9987ffe238f9577854'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.700423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db254031b3b4e9987ffe238f9577854'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.811362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db254031b3b4e9987ffe238f9577854'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.843946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db254031b3b4e9987ffe238f9577854'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.845078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a49bba70-f34d-4b1c-a2ae-ef1134b78017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db254031b3b4e9987ffe238f9577854'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:47.876079 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2142/4299] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:47 2022] DELETE /identity/v3/users/6db254031b3b4e9987ffe238f9577854 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:48.007425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:48.007972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:48.007972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:48.069785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] MFA Rules not processed for user `c1f6dc86d8094a53ac0e58c3a59e7e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:48.071229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:48.166786 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2158/4300] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:48.180587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:48.181754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:48.182355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:48.221549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] MFA Rules not processed for user `c1f6dc86d8094a53ac0e58c3a59e7e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:48.222821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:48.231380 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2143/4301] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:48.264158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:48.264158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:48.335516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:48.350224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:48.350361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:48.467924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78e495-0bc9-43de-a045-5e52a0f5a202 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:48.477158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:48.479303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:48.479748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:48.480181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] PATH_INFO: `/v3/projects/8a3cd2b97d464492986984f7dd98df36` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:48.483938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3cd2b97d464492986984f7dd98df36)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:48.490007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:48.509149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117a8a-0a16-444a-b5f6-8e6187d5302a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:48.516764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:48.517684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:48.518167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:48.518747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:48.533513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:48.536072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37d1a-1a42-4332-a1b8-9ca86128868d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:48.554393 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2144/4302] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:48.751097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3cd2b97d464492986984f7dd98df36', 'request_id': 'req-9d2eaa92-83bb-4c80-953e-43371b967323'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:48.828277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3cd2b97d464492986984f7dd98df36', 'request_id': 'req-9d2eaa92-83bb-4c80-953e-43371b967323'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:48.835256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3cd2b97d464492986984f7dd98df36', 'request_id': 'req-9d2eaa92-83bb-4c80-953e-43371b967323'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:48.864529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] The token cache is being invalidate because project 8a3cd2b97d464492986984f7dd98df36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:48.864529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:48.864529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d2eaa92-83bb-4c80-953e-43371b967323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:48.868051 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2159/4303] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:48 2022] DELETE /identity/v3/projects/8a3cd2b97d464492986984f7dd98df36 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:36:48.873853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:48.874251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:48.874601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:48.913352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:48.914786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:48.969050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:49.082168 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2145/4304] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:49.166488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.167341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.168093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.197295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:49.198817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:49.225845 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2160/4305] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:36:49.230914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.246993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a430-1116-496f-b52e-4dd420915ae9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.260926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.263196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.263640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.263965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.265403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:36:49.265403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.268976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.286657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2146/4306] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:49.291017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.304584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb48bbd-11d9-4cda-8b52-26559b112b73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.312538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.313976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.314413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.314939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.317107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.319332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.476326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2161/4307] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:49 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:49.481289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.492611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20ebaa-a2cd-487b-9ccb-95a80f8ec5c1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.561478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.562448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.563394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.570361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.570361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.570361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.710085 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2147/4308] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:49 2022] POST /identity/v3/users => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:49.714692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.727676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b8e86-311d-4f77-937d-7885c76e0a4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.734824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.734824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.734824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.734824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.735138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.736361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.749293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2162/4309] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:49.753271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.773899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53afe4-9eb9-4c90-a944-60347ea6f85f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.783280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.784038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.784912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.785451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.786771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.789742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1169a6-ff1d-4ffd-87dd-0b1ed2048110 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.802950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2148/4310] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:49.808030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:49.818724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501d9b1-b71c-4c5f-9f65-fe057b89e551 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:49.824174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:49.824838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.825237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.825528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] PATH_INFO: `/v3/projects/22c085a2b1b1476fb5b65385bba49c6f/users/5055a2a02683431fab693ab31a19c91a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:49.853201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c085a2b1b1476fb5b65385bba49c6f, user_id=5055a2a02683431fab693ab31a19c91a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:49.857470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:49.962178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2163/4311] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:49 2022] PUT /identity/v3/projects/22c085a2b1b1476fb5b65385bba49c6f/users/5055a2a02683431fab693ab31a19c91a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:49.972481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3693a-06e3-4db1-bcd8-e69a6cd61d74 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:49.972764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3693a-06e3-4db1-bcd8-e69a6cd61d74 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:49.973040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3693a-06e3-4db1-bcd8-e69a6cd61d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:50.033546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7af3693a-06e3-4db1-bcd8-e69a6cd61d74 None None] MFA Rules not processed for user `5055a2a02683431fab693ab31a19c91a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:50.034802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7af3693a-06e3-4db1-bcd8-e69a6cd61d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:50.222236 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2149/4312] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:50.255649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:50.360007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:50.388815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f799f-1e2d-49e9-8d8d-845784b57e4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:50.403191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:50.403901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:50.404357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:50.404816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] PATH_INFO: `/v3/users/5055a2a02683431fab693ab31a19c91a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:50.406178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5055a2a02683431fab693ab31a19c91a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:50.408445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:50.773188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5055a2a02683431fab693ab31a19c91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:50.776151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5055a2a02683431fab693ab31a19c91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:50.877841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5055a2a02683431fab693ab31a19c91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:50.939836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5055a2a02683431fab693ab31a19c91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:50.942828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5055a2a02683431fab693ab31a19c91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:50.995079 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2164/4313] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:50 2022] DELETE /identity/v3/users/5055a2a02683431fab693ab31a19c91a => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:50.996319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:50.996788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:50.996788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:51.050323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:51.052667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:51.088000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:51.247771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2150/4314] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:51.254869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:51.256442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:51.403783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ffd1-2b04-4b9f-aac1-f2289e4bbdae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:51.413643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:51.414519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:51.415363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:51.415833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:51.435768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:51.437360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b0829-cf24-42fb-92af-026e4bb65f74 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:51.471293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2165/4315] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:52.268106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:52.272580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:52.299565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936796cd-2d79-40d3-b914-21dcf0e073ec None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:52.316591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:52.318117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:52.318565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:52.319276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] PATH_INFO: `/v3/projects/22c085a2b1b1476fb5b65385bba49c6f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:52.323329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c085a2b1b1476fb5b65385bba49c6f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:52.327192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:52.576310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c085a2b1b1476fb5b65385bba49c6f', 'request_id': 'req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:52.685293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c085a2b1b1476fb5b65385bba49c6f', 'request_id': 'req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:52.694558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c085a2b1b1476fb5b65385bba49c6f', 'request_id': 'req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:52.729489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] The token cache is being invalidate because project 22c085a2b1b1476fb5b65385bba49c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:52.729789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:52.732191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a4cb63fa-d8e5-446f-a53b-d2e6c5fae7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:52.744185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2151/4316] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:52 2022] DELETE /identity/v3/projects/22c085a2b1b1476fb5b65385bba49c6f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:52.756613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:52.757137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:52.757329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:52.780951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:52.782102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:52.994829 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2166/4317] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:36:53.003427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.003427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.003427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.049917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:53.052902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:53.092404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2152/4318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:53.092532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:53.105584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48404af4-4fc1-4f75-a7e2-ea269392afbe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:53.118491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:53.119700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.120130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.120550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.121419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:36:53.121920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:53.128128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:53.173551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:53.194820 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2167/4319] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:53.198680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:53.217619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bd07d-46cc-4793-a32a-8d66936db315 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:53.245037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:53.245845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.246292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.246575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.247240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:53.249172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:53.444434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2153/4320] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:53 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:53.448767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:53.463720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905aa5b-afe5-480e-880d-2d9e477dcbd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:53.636025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:53.636669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.636953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.643527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.644157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:53.646130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:53.793886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2168/4321] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:53 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:53.795153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:53.815724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19889-cf7a-4d92-86dc-960980458571 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:53.832926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:53.834156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.834779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.835300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.836343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:53.838811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:53.871026 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2154/4322] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:53.876010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:53.893141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44d87-52b9-4997-b60f-78fa1933b9b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:53.919696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:53.919696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:53.919696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:53.919696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:53.920132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:53.951378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de2d44-f20a-4267-85fc-a1ce604a8fde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:53.985862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2169/4323] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:53.990407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:54.010800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b9b26-a2e4-4624-845f-9edfc4e92562 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:54.041897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:54.047005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:54.048661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:54.048972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] PATH_INFO: `/v3/projects/ab3ba041194a46969f227fd1caa473e3/users/b40e85d56dda4cf88b1eaff1f44433cd/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:54.143214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3ba041194a46969f227fd1caa473e3, user_id=b40e85d56dda4cf88b1eaff1f44433cd, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:54.153876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8a85b-2895-42b0-91a3-637349bb43ec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:54.245508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2155/4324] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:53 2022] PUT /identity/v3/projects/ab3ba041194a46969f227fd1caa473e3/users/b40e85d56dda4cf88b1eaff1f44433cd/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:54.264508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:54.264789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:54.265872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:54.309100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:54.309911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:54.310185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:54.417571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] MFA Rules not processed for user `b40e85d56dda4cf88b1eaff1f44433cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:54.419138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:54.435629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] MFA Rules not processed for user `bd851df5114d4ca1a3aa2233cde813a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:54.440439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:54.516307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:54.662424 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2156/4325] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:54.670500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:54.675763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:54.715949 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2170/4326] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:54.717073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:54.940236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb4c0-0074-4049-bc24-534cf493fe1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:54.964157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927db4d-cbfc-4931-85f1-cbfdcb36cdd3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:54.969476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:54.970255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:54.970537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:54.970846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:54.971484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:54.973506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:54.985369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:54.990646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:54.990646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:54.990646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.002190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:55.020803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.022876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:55.069957 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2157/4327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:36:55.122839 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2171/4328] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:36:55.131440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:55.151750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0509-062d-44f5-bb8c-28ec7baa351a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:55.309703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:55.309703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:55.309703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:55.309703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.309983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.309983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:55.463719 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2158/4329] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:36:55 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:55.467311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:55.498129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5c63-b348-4aed-ba8f-dc7059f64ac5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:55.526555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:55.526555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:55.526555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:55.526555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.529728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.531416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:55.570204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:55.570759 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2172/4330] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:55.593133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e6863-f3bb-4e31-b541-ac5716ad0fe6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:55.611564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:55.612245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:55.612691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:55.613139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] PATH_INFO: `/v3/projects/ab78d79c812541c09b4b688923251581/users/2b501a0dfe3540f397a757a829f6f28b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.652412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab78d79c812541c09b4b688923251581, user_id=2b501a0dfe3540f397a757a829f6f28b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.656715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:55.797395 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2159/4331] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:55 2022] PUT /identity/v3/projects/ab78d79c812541c09b4b688923251581/users/2b501a0dfe3540f397a757a829f6f28b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:55.801481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:55.814830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec3e2c-c102-4634-b211-4063b4d09be4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:55.903666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:55.904520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:55.905044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:55.905707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.906543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.910455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de072d-6ed0-484d-bc1f-aa52ae620546 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:55.928552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:55.941858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2173/4332] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:36:55.955683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddbd6-997e-400f-97a4-b792a4c85696 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:55.973790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:55.978070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:55.978360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:55.978726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] PATH_INFO: `/v3/projects/ab78d79c812541c09b4b688923251581/users/2b501a0dfe3540f397a757a829f6f28b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:55.985524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab78d79c812541c09b4b688923251581, user_id=2b501a0dfe3540f397a757a829f6f28b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:55.995366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:56.039875 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2160/4333] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:36:55 2022] PUT /identity/v3/projects/ab78d79c812541c09b4b688923251581/users/2b501a0dfe3540f397a757a829f6f28b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:56.052532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:56.052972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:56.056719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:56.120323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] MFA Rules not processed for user `2b501a0dfe3540f397a757a829f6f28b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:56.123404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:56.370842 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2174/4334] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:56.376411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:56.385662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:56.397824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d7d1-8914-4698-aa1f-b644f92acea4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:56.430041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:56.435054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:56.435391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:56.435674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:56.441910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:56.452975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:56.613203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2161/4335] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:36:56 2022] POST /identity/v3/projects => generated 359 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:36:56.618563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:56.632079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d69f-6efb-4217-b6e6-a4af3a19f426 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:56.774096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:56.775260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:56.775396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:56.775605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-2145372140` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:56.781023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=f709af02b7da48f7a2fd6808e64a15bc, value=tempest-tag-2145372140)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:56.784141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:56.800493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:56.955272 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2145372140. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:36:56.955272 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:36:56.955272 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:36:56.964276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2175/4336] 10.222.0.13 () {60 vars in 1333 bytes} [Mon Oct 31 14:36:56 2022] PUT /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-2145372140 => generated 0 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 31 14:36:56.967659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:56.982217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a55c2-ab45-4ba6-8aae-2cde764e3668 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:56.988586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:56.989670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:56.990089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:56.990467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-2145372140` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.011145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f709af02b7da48f7a2fd6808e64a15bc, value=tempest-tag-2145372140)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.015624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:57.033864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2162/4337] 10.222.0.13 () {58 vars in 1314 bytes} [Mon Oct 31 14:36:56 2022] GET /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-2145372140 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:36:57.037033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:57.054411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529ab5-e6ad-4b01-a5ca-02c0bbca106d tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:57.071705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:57.072474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:57.078666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:57.078666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.079966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=f709af02b7da48f7a2fd6808e64a15bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.085197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:57.323103 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2176/4338] 10.222.0.13 () {60 vars in 1265 bytes} [Mon Oct 31 14:36:57 2022] PUT /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags => generated 140 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:57.326994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:57.344150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9cd01-73ae-4780-8f29-5750023caa86 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:57.354606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:57.354606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:57.354606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:57.354913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.382586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f709af02b7da48f7a2fd6808e64a15bc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.384951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:57.413830 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2163/4339] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Oct 31 14:36:57 2022] GET /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags => generated 140 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:36:57.419246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:57.438384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf494d-7519-44a9-8cb3-e2a4a4b68658 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:57.459558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:57.464096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:57.464647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:57.466666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-1277496515` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.468036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=f709af02b7da48f7a2fd6808e64a15bc, value=tempest-tag-1277496515)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.478272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:57.878832 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1277496515. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:36:57.878832 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:36:57.878832 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:36:57.879772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2177/4340] 10.222.0.13 () {58 vars in 1317 bytes} [Mon Oct 31 14:36:57 2022] DELETE /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-1277496515 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:57.883749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:57.900691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573e87-f483-4ff4-adab-5e55f7cdb4c8 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:57.907908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:57.911873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:57.911873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:57.911873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-1277496515` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.930881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f709af02b7da48f7a2fd6808e64a15bc, value=tempest-tag-1277496515)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.930881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Could not find project tag: tempest-tag-1277496515.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1277496515. Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 31 14:36:57.954115 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1277496515. Oct 31 14:36:57.955239 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:36:57.958457 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2164/4341] 10.222.0.13 () {58 vars in 1314 bytes} [Mon Oct 31 14:36:57 2022] GET /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags/tempest-tag-1277496515 => generated 107 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:36:57.963974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:57.976082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6cf5b-907f-4f8a-835a-0f76433c5669 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:57.982270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:57.982708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:57.983493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:57.983999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:57.985399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=f709af02b7da48f7a2fd6808e64a15bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:57.987978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:58.136963 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2178/4342] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 14:36:57 2022] DELETE /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:58.138193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:58.168408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dbd12-df50-46a6-89ee-8cedbcaece19 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:58.191991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:58.192648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:58.192925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:58.193197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:58.222536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f709af02b7da48f7a2fd6808e64a15bc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:58.226880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:58.250527 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2165/4343] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Oct 31 14:36:58 2022] GET /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc/tags => generated 66 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 14:36:58.254044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:58.272614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2e25-c57b-4e90-8ca5-3dfaa49aab65 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:58.282319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b501a0dfe3540f397a757a829f6f28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab78d79c812541c09b4b688923251581', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:58.283032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:58.283545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:58.283896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] PATH_INFO: `/v3/projects/f709af02b7da48f7a2fd6808e64a15bc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:58.285314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f709af02b7da48f7a2fd6808e64a15bc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:58.305864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:58.449076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f709af02b7da48f7a2fd6808e64a15bc', 'request_id': 'req-25e2c333-f8ac-4f59-9814-147c993c42eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:58.577408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f709af02b7da48f7a2fd6808e64a15bc', 'request_id': 'req-25e2c333-f8ac-4f59-9814-147c993c42eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:58.586648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f709af02b7da48f7a2fd6808e64a15bc', 'request_id': 'req-25e2c333-f8ac-4f59-9814-147c993c42eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:58.611888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:58.618151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] The token cache is being invalidate because project f709af02b7da48f7a2fd6808e64a15bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:36:58.618446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:58.621223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25e2c333-f8ac-4f59-9814-147c993c42eb tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:58.625294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2179/4344] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:36:58 2022] DELETE /identity/v3/projects/f709af02b7da48f7a2fd6808e64a15bc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:58.630654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:58.637475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:58.791352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ca5-c115-461f-9901-e308d5d85620 tempest-IdentityV3ProjectTagsTest-555997462 tempest-IdentityV3ProjectTagsTest-555997462-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:58.865899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:58.866575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:58.866867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:58.867143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] PATH_INFO: `/v3/users/b40e85d56dda4cf88b1eaff1f44433cd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:58.869322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40e85d56dda4cf88b1eaff1f44433cd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:58.871526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:58.877327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:36:59.190011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40e85d56dda4cf88b1eaff1f44433cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:59.191088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40e85d56dda4cf88b1eaff1f44433cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:59.302900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40e85d56dda4cf88b1eaff1f44433cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:59.333948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40e85d56dda4cf88b1eaff1f44433cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:59.334209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40e85d56dda4cf88b1eaff1f44433cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:36:59.372136 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2166/4345] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:36:58 2022] DELETE /identity/v3/users/b40e85d56dda4cf88b1eaff1f44433cd => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:36:59.376726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd7eb-22df-4aa4-b316-33e9022ef83b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:59.377229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd7eb-22df-4aa4-b316-33e9022ef83b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:59.377506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd7eb-22df-4aa4-b316-33e9022ef83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:59.427336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa0fd7eb-22df-4aa4-b316-33e9022ef83b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:36:59.431255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa0fd7eb-22df-4aa4-b316-33e9022ef83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:59.607859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2180/4346] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:36:59.637691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:36:59.639892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:36:59.824616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c0a0-3c46-4ce7-84fa-5e2ace2ea9ab admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:36:59.834263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:36:59.835097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:36:59.835665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:36:59.835665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:36:59.862145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:36:59.864929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:36:59.890952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2167/4347] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:01.086213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:01.087327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:01.087550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:01.157613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] MFA Rules not processed for user `f6e5ac25311c4a979f5fdd0d3f02c3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:01.170646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:01.326439 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2181/4348] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:01.699967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:01.702009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:01.747793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3bcb4-2813-451f-8f9c-f736fff0a5da service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:01.766282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:01.768534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:01.768534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:01.768534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] PATH_INFO: `/v3/projects/ab3ba041194a46969f227fd1caa473e3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:01.791701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3ba041194a46969f227fd1caa473e3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:01.795096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:01.948722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3ba041194a46969f227fd1caa473e3', 'request_id': 'req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.034255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3ba041194a46969f227fd1caa473e3', 'request_id': 'req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.042550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3ba041194a46969f227fd1caa473e3', 'request_id': 'req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.066778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] The token cache is being invalidate because project ab3ba041194a46969f227fd1caa473e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:02.067204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.069567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.073234 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2168/4349] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:01 2022] DELETE /identity/v3/projects/ab3ba041194a46969f227fd1caa473e3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:02.077218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:02.094902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1bea-a6f7-4aea-a18f-746af00b78b7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:02.180755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:02.181652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:02.182139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:02.183464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] PATH_INFO: `/v3/users/2b501a0dfe3540f397a757a829f6f28b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:02.185118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b501a0dfe3540f397a757a829f6f28b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:02.187276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:02.429201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:02.459393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b501a0dfe3540f397a757a829f6f28b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.460079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b501a0dfe3540f397a757a829f6f28b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.646487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b501a0dfe3540f397a757a829f6f28b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.671521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b501a0dfe3540f397a757a829f6f28b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.672608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699d47d-4dc9-456b-b97f-3347b647c35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b501a0dfe3540f397a757a829f6f28b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:02.700470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2182/4350] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:02 2022] DELETE /identity/v3/users/2b501a0dfe3540f397a757a829f6f28b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:03.434821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:03.436808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:03.460950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3bd1-3b8d-4e9a-8b21-cd125b2ad649 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:03.472489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:03.612297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:03.613192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:03.613627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:03.614238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] PATH_INFO: `/v3/users/752860792f754829a94314d555321ac1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:03.621229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] RBAC: Authorizing `identity:delete_user(user_id=752860792f754829a94314d555321ac1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:03.623936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:03.858949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752860792f754829a94314d555321ac1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:03.859796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752860792f754829a94314d555321ac1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:03.953499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752860792f754829a94314d555321ac1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:03.969566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752860792f754829a94314d555321ac1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:03.970607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752860792f754829a94314d555321ac1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:03.988087 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2169/4351] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:03 2022] DELETE /identity/v3/users/752860792f754829a94314d555321ac1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:03.990008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:03.996879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:03.996879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.014557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:04.027262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.076062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:04.077612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.221050 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2183/4352] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:04.221290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75b69-2c54-4baf-976a-ee8cbb79376b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:04.236929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:04.236929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:04.236929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:04.236929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] PATH_INFO: `/v3/projects/ab78d79c812541c09b4b688923251581` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.237782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab78d79c812541c09b4b688923251581)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:04.239864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:04.272097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:04.273765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.374010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:04.410742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab78d79c812541c09b4b688923251581', 'request_id': 'req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:04.441170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a5e9f-bb74-4d14-9760-f294977eaf1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:04.556932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab78d79c812541c09b4b688923251581', 'request_id': 'req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:04.567364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab78d79c812541c09b4b688923251581', 'request_id': 'req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:04.595182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:04.595499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] The token cache is being invalidate because project ab78d79c812541c09b4b688923251581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:04.596282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:04.597554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:04.598150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-31e6e9c3-ce8d-456f-bd38-f8f2f271d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:04.598708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:04.599527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.608828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2170/4353] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:04 2022] DELETE /identity/v3/projects/ab78d79c812541c09b4b688923251581 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:04.612563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.619198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:04.619198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:04.619198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.671922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:04.678838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:04.682438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.785575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:04.788022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfcf5b-f4df-4ea1-a3eb-798c192673e6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:04.804729 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2184/4354] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:04.832575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2171/4355] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:04.841115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:04.841593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:04.842075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.872165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:04.874927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:04.886363 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2185/4356] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:04.891069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:04.912946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0790fa-c9ac-475d-aab9-a8efacee9a24 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:04.929768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:04.930657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:04.931097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:04.931627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:04.932446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:04.932886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:04.934771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:04.965167 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2172/4357] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:04.969889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:04.983699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4906b-4f5c-47a4-896d-1f394499d953 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.000966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.002166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.002550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.003178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.004011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.006064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.057106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.059538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.087597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a97513-9260-4953-8b67-da03ed0d3a60 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.096390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.103257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.103257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.103257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.103257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.131784 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2186/4358] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:04 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:05.135358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.249689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.252596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.277373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2173/4359] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:37:05.284109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff57b9-88aa-4e50-ac02-b5943f345173 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.290329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.291013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.291401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.291751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.292459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.294603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.348001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.352796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.378493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47feb76-8d71-48bb-9351-0755089268bc service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.387730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.388617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.389078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.389531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] PATH_INFO: `/v3/users/bd851df5114d4ca1a3aa2233cde813a9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.391140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd851df5114d4ca1a3aa2233cde813a9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.394421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.415303 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2187/4360] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:05 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:05.416315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.432666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f765-728a-4bc7-b82f-e6fe8e79b395 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.442265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.443038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.444141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.445468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.446457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.448682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.464892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2188/4361] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:05.475213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.487815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef3be1-3631-4918-b93f-48c2eceeacb8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.493522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.494133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.494914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.494914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.495605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.497190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.512447 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2189/4362] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:05.513351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.523685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b3939-f312-4d0c-9bcd-30970b6a343a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.529225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.529886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.530161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.530431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] PATH_INFO: `/v3/projects/3602353c3ff44b029685b0091fdd780b/users/0b68ac2e2e3b4cfa9111c5af3d5565fe/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.548239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3602353c3ff44b029685b0091fdd780b, user_id=0b68ac2e2e3b4cfa9111c5af3d5565fe, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.551257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.563369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd851df5114d4ca1a3aa2233cde813a9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:05.564097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd851df5114d4ca1a3aa2233cde813a9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:05.685251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd851df5114d4ca1a3aa2233cde813a9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:05.693263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2190/4363] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:05 2022] PUT /identity/v3/projects/3602353c3ff44b029685b0091fdd780b/users/0b68ac2e2e3b4cfa9111c5af3d5565fe/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:05.693263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.693705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.701204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd851df5114d4ca1a3aa2233cde813a9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:05.702369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-41696416-6c55-40ff-8992-bf4a2a7632d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd851df5114d4ca1a3aa2233cde813a9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:05.717354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2174/4364] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:05 2022] DELETE /identity/v3/users/bd851df5114d4ca1a3aa2233cde813a9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:05.720020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0104-0beb-4212-957a-c805a03753be None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.720956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0104-0beb-4212-957a-c805a03753be None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.721169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce0104-0beb-4212-957a-c805a03753be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.759078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-16ce0104-0beb-4212-957a-c805a03753be None None] MFA Rules not processed for user `0b68ac2e2e3b4cfa9111c5af3d5565fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:05.760597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-16ce0104-0beb-4212-957a-c805a03753be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.831695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedfa8-cd95-40e6-a95c-15f2257904dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.895392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2175/4365] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:05.896869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce0104-0beb-4212-957a-c805a03753be None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:05.899044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-16ce0104-0beb-4212-957a-c805a03753be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:05.923404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.924370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.924650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.925020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] PATH_INFO: `/v3/projects/1865b04058b844e9a2c131dc1703ddb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.926834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1865b04058b844e9a2c131dc1703ddb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.929124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:05.991624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce0104-0beb-4212-957a-c805a03753be None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:05.996257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:05.996890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:05.997139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:05.997409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:05.998028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:05.999958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.040003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1865b04058b844e9a2c131dc1703ddb3', 'request_id': 'req-d11b4433-e3b6-4fac-a777-9f7501c8feec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.103896 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2176/4366] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:05 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:06.107828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.108476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.121071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1865b04058b844e9a2c131dc1703ddb3', 'request_id': 'req-d11b4433-e3b6-4fac-a777-9f7501c8feec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.127450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1865b04058b844e9a2c131dc1703ddb3', 'request_id': 'req-d11b4433-e3b6-4fac-a777-9f7501c8feec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.142013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] The token cache is being invalidate because project 1865b04058b844e9a2c131dc1703ddb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:06.142246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.142927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.149024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2191/4367] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:05 2022] DELETE /identity/v3/projects/1865b04058b844e9a2c131dc1703ddb3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:06.149024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.149024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.186372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704f2d7-2deb-49d2-8a34-e27cf84b900e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.194205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.195009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.195195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.195463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] PATH_INFO: `/v3/projects/c69b0c9162c040f7a413446fe6dacb53` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.197167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69b0c9162c040f7a413446fe6dacb53)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.199160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.225529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4433-e3b6-4fac-a777-9f7501c8feec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.230347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.230993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.231271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.231547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.232202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.234114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1d0f8-1ad2-4081-b8cf-596065cbf664 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.337011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69b0c9162c040f7a413446fe6dacb53', 'request_id': 'req-7656b786-707c-4213-a845-af02767965a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.364254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:06.370522 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2192/4368] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:06.379435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.379435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.379435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.392319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:06.393490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.439166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69b0c9162c040f7a413446fe6dacb53', 'request_id': 'req-7656b786-707c-4213-a845-af02767965a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.445297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69b0c9162c040f7a413446fe6dacb53', 'request_id': 'req-7656b786-707c-4213-a845-af02767965a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.454021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2193/4369] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:06.454021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.457090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] The token cache is being invalidate because project c69b0c9162c040f7a413446fe6dacb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:06.457381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.458038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7656b786-707c-4213-a845-af02767965a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:06.459769 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2177/4370] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:06 2022] DELETE /identity/v3/projects/c69b0c9162c040f7a413446fe6dacb53 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:06.460953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.461212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.461483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.462546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3fcc-da87-4749-b35f-e1e716771d50 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.467278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.467918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.468219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.468492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.469123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.470768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e9b9-35ef-405d-9750-04ea166fd9ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.483040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:06.483974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.485781 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2194/4371] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:06.487070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.488428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.488428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.494116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2178/4372] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:06.495006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.496423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.508400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f7682-7a79-4ead-bdcb-6f0e2a609c8c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.513193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.513851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.514663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.514663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] PATH_INFO: `/v3/projects/265b2488fa1f4ad8bc333872a4165c75/users/1ac94ff7a59a40e6bdb5246be63b37dd/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.519288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:06.520491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.528978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2195/4373] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:06.529787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.539021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265b2488fa1f4ad8bc333872a4165c75, user_id=1ac94ff7a59a40e6bdb5246be63b37dd, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.542244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614917-3417-40bf-91ce-b0105ba02ad1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.545831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.547145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.547753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.548033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.548726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.549453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:06.549756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.551361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0df8-51d5-4a63-8515-a31a6ca0e8a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.567020 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2196/4374] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:06.567020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:06.567281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.567555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.567890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.587328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:06.591810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.596838 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2197/4375] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:06.597646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.607784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7ab0d-58fd-43b1-96f3-a7947b35c12c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.612575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.614584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.614584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.614584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.614584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.616276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.639562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2179/4376] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:06 2022] PUT /identity/v3/projects/265b2488fa1f4ad8bc333872a4165c75/users/1ac94ff7a59a40e6bdb5246be63b37dd/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:06.640525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.642174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.700977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d329f-8f5b-4075-b266-c94479da95e6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.704613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.705219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.705501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.705771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.707548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:06.754880 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2198/4377] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:06.755812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.780119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.781817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.794889 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2180/4378] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:06.795951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.825189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72decb6a-c08c-49c2-89a1-81cbe94c6c05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.834963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.835706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.836337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.836337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.837543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:06.837844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.840190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.853496 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2199/4379] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:06.858071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.866842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9da9-50f2-41a5-8f2e-0560d6fee562 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.871661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.872065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b642b-4eb0-4968-87b7-84aaf50ba413 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.872735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.873045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.873317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.874014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.874815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:06.875677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.879400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.889299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.889299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.889299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.889299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.889299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.890088 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2181/4380] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:06.890088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:06.897079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64cc9c-c2eb-4d81-afbd-c4e7d9c4a88d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:06.903589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:06.904416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:06.907639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:06.907639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:06.907639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:06.907639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:06.908135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:06.988545 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2200/4381] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:06.989357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.000701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05181d-77bc-44c0-8754-ffd39848fcad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.005588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.006259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.006543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.006853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] PATH_INFO: `/v3/projects/265b2488fa1f4ad8bc333872a4165c75/users/1ac94ff7a59a40e6bdb5246be63b37dd/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.008800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265b2488fa1f4ad8bc333872a4165c75, user_id=1ac94ff7a59a40e6bdb5246be63b37dd, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.011646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.019475 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2182/4382] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:06 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:07.019475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.028446 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2201/4383] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:06 2022] PUT /identity/v3/projects/265b2488fa1f4ad8bc333872a4165c75/users/1ac94ff7a59a40e6bdb5246be63b37dd/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:07.029319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.107489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0d749-85f8-486e-b3f5-5d6d2c7e9670 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.113987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.114742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.115029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.115359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.115998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.117593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea8070-4c72-496d-b61f-1f1f0a18752c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.118189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.123937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.125049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.125544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.126111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.127004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.129745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bab05-5044-4ce6-821b-de18b9af0992 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.144020 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2183/4384] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:07.145633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.146177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.146719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.179793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] MFA Rules not processed for user `1ac94ff7a59a40e6bdb5246be63b37dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:07.181456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:07.243256 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2202/4385] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/users => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:07.243873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.267419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d7e8-086f-4745-b4ad-bb359cd3dbea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.277731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.278642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.279085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.280277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.281125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.282922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.296691 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2203/4386] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:07.297586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.315084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc041d3f-2524-4c26-bbb1-f36d8cb11be8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.319184 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2184/4387] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:07.319930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.335189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c6a7-0007-43ea-a2ac-d22b838c3e3f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.353121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.354208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.354208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.354444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] PATH_INFO: `/v3/projects/0686b9d1c6f94a5ab67bcc393dc76e6e/users/3e83a4d329c341e1bd07ba0a1beb1f2b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.355658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.355935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.356197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.356830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.358184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.385975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0686b9d1c6f94a5ab67bcc393dc76e6e, user_id=3e83a4d329c341e1bd07ba0a1beb1f2b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.388723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.391377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.400269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:07.419652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2204/4388] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:07.421847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.435844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288867-b1fe-4578-a087-68dfb262cf4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.441370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.442015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.442306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.442574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.443280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.445276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc53b47-7777-4660-a208-ee69cdf2e93c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.457261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:07.487738 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2185/4389] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:07 2022] PUT /identity/v3/projects/0686b9d1c6f94a5ab67bcc393dc76e6e/users/3e83a4d329c341e1bd07ba0a1beb1f2b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:07.488958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.511156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2205/4390] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/roles => generated 235 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:07.516018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.516018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.516018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.550755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] MFA Rules not processed for user `3e83a4d329c341e1bd07ba0a1beb1f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:07.552032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:07.575708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0931d-be4b-4c7d-a334-22bf997c2bbf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.581924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.582650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.582994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.583337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.584046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.585915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.597682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2186/4391] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:07 2022] GET /identity/v3/roles => generated 1646 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:07.598599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.632884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2206/4392] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:07.632884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.647842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b75a0b-47f7-4460-9435-c8d716c54eac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.657939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.658639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.658918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.659195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] PATH_INFO: `/v3/projects/65a96c3b987247fc8dac51bd32803a38/users/afbabe63e86343428ec089655b235cf7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.679502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a96c3b987247fc8dac51bd32803a38, user_id=afbabe63e86343428ec089655b235cf7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.683224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.683366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869afd-646e-419f-a44c-8336999dbf00 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.688495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.689271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.689617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.689958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.690724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.691809 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:07.691809 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:07.691809 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:07.692866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b689e-c215-4e75-aa1c-9ac71b8bc909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.757599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2207/4393] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:07 2022] PUT /identity/v3/projects/65a96c3b987247fc8dac51bd32803a38/users/afbabe63e86343428ec089655b235cf7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:07.761280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.761392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2187/4394] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/roles => generated 235 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:07.762954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.763323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.763601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.785509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:07.786776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:07.807042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:07.852241 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2188/4395] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:07.853246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.854493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e7032-aab3-4f58-9629-cdb2b0641ded admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.867498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.868997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.869279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.869550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.870177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.872103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.885331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:07.932378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc0d26-e504-40b4-96fe-089588d7e293 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:07.939598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:07.940289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:07.940640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:07.941131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:07.942014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:07.946405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:07.979010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2208/4396] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/projects => generated 371 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:07.980176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:07.981910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:08.019020 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2189/4397] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:07 2022] POST /identity/v3/roles => generated 235 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:08.020059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.031630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0ff1-7b34-4c98-baeb-4b76f8f4a542 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.049561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaa8f7-7e2e-47d6-9a39-1774aa1abc20 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.053592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.054195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.054470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.054799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.095052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.095657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.095931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.096195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.096826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.098858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.120989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.122557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.131946 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2209/4398] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:08.132699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.174292 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2190/4399] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:08.175407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.177073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:08.186872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a147b3-8bf6-4e21-8080-14092de580f7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.191553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.192147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.196566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:08.196702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.196702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.196702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.196702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.198516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd7d8b-fb3b-49e8-a165-22cc9d725e34 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.203798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.204397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.204682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.204940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.205603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.207960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2191/4400] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:08 2022] GET /identity/v3/roles => generated 2098 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:08.208760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.212782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.222846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb1d2-7685-4d7b-9ca9-2da78d79d844 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.227646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.228307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.228582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.228853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] PATH_INFO: `/v3/projects/613ad8e2345847038025b0bafc2f2e07/users/bc11d4276bcf4974b41e9b6caf3e38f7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.245680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=613ad8e2345847038025b0bafc2f2e07, user_id=bc11d4276bcf4974b41e9b6caf3e38f7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.248484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.279123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2210/4401] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/domains => generated 277 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:08.279946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.327563 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2192/4402] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:08 2022] PUT /identity/v3/projects/613ad8e2345847038025b0bafc2f2e07/users/bc11d4276bcf4974b41e9b6caf3e38f7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:08.331620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.366899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43bd7-390f-4702-b8fa-b3a613b22a54 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.431016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b3425-6dac-4b9a-9c62-a526d175b74b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.431016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.431016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.431016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.431471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.431471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.431471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.433416 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2193/4403] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:08 2022] GET /identity/v3/roles => generated 2098 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:08.437851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.440604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.441412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.441850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.442302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.443239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.452169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67b7e-6f9d-4367-990a-659577e6a75c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.454804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.458918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.459624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.460153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.460432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] PATH_INFO: `/v3/projects/613ad8e2345847038025b0bafc2f2e07/users/bc11d4276bcf4974b41e9b6caf3e38f7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.462912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] RBAC: Authorizing `identity:create_grant(project_id=613ad8e2345847038025b0bafc2f2e07, user_id=bc11d4276bcf4974b41e9b6caf3e38f7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.465635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e3bd0-80a4-467f-af31-fddcfeb8341e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.483674 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2194/4404] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:08 2022] PUT /identity/v3/projects/613ad8e2345847038025b0bafc2f2e07/users/bc11d4276bcf4974b41e9b6caf3e38f7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:08.497227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.497788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.498557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.539518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] MFA Rules not processed for user `bc11d4276bcf4974b41e9b6caf3e38f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:08.539518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:08.625785 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2195/4405] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:08.630386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.641644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3798ec-acaf-4278-90d0-a25fb6be1500 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.647389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.648078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.648461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.648802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.650069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.651133 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:08.651133 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:08.651133 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:08.652076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.676027 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2211/4406] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/projects => generated 398 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:08.680316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.760329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624091-8342-440e-a8ea-36ca1d9aad72 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.765660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2196/4407] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/services => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:08.770248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.780742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.781666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.782149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.782509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.783244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.786565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.810146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5a43-6efd-47c7-84c7-a518d16def89 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.825661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:08.860711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2212/4408] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/groups => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:08.865176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.882678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853e68-fd51-421e-ba50-fd1bd02c2054 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:08.888769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.889437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.889726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.890004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.890902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.891452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:08.892274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:08.892574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.892972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:08.893436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:08.894165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:08.895599 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:08.895599 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:08.895599 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:08.897325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:08.904975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:08.979713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2197/4409] 10.222.0.13 () {60 vars in 1213 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:08.984380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:08.996048 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2213/4410] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/roles => generated 235 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:09.000964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.007099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd753-fc2e-4544-8637-559be28f6d04 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.021037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.021934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.027303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.027303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.027303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.027613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66052b1-c347-4cce-bb14-b9f2c30047c6 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.027739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.030083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.031218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.031653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.032074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.033575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.035549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.162654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2214/4411] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/users => generated 439 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:09.163311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2198/4412] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:08 2022] POST /identity/v3/services => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:09.163409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.166415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.179528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c75e-039c-44d7-8bda-aefecde7db4f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.195769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695038e-81b5-4fd5-9232-a5f63040a2e4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.202020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.202668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.202959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.203234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.204783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.205551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.206067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.206436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.207457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.209232 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.209232 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:09.209232 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:09.210498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.215714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.219850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:09.223209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.283497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2215/4413] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:09 2022] POST /identity/v3/roles => generated 270 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:09.290097 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2199/4414] 10.222.0.13 () {60 vars in 1213 bytes} [Mon Oct 31 14:37:09 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:09.291179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.291284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.310046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2d39-30d0-4ba3-a76a-77bb02e46112 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.318894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2796-f135-4aff-b266-453e720ee76f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.323359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.324124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.324411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.324688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.325378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.326071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.326333 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.326333 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:09.326333 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:09.327207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.327359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.327671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.328096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/a73e5753f9b24fe4b4fba3443b3b7f59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.340314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2200/4415] 10.222.0.13 () {58 vars in 1191 bytes} [Mon Oct 31 14:37:09 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:09.345372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.354967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=a73e5753f9b24fe4b4fba3443b3b7f59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.359115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa923-2ba9-4872-b9c9-eb15a265ed74 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.360867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.366142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.366899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.367245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.367874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.368537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9278566c266c4af2a97c2db4533f58e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.369557 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.369557 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:09.369557 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:09.370713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.389793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2201/4416] 10.222.0.13 () {58 vars in 1290 bytes} [Mon Oct 31 14:37:09 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1 => generated 333 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:09.389793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.402118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c396-59e1-47c8-ab57-156ac6ed607e tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.408310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.409133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.409541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.409900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.418558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9278566c266c4af2a97c2db4533f58e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.418558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.418558 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2202/4417] 10.222.0.13 () {58 vars in 1291 bytes} [Mon Oct 31 14:37:09 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 14:37:09.421788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.432762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e2d7a-25ef-4367-a8f0-d40050e66e72 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.440692 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2216/4418] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:09 2022] PUT /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/a73e5753f9b24fe4b4fba3443b3b7f59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:09.445171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.514741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.515485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.515764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.516039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.516629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9278566c266c4af2a97c2db4533f58e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.517649 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.517649 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:09.517649 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:09.518530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.533558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d677f-d880-4f1b-a8a5-b691ad9be585 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.538372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.538995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.539273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.539541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.540974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Adding query filter params (scope.project.id=a2c8115e442f4ebcb51d60121be06486, user.id=2eb58b044b5e43038137d6d193f93d42) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:09.541391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.547105 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.547105 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:09.547105 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:09.548858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.606404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2203/4419] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 14:37:09 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:09.612851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.625742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e060e3-0e67-4fc3-ac89-be2afcaef7e6 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.628817 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2217/4420] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:37:09 2022] GET /identity/v3/role_assignments?scope.project.id=a2c8115e442f4ebcb51d60121be06486&user.id=2eb58b044b5e43038137d6d193f93d42&effective => generated 228 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:09.633669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.636355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.637120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.637503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.638576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.639616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.641516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.653481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2204/4421] 10.222.0.13 () {58 vars in 1191 bytes} [Mon Oct 31 14:37:09 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:09.653694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfafd54-840c-4209-a650-0ba44a057700 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.655396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.661313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.662659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.662787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.663572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/a73e5753f9b24fe4b4fba3443b3b7f59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.668890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=a73e5753f9b24fe4b4fba3443b3b7f59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.669341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835fa6-0829-43cd-948d-276ff39802c4 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.670095 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.670095 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:09.670095 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:09.672262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.676747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.677487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.678017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.678370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.679220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9278566c266c4af2a97c2db4533f58e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.680992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.681526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role a73e5753f9b24fe4b4fba3443b3b7f59 was removed from user 2eb58b044b5e43038137d6d193f93d42 on project a2c8115e442f4ebcb51d60121be06486. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:09.682039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:09.684072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Could not find Endpoint Group: 9278566c266c4af2a97c2db4533f58e1.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9278566c266c4af2a97c2db4533f58e1. Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 31 14:37:09.700582 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9278566c266c4af2a97c2db4533f58e1. Oct 31 14:37:09.701556 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:09.706550 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2205/4422] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 14:37:09 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9278566c266c4af2a97c2db4533f58e1 => generated 120 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:09.707886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.716979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:09.733164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c696cd-c9f3-44fe-97e4-672483e34eec tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.739656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.740662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.741038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.741397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services/0c6d1fc61bc54234a254d1ebd96154ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.742817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0c6d1fc61bc54234a254d1ebd96154ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.743997 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.743997 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:09.743997 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:09.745038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.761860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2218/4423] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:37:09 2022] DELETE /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/a73e5753f9b24fe4b4fba3443b3b7f59 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:09.766275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.769558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:09.804119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:09.861609 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2206/4424] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:09 2022] DELETE /identity/v3/services/0c6d1fc61bc54234a254d1ebd96154ce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:09.870252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:09.872110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077766-1d28-43f4-bf16-5ba0ef616e29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.904219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:09.905317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991f16-b983-4709-8a3c-116386b25527 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:09.909877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:09.910452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:09.912752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/a73e5753f9b24fe4b4fba3443b3b7f59` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:09.914317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a73e5753f9b24fe4b4fba3443b3b7f59)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:09.917759 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:09.917759 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:09.917759 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:09.919297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:09.981260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:10.014211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.014953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.015356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.015943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.016690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.018519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.074738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role a73e5753f9b24fe4b4fba3443b3b7f59 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:10.074963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:10.075596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:10.080716 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2219/4425] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:09 2022] DELETE /identity/v3/roles/a73e5753f9b24fe4b4fba3443b3b7f59 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:10.086053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.087574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:10.132233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2207/4426] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:09 2022] POST /identity/v3/services => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:10.136901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.138718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:10.191261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13391a9-0670-4729-8ba1-62ad9e947551 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.193022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5873-fe36-4bd8-8817-05dc5d11ab58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.213884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.214775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.215283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.215701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/fe48edb872bc4c3884fdcb45d03536df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.218290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=fe48edb872bc4c3884fdcb45d03536df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.223361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.288251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2220/4427] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:10 2022] PUT /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/fe48edb872bc4c3884fdcb45d03536df => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:10.290989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.291818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.292731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.293133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.293534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.297461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.301336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.375899 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2208/4428] 10.222.0.13 () {60 vars in 1213 bytes} [Mon Oct 31 14:37:10 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:10.377498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.389518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb393-c17b-41b8-8ff5-fc2d082618b5 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.412030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8c450-52b6-4a36-811b-dfd58549ea84 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.419661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.428410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.428745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.429022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.431648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.432996 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:10.432996 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:10.432996 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:10.434077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.518818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.519575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.520149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.520284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.520955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.522949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.563964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2221/4429] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:10 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 521 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:10.568160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.644445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb016-01da-42ae-ab10-e9379b193e58 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.655623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2209/4430] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:10 2022] POST /identity/v3/services => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:10.656838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.699550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211874e-326b-45c2-951d-727ae094e147 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.711032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.712588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.712873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.713149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.713938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Adding query filter params (scope.project.id=a2c8115e442f4ebcb51d60121be06486, user.id=2eb58b044b5e43038137d6d193f93d42) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:10.714302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.717448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.800407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.801631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.802129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.802550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/39df102e0e61416380976d0be83e72f2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.803726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=39df102e0e61416380976d0be83e72f2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.807781 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:10.807781 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:10.807781 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:10.809267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.818062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2222/4431] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:37:10 2022] GET /identity/v3/role_assignments?scope.project.id=a2c8115e442f4ebcb51d60121be06486&user.id=2eb58b044b5e43038137d6d193f93d42&effective => generated 1061 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:10.822436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.847885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870e2e-85e6-4238-9c8d-1601edeafdb2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.853719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.854674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.855029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.855428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.857324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.860036 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:10.860036 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:10.860036 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:10.861238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:10.924198 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2210/4432] 10.222.0.13 () {60 vars in 1313 bytes} [Mon Oct 31 14:37:10 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/39df102e0e61416380976d0be83e72f2 => generated 335 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:10.925946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.953155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b2a53-b85b-420d-9abe-0e1fd044f064 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:10.971469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:10.972128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:10.972536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:10.972811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services/2378b0e439ea4e1fae5759b8fc81e0a8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:10.973405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2378b0e439ea4e1fae5759b8fc81e0a8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:10.978259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2223/4433] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:10 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:10.982569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:10.985088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.037144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:11.097649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768cb6-1c9d-49c9-808c-317f95835833 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.108746 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2211/4434] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:10 2022] DELETE /identity/v3/services/2378b0e439ea4e1fae5759b8fc81e0a8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:11.112958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.113323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.116535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.116854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.117127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.117945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Adding query filter params (scope.project.id=a2c8115e442f4ebcb51d60121be06486, user.id=2eb58b044b5e43038137d6d193f93d42) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:11.118256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.123257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.128709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:11.172649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41c58-5e3e-49dc-9025-44214578d163 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.207026 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2224/4435] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:37:10 2022] GET /identity/v3/role_assignments?scope.project.id=a2c8115e442f4ebcb51d60121be06486&user.id=2eb58b044b5e43038137d6d193f93d42&effective => generated 577 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:11.210913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.222282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704c5c2-948c-4a5a-8889-cd28d44e2918 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.241638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.245717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.248397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.248790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.250872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.252860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9.: keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = query.one() Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:11.276291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:11.283283 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:11.284407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2225/4436] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 137 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:11.288308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.304384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4872729-901c-4339-872b-711e41054a56 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.310183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.311476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.311476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.311476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/39df102e0e61416380976d0be83e72f2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.315518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=39df102e0e61416380976d0be83e72f2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.315800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.316669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.317942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.318443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.318846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/fe48edb872bc4c3884fdcb45d03536df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.321963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=fe48edb872bc4c3884fdcb45d03536df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.325585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.332946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role fe48edb872bc4c3884fdcb45d03536df was removed from user 2eb58b044b5e43038137d6d193f93d42 on project a2c8115e442f4ebcb51d60121be06486. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:11.333357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:11.334268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:11.388994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2212/4437] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/39df102e0e61416380976d0be83e72f2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:11.393101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.400254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:11.414699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f9511-02e0-4587-ba0f-8f00c781b672 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.422492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.424352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.424352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.424352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services/f61172c3df7f4ca0971ae20e1208a13b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.426135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f61172c3df7f4ca0971ae20e1208a13b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.428283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.476660 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2226/4438] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/fe48edb872bc4c3884fdcb45d03536df => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:11.482185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.484265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:11.522969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2213/4439] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/services/f61172c3df7f4ca0971ae20e1208a13b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:11.528280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.574565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306dfba-f6e9-47e9-908b-a50bbadb3e88 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.655531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453582a2-980b-45ca-9378-dc9ee08c72f2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.693069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.693069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.693069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.693402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/41a1f1df02704ad3aee7d22b8dd70aa6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.693402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=41a1f1df02704ad3aee7d22b8dd70aa6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.695248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.704477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.705749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.706171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.706598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.707476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.709478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.803036 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2214/4440] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/41a1f1df02704ad3aee7d22b8dd70aa6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:11.804596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.816268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0f8d7-4a26-4da4-8424-1dd53f657477 tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.822514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc11d4276bcf4974b41e9b6caf3e38f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '613ad8e2345847038025b0bafc2f2e07', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.826018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.826523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.830732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] PATH_INFO: `/v3/services/713c8c9f64744b51a2702b0884c36a1d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.831653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorizing `identity:delete_service(service_id=713c8c9f64744b51a2702b0884c36a1d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.833772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.843297 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2227/4441] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:11 2022] POST /identity/v3/roles => generated 272 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:11.849552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.872662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77d969-191a-4efa-bd6b-74bb3e260145 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.880349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.881047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.881994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.882380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.884631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Adding query filter params (domain_id=343b017b928340cf9dbc677c60fe26a6) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:11.885056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.890180 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:11.890180 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:11.890180 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:11.892254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:11.911385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2228/4442] 10.222.0.13 () {58 vars in 1207 bytes} [Mon Oct 31 14:37:11 2022] GET /identity/v3/roles?domain_id=343b017b928340cf9dbc677c60fe26a6 => generated 409 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:11.912546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.924901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57006a5-2437-4387-a96c-103e5f09ce52 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:11.928560 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2215/4443] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/services/713c8c9f64744b51a2702b0884c36a1d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:11.932704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:11.937362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:11.952256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:11.953095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:11.954378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:11.954819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/d159287fb905481ba3f7447fb308ab24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:11.956159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d159287fb905481ba3f7447fb308ab24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:11.957924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.083564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1cbf-b55c-4bb0-b3dd-8117ee0ae5de tempest-EndPointGroupsTest-359803444 tempest-EndPointGroupsTest-359803444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.093004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.093004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.093004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.093004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] PATH_INFO: `/v3/users/3e83a4d329c341e1bd07ba0a1beb1f2b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.093443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e83a4d329c341e1bd07ba0a1beb1f2b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.094589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.115391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role d159287fb905481ba3f7447fb308ab24 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:12.115711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.117262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.120002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2229/4444] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/roles/d159287fb905481ba3f7447fb308ab24 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:12.124890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.127362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.218641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870bcb-3ab8-4a96-b5ac-b387690a6824 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.223922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.224543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.224825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.225112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.225993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Adding query filter params (domain_id=343b017b928340cf9dbc677c60fe26a6) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:12.226310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.228058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.235313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2230/4445] 10.222.0.13 () {58 vars in 1207 bytes} [Mon Oct 31 14:37:12 2022] GET /identity/v3/roles?domain_id=343b017b928340cf9dbc677c60fe26a6 => generated 148 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:12.239651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.258969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15d65-a492-4f34-a3b1-8846ddb611f0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.273504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.274229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.274510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.274807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/d159287fb905481ba3f7447fb308ab24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.290202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Could not find role: d159287fb905481ba3f7447fb308ab24.: keystone.exception.RoleNotFound: Could not find role: d159287fb905481ba3f7447fb308ab24. Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 31 14:37:12.297770 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:37:12.299054 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d159287fb905481ba3f7447fb308ab24. Oct 31 14:37:12.300426 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:12.303469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2231/4446] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:12 2022] DELETE /identity/v3/roles/d159287fb905481ba3f7447fb308ab24 => generated 110 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:37:12.309020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.320840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6a017-de5a-4bc3-8f1e-37a6bc2174d9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.338698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.339839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.340134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.340413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.350251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.353998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.362954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e83a4d329c341e1bd07ba0a1beb1f2b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.363919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e83a4d329c341e1bd07ba0a1beb1f2b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.457741 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2232/4447] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:12 2022] PUT /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:12.458821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.460606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.496578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e83a4d329c341e1bd07ba0a1beb1f2b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.499652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:12.517184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e83a4d329c341e1bd07ba0a1beb1f2b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.518457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5de58e0e-42e1-47c3-ac59-b1c52fff501f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e83a4d329c341e1bd07ba0a1beb1f2b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.537660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2216/4448] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:11 2022] DELETE /identity/v3/users/3e83a4d329c341e1bd07ba0a1beb1f2b => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:12.544848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.545165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.545456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.592173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:12.593520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.600522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f139-05cf-4712-87f5-1a3de2d739d0 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.691245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.692017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2217/4449] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:12.695509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.695933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.696280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.698186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=343b017b928340cf9dbc677c60fe26a6, group_id=eebe4f6b2a784978b097c3a17254421f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.702706 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:12.702706 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:12.702706 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:12.702706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.704315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.712747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.735761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2233/4450] 10.222.0.13 () {58 vars in 1365 bytes} [Mon Oct 31 14:37:12 2022] GET /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles => generated 410 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:12.739475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.755229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944bb2f-dc77-43c8-a7c0-d1d0a51d219f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.760257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:12.766014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.767144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.767646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.767945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.770302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.771364 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:12.771364 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:12.771364 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:12.773381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.779984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2234/4451] 10.222.0.13 () {58 vars in 1465 bytes} [Mon Oct 31 14:37:12 2022] HEAD /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:12.784167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.799030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2559f-9718-4d01-98fb-b5faafbf3f0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.804185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.804924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.806044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.806044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.810219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.811682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.820989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role de1ac7f8d0d24077b80de46561ba1f57 was removed from group eebe4f6b2a784978b097c3a17254421f on domain 343b017b928340cf9dbc677c60fe26a6. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:12.821478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.822487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:12.825115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714e5b9-90bc-4899-9d46-2a9fff1a7687 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:12.829455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:12.830139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:12.830483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:12.830856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:12.832929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.852866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:12.854427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:12.864748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2218/4452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:12.891278 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2235/4453] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:37:12 2022] DELETE /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:12.897150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:12.900526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:12.915200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6c8a-2102-4239-8c34-6ec217c75785 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:13.006609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:13.008370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.008850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.009231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.014752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2c8115e442f4ebcb51d60121be06486, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:13.029254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:13.142364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.189259 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2219/4454] 10.222.0.13 () {60 vars in 1486 bytes} [Mon Oct 31 14:37:12 2022] PUT /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:13.189594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e07b1-5a86-49ad-9f5f-47d96d54c712 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:13.249266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:13.250266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.251263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.251651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.254933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a2c8115e442f4ebcb51d60121be06486, group_id=eebe4f6b2a784978b097c3a17254421f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:13.260418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051e688-bb83-4282-b265-6a2ed8085ff1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:13.283177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.286865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2236/4455] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:37:13 2022] GET /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles => generated 411 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:13.298894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92864fb-8168-466e-8a12-8e5c65cbe58f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:13.305211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:13.306023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.306404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.306836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/groups/eebe4f6b2a784978b097c3a17254421f/users/2eb58b044b5e43038137d6d193f93d42` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.308799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eebe4f6b2a784978b097c3a17254421f, user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:13.311308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:13.410746 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2220/4456] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:37:13 2022] PUT /identity/v3/groups/eebe4f6b2a784978b097c3a17254421f/users/2eb58b044b5e43038137d6d193f93d42 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:13.413879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.414205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.414945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.474859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] MFA Rules not processed for user `2eb58b044b5e43038137d6d193f93d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:13.476924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:13.620872 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2237/4457] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:13 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:13.624855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.745299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd1110-b189-486b-99c9-ea90dafb2708 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:13.763149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:13.763906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.764186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.764522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.769351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a2c8115e442f4ebcb51d60121be06486, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:13.770632 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:13.770632 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:13.770632 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:13.776812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:13.794024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2221/4458] 10.222.0.13 () {58 vars in 1468 bytes} [Mon Oct 31 14:37:13 2022] HEAD /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:13.798319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.818801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd976-e714-493e-bc21-a46c7e7cc750 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:13.830368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:13.831223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:13.831578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:13.831902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:13.834252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a2c8115e442f4ebcb51d60121be06486, group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:13.837731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:13.844590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role de1ac7f8d0d24077b80de46561ba1f57 was removed from group eebe4f6b2a784978b097c3a17254421f on project a2c8115e442f4ebcb51d60121be06486. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:13.845010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:13.845824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:13.942042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2238/4459] 10.222.0.13 () {58 vars in 1470 bytes} [Mon Oct 31 14:37:13 2022] DELETE /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:13.947092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.949572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:13.971518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:13.974802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:13.975503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596417-ec3c-4d36-856b-0576d76b566b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.103645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.104431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.105783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.105783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/groups/eebe4f6b2a784978b097c3a17254421f/users/2eb58b044b5e43038137d6d193f93d42` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.107446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=eebe4f6b2a784978b097c3a17254421f, user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.109834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.114954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f847-cbdf-42bb-aca3-59d002ffd99a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.121799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.122156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.123094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.123094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] PATH_INFO: `/v3/projects/0686b9d1c6f94a5ab67bcc393dc76e6e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.124201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0686b9d1c6f94a5ab67bcc393dc76e6e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.126184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.233351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.297810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0686b9d1c6f94a5ab67bcc393dc76e6e', 'request_id': 'req-40b01aaf-ce3d-4d4a-841f-196005e0daec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.367136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:14.378781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2222/4460] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:37:13 2022] DELETE /identity/v3/groups/eebe4f6b2a784978b097c3a17254421f/users/2eb58b044b5e43038137d6d193f93d42 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:14.380512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.442771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cea01e-3506-447f-8811-51ca183dbb3a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.448496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.449156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.449461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.451573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.451573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.452583 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:14.452583 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:14.452583 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:14.453476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.491147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0686b9d1c6f94a5ab67bcc393dc76e6e', 'request_id': 'req-40b01aaf-ce3d-4d4a-841f-196005e0daec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.498437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0686b9d1c6f94a5ab67bcc393dc76e6e', 'request_id': 'req-40b01aaf-ce3d-4d4a-841f-196005e0daec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.511308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] The token cache is being invalidate because project 0686b9d1c6f94a5ab67bcc393dc76e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:14.511636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.512727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:14.514452 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2239/4461] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:13 2022] DELETE /identity/v3/projects/0686b9d1c6f94a5ab67bcc393dc76e6e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:14.518872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.520300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:14.537019 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2223/4462] 10.222.0.13 () {60 vars in 1381 bytes} [Mon Oct 31 14:37:14 2022] PUT /identity/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:14.546234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.548021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:14.570586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f223d-432a-4501-a312-cf1b6486d9cb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.583986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.584519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.584803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.585084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.592155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=eebe4f6b2a784978b097c3a17254421f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.593295 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:14.593295 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:14.593295 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:14.594255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.624268 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2224/4463] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 14:37:14 2022] GET /identity/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles => generated 376 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:14.630037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.630524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:14.639341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b01aaf-ce3d-4d4a-841f-196005e0daec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.661793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8158-f807-4264-9f6a-7d8bc4d0ea7d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.692487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.703372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.704854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.706056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.734105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.734317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.734950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.735225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.735501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] PATH_INFO: `/v3/users/bc11d4276bcf4974b41e9b6caf3e38f7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.735890 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:14.735890 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:14.735890 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:14.737541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc11d4276bcf4974b41e9b6caf3e38f7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.738677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.739503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.768852 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2225/4464] 10.222.0.13 () {58 vars in 1363 bytes} [Mon Oct 31 14:37:14 2022] HEAD /identity/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:14.776735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.799392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c44d2a-0d44-49a7-9ab2-40f35b1b34bb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.808817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.810181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.810750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.811159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.813612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=eebe4f6b2a784978b097c3a17254421f, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.816383 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:14.816383 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:14.816383 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:14.819260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:14.935640 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2226/4465] 10.222.0.13 () {58 vars in 1365 bytes} [Mon Oct 31 14:37:14 2022] DELETE /identity/v3/system/groups/eebe4f6b2a784978b097c3a17254421f/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:14.941083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:14.948195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa426-4973-49ca-a80e-30ada80cf4b9 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:14.953187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:14.953922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:14.954291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:14.954697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:14.956973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:14.959857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.048379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc11d4276bcf4974b41e9b6caf3e38f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.049776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc11d4276bcf4974b41e9b6caf3e38f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.094183 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2227/4466] 10.222.0.13 () {60 vars in 1480 bytes} [Mon Oct 31 14:37:14 2022] PUT /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:15.100645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.102916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:15.137065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc11d4276bcf4974b41e9b6caf3e38f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.154649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc11d4276bcf4974b41e9b6caf3e38f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.155466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc11d4276bcf4974b41e9b6caf3e38f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.181265 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2240/4467] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:14 2022] DELETE /identity/v3/users/bc11d4276bcf4974b41e9b6caf3e38f7 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:15.257212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53626d4-d093-4c99-88d2-f44839c790b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.334960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.335825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.335949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:15.336177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:15.338739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=343b017b928340cf9dbc677c60fe26a6, user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:15.339848 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:15.339848 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:15.339848 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:15.341712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.358718 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2228/4468] 10.222.0.13 () {58 vars in 1362 bytes} [Mon Oct 31 14:37:15 2022] GET /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles => generated 409 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:15.363095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.375826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff3ab-a559-4f47-8764-f5b00af7e67c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.382729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.387203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.387203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:15.387203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:15.387203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:15.390293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.408417 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2241/4469] 10.222.0.13 () {58 vars in 1462 bytes} [Mon Oct 31 14:37:15 2022] HEAD /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:15.410045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.434872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa7d7-d62f-440d-9ff9-c0b597aaf3f4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.451565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.452255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.452541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:15.452817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:15.459062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=343b017b928340cf9dbc677c60fe26a6, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:15.460032 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:15.460032 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:15.460032 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:15.463056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.481332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role de1ac7f8d0d24077b80de46561ba1f57 was removed from user 2eb58b044b5e43038137d6d193f93d42 on domain 343b017b928340cf9dbc677c60fe26a6. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:15.481535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.484156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:15.557228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2229/4470] 10.222.0.13 () {58 vars in 1464 bytes} [Mon Oct 31 14:37:15 2022] DELETE /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:15.564161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.566569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:15.581199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc53751-eae6-4c95-af5b-73c4389de4e7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.665854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.666885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.667212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:15.667731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:15.670412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:15.674677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.745742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.745742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:15.779689 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2242/4471] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:15 2022] PUT /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:15.780876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:15.880837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38e9c-ba88-44fc-98b3-8811cbdbb909 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.958906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76135b5e-9f70-4def-b733-a8845298b93f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:15.964641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:15.974989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.976099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.976616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:15.977016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:15.979757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:15.987567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:15.997943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:15.998935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:15.999377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.000009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] PATH_INFO: `/v3/projects/613ad8e2345847038025b0bafc2f2e07` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.003488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613ad8e2345847038025b0bafc2f2e07)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.005109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2243/4472] 10.222.0.13 () {58 vars in 1365 bytes} [Mon Oct 31 14:37:15 2022] GET /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles => generated 410 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:16.007542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.014065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.029969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a133f2-dca7-4785-a7f6-726edc4820ee tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.036559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.042033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.042033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.042033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.042033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.045444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.067256 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2244/4473] 10.222.0.13 () {58 vars in 1465 bytes} [Mon Oct 31 14:37:16 2022] HEAD /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:16.072258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.084518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae261b-8d7f-4ad8-be99-a45a97abeb0b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.093195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.094044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.094429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.095034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.097450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a2c8115e442f4ebcb51d60121be06486, user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.101996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.107833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role de1ac7f8d0d24077b80de46561ba1f57 was removed from user 2eb58b044b5e43038137d6d193f93d42 on project a2c8115e442f4ebcb51d60121be06486. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:16.108449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.111246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.177018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:16.258027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613ad8e2345847038025b0bafc2f2e07', 'request_id': 'req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.264394 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2245/4474] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:37:16 2022] DELETE /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:16.265764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.269260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.332468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613ad8e2345847038025b0bafc2f2e07', 'request_id': 'req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.341980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613ad8e2345847038025b0bafc2f2e07', 'request_id': 'req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.360542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] The token cache is being invalidate because project 613ad8e2345847038025b0bafc2f2e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:16.361064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.361832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cd864f82-0f3c-4e0a-97ac-81d034ff95e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:16.368729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2230/4475] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:15 2022] DELETE /identity/v3/projects/613ad8e2345847038025b0bafc2f2e07 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:16.370499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b410-3c39-4401-9f1d-676c2b451770 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.370905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b410-3c39-4401-9f1d-676c2b451770 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.371280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b410-3c39-4401-9f1d-676c2b451770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.379765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319de11-f256-49ec-84c4-e3a5a092f36d tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.398462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8995b410-3c39-4401-9f1d-676c2b451770 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:16.400163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8995b410-3c39-4401-9f1d-676c2b451770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.463496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.464174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.464443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.464706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.466645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.468174 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:16.468174 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:16.468174 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:16.470111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.493003 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2231/4476] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:16.494739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.494871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.495465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.527621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:16.529459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.540185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2232/4477] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:16.544507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.556168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae5a7-d48f-48f2-8560-71dab975953d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.559885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2246/4478] 10.222.0.13 () {60 vars in 1378 bytes} [Mon Oct 31 14:37:16 2022] PUT /identity/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:16.564395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.566534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.571447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.571447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.571741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.571825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.571825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:16.571825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.571825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.583548 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2233/4479] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:16.588103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.595859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa4d8-a7a1-4bd8-9b0a-147ace25baa3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.601624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.602316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.603810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.603810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.605414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.606288 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:16.606288 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:16.606288 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:16.608404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.612373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ea57c-1006-459d-974b-73e22071a84b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.624069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.625800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.625800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.625800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.626910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.629430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2247/4480] 10.222.0.13 () {58 vars in 1260 bytes} [Mon Oct 31 14:37:16 2022] GET /identity/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles => generated 375 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:16.629959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.630344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.657320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a98a29-837b-4d3f-846b-9dd0251b8a77 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.664649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.665544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.665814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.666205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.668096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.669333 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:16.669333 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:16.669333 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:16.670658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.682095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2248/4481] 10.222.0.13 () {58 vars in 1360 bytes} [Mon Oct 31 14:37:16 2022] HEAD /identity/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:16.686182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.697289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1844d7-51e4-45ab-a5f4-7959e44c0829 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.703391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.707072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.707357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.708082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.709877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=2eb58b044b5e43038137d6d193f93d42, role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.711660 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:16.711660 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:16.711660 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:16.712785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934bdb3-668e-4591-91c7-10755b53c159 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.756955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2234/4482] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:16.760562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.811919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2249/4483] 10.222.0.13 () {58 vars in 1362 bytes} [Mon Oct 31 14:37:16 2022] DELETE /identity/v3/system/users/2eb58b044b5e43038137d6d193f93d42/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:16.811919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.811919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.811919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.852002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] MFA Rules not processed for user `afbabe63e86343428ec089655b235cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:16.854178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.856281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf519dd-d820-4d7c-8eaa-8e36f528ca53 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.861824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.862801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.863138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.863694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:16.864435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:16.866816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:16.896706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:16.927603 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2250/4484] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:16.928485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.960635 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2235/4485] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:16.965354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:16.967087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:16.993439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bfda8-100a-4167-bd2c-0274e6d84c0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:16.998545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:16.999195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:16.999778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:16.999778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.000535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.002169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.054820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cacc1-819b-45c3-ba95-629471a5b25d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.060898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.061533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.061812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.062086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.070400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.072620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.081788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2236/4486] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:16 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:17.082585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.092629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b85e15-26fa-47e5-a934-dce61f64f29c service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.100006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.100006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.100006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.100006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.100420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.101154 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2251/4487] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:16 2022] POST /identity/v3/roles => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:17.101767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.103254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.115877 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2237/4488] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:17 2022] GET /identity/v3/roles => generated 2324 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:17.120501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.123898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63654-3a26-44af-a2f3-4111aedfdd2b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.130431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.131333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.131563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb00d-4ce8-48ca-8a6f-c00ad3e8b87d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.131775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.132303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.133200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.136146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.136976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.137584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.137860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.138131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.138824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.140850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.157991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2238/4489] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:17 2022] GET /identity/v3/roles => generated 2324 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:17.158948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.173621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edeae-3f3a-4426-a565-698e117ece65 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.176854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.182567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.182567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.182567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] PATH_INFO: `/v3/projects/4049ed468d224779a78a034b837a6130/users/d9f469d7f0214941b363a87d3a481507/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.201069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4049ed468d224779a78a034b837a6130, user_id=d9f469d7f0214941b363a87d3a481507, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.206404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c53a3a-5027-4d5e-a6dc-d8d5f24564ab admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.211198 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2252/4490] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:17 2022] POST /identity/v3/roles => generated 268 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:17.212429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.229542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069a85-1775-4f93-9d45-d0cfdfb5aef4 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.234820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.235924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.236552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.237044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/c78f14182cc242769abf2867fe805e01` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.239324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=c78f14182cc242769abf2867fe805e01)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.241444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.277919 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2239/4491] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:17 2022] PUT /identity/v3/projects/4049ed468d224779a78a034b837a6130/users/d9f469d7f0214941b363a87d3a481507/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:17.289105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.289105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.300553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.320506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:17.364106 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2253/4492] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:17 2022] PUT /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/c78f14182cc242769abf2867fe805e01 => generated 528 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:17.365980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.400594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] MFA Rules not processed for user `d9f469d7f0214941b363a87d3a481507`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:17.409289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:17.547975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d162956-ff5c-40e0-8b45-497734f38955 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.553665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.554766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.555582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.555858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.556525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.558121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.611899 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2240/4493] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:17.616355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.656524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2254/4494] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:37:17 2022] POST /identity/v3/domains => generated 277 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:17.660459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.697649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:17.745937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:17.754420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa52b-e38f-4299-abb7-114deffddc49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.797869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d95386-e0a8-4b1b-84b5-ea5b0aa8b57b tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.806996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.807621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.807899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.808168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.808959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.810809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.880921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.881608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.881890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.882222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.883998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.888017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:17.916497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2255/4495] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:17 2022] POST /identity/v3/roles => generated 270 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:17.928422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:17.948167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7aa62-cc53-47ef-976b-6a7db7397b29 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:17.950508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:17.959138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:17.959981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:17.960274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:17.960556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/36a3694e238043db9845149f5f52d1dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:17.964539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=36a3694e238043db9845149f5f52d1dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:17.966229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.019591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2241/4496] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:17 2022] POST /identity/v3/projects => generated 369 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:18.023850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.130845 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2256/4497] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:17 2022] PUT /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/36a3694e238043db9845149f5f52d1dc => generated 530 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:18.132713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.231509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4debe1c-6c75-4848-ab13-58fe2f7bd8e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.252474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:18.303684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9b961-38a5-49fb-8b91-412231b9d592 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.325721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.326991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.329807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.330428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.338833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.340974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.366782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.368268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.368661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.369164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.370385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.377580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.531978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2257/4498] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:18 2022] PUT /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 525 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:18.538279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.552168 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2242/4499] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:18 2022] POST /identity/v3/users => generated 291 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:18.563987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.583364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba94d-d0b5-4c82-b38e-dcac4d8df711 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.691885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:18.735166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.735804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.736084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.736355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.737012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.738855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.739848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ff0de-bfa7-46bc-90d7-3ef0b37d40b2 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.745596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.749124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.749124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.749124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/de1ac7f8d0d24077b80de46561ba1f57/implies/fde302acbe5c428688c1ed0a976267b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.749124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=de1ac7f8d0d24077b80de46561ba1f57, implied_role_id=fde302acbe5c428688c1ed0a976267b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.750386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.760017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2243/4500] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:18 2022] GET /identity/v3/roles => generated 2324 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:18.763571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] fde302acbe5c428688c1ed0a976267b7 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: fde302acbe5c428688c1ed0a976267b7 cannot be an implied roles. Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 31 14:37:18.773487 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: fde302acbe5c428688c1ed0a976267b7 cannot be an implied roles. Oct 31 14:37:18.775414 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:18.777101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2258/4501] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:18 2022] PUT /identity/v3/roles/de1ac7f8d0d24077b80de46561ba1f57/implies/fde302acbe5c428688c1ed0a976267b7 => generated 116 bytes in 240 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:37:18.781776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81ed59-18fa-4fa1-8d5f-a53f76ca8f7b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.781947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.793288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.794209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.794589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.796872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d7b7-49b3-4c5a-9f0c-a680c5b25041 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.797799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] PATH_INFO: `/v3/projects/52f9e428d1384d8f94bf0310d1c8f606/users/3dd265b97162463883327498987fa0e6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.807988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:18.809201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:18.809633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:18.810065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:18.812039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.815009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.819044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f9e428d1384d8f94bf0310d1c8f606, user_id=3dd265b97162463883327498987fa0e6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:18.825175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:18.900871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2259/4502] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:18 2022] DELETE /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:18.902577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.921020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:18.926926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2244/4503] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:18 2022] PUT /identity/v3/projects/52f9e428d1384d8f94bf0310d1c8f606/users/3dd265b97162463883327498987fa0e6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:18.931524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:18.988069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf480f4-7d6a-4ee7-9a28-52e3a1f19184 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:18.988516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:19.055713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2144ee-b892-44a1-b551-acf3d04235bb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.065278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.068101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.068710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.070973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.075231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.079176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.103978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:19.110032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.113723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.113723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.113723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/36a3694e238043db9845149f5f52d1dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.114137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2245/4504] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:18 2022] GET /identity/v3/roles => generated 2324 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:19.114239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=36a3694e238043db9845149f5f52d1dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.115035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.119014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.152697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47472-e213-48fd-8666-74c7405e1eff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.160391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.171791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.172244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.172801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] PATH_INFO: `/v3/projects/52f9e428d1384d8f94bf0310d1c8f606/users/3dd265b97162463883327498987fa0e6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.175913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f9e428d1384d8f94bf0310d1c8f606, user_id=3dd265b97162463883327498987fa0e6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.178906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d9c2-70f3-4b7c-b149-c8751cae1bba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.192936 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2246/4505] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:19 2022] PUT /identity/v3/projects/52f9e428d1384d8f94bf0310d1c8f606/users/3dd265b97162463883327498987fa0e6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:19.206343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.206812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.207149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.246959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:19.248964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2260/4506] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:18 2022] DELETE /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/36a3694e238043db9845149f5f52d1dc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:19.252908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.275904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] MFA Rules not processed for user `3dd265b97162463883327498987fa0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:19.278689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:19.297910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:19.384178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10b263-6583-4982-aafd-ad25f11a3939 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.391462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.392158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.392438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.400833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/36a3694e238043db9845149f5f52d1dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.400833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=36a3694e238043db9845149f5f52d1dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.400833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.409461 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2247/4507] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:19.416523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.433803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14e13c-53f1-4acf-93eb-d35ed99a09b0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.451149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.459837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.459837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.459837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.459837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.459837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.582384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role 36a3694e238043db9845149f5f52d1dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:19.582698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.583890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.597979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2261/4508] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:19 2022] DELETE /identity/v3/roles/36a3694e238043db9845149f5f52d1dc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:19.599120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.605977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:19.615445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2248/4509] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:19 2022] POST /identity/v3/services => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:19.616471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.622181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:19.642232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:19.668896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba9f-e4fd-4813-b4c0-12c401f66fc9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.765810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b882cb4-cae7-4699-bc12-d61c945a0422 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:19.790163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.791150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.791551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.791899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/874504daea0d4a968ffe928d44aec52c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.801892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:19.802693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:19.803091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:19.803600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:19.805169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.806938 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:19.806938 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:19.806938 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:19.808566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.808836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=874504daea0d4a968ffe928d44aec52c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:19.810706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:19.840757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.842678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.903266 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-264043131. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:19.903266 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:19.903266 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:19.948443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.949277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:19.953314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2262/4510] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:37:19 2022] PATCH /identity/v3/domains/874504daea0d4a968ffe928d44aec52c => generated 278 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:19.958837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:19.960645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:20.069509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2249/4511] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:37:19 2022] POST /identity/v3/endpoints => generated 359 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:20.075274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.077100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:20.106579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9ab8-6697-462b-9a55-728f8bb5a092 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.137645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62713b10-ccc4-4bdf-a2a0-6b81d66b4b24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.144072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.144719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.145041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.145345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/874504daea0d4a968ffe928d44aec52c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.197337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=874504daea0d4a968ffe928d44aec52c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.200217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.230233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.234041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '874504daea0d4a968ffe928d44aec52c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.237544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:20.273528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.274228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.274510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.274817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-264043131` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.275414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-264043131)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.276503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.278039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:20.284880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2250/4512] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 14:37:20 2022] GET /identity/v3/regions/tempest-region-264043131 => generated 178 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:20.285838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.310335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485271-291c-449a-a6f4-2d08a5416620 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.321804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.322444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.323802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.324097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.324775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.328234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.406207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.421719 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2251/4513] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:20 2022] POST /identity/v3/services => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:20.422872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.451225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08000341-6538-4a67-8c57-07bd65ae033f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.531950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.532582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.533768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.533768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.533768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.535455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.549110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.559126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.575944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] The token cache is being invalidate because project 874504daea0d4a968ffe928d44aec52c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:20.576310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.577069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.589557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.590477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.591167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c93022-40e5-41cd-a666-7c5ea5725ee7 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '874504daea0d4a968ffe928d44aec52c', 'request_id': 'req-63c93022-40e5-41cd-a666-7c5ea5725ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:20.607902 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2263/4514] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:37:19 2022] DELETE /identity/v3/domains/874504daea0d4a968ffe928d44aec52c => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:20.609439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.609727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.610080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.633589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] MFA Rules not processed for user `c1f6dc86d8094a53ac0e58c3a59e7e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:20.634906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:20.663052 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-629502791. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:20.663052 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:20.663052 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:20.736361 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2264/4515] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:20 2022] POST /identity/v3/auth/tokens => generated 3703 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:20.742125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.743787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:20.833407 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2252/4516] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:37:20 2022] POST /identity/v3/endpoints => generated 360 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:20.839533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.845050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:20.856982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d9be3-a2bd-40e2-9d17-1d8eb0e0fbfa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.884092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.885746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.886510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.887119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/c78f14182cc242769abf2867fe805e01` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.891249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fde302acbe5c428688c1ed0a976267b7, implied_role_id=c78f14182cc242769abf2867fe805e01)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.894153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.900951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06157-ccd5-4b95-9210-1192f9978508 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.913700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.914605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.915068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.915450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-629502791` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.918172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-629502791)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.918573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.920786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2253/4517] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 14:37:20 2022] GET /identity/v3/regions/tempest-region-629502791 => generated 178 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:20.925801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.941198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bdac-57d0-4e80-a331-31dfeed7c8fd tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:20.949043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:20.949701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:20.949984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:20.950291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:20.951057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:20.952676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:20.961081 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2265/4518] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:20 2022] DELETE /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7/implies/c78f14182cc242769abf2867fe805e01 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:20.965679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:20.970436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:21.038877 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1138795955. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:21.038877 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:21.038877 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:21.096888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c43e8-d477-46a1-860c-e514736b0d15 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.131969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.132610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.132890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.134993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/c78f14182cc242769abf2867fe805e01` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.136237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c78f14182cc242769abf2867fe805e01)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.137859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.154926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2254/4519] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:37:20 2022] POST /identity/v3/endpoints => generated 360 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:21.158779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.199297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea052-7105-41e7-95db-a894d023e159 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.258606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:21.280504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role c78f14182cc242769abf2867fe805e01 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:21.281376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:21.282077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:21.288520 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2266/4520] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:20 2022] DELETE /identity/v3/roles/c78f14182cc242769abf2867fe805e01 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:21.290137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.294172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:21.320359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.321146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.321496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.321835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-1138795955` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.322494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1138795955)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.324253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.330670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2255/4521] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:37:21 2022] GET /identity/v3/regions/tempest-region-1138795955 => generated 180 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:21.333982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.335933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:21.353048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11ddb-b3c2-4e2c-9c9c-dd75996ce114 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.416669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2cf8-16d8-45d6-be3f-7f11315be351 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.456226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.456789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.457071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.457344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fde302acbe5c428688c1ed0a976267b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.461686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=fde302acbe5c428688c1ed0a976267b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.465758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.502828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.504459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.505577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.505952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.506965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.521970 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:21.521970 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:21.521970 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:21.521970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.526786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2256/4522] 10.222.0.13 () {58 vars in 1134 bytes} [Mon Oct 31 14:37:21 2022] GET /identity/v3/endpoints => generated 4393 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:21.528146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.538520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30616d23-06e7-48a7-b014-c6739a2f4f5d tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.544852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.545636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.546101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.546983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.554829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=e0df47d3a7f44e06a011ee4e9e983894)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.556530 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:21.556530 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:21.556530 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:21.557672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.559999 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2257/4523] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:21 2022] GET /identity/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894 => generated 360 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:21.583789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.598478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de09c-d082-4ac3-ad3f-edd182ee0942 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.630391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.635117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.635624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.636056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.639362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e0df47d3a7f44e06a011ee4e9e983894)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.648745 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:21.648745 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:21.648745 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:21.650447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.676624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role fde302acbe5c428688c1ed0a976267b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:21.677500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:21.678855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:21.690429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2267/4524] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:21 2022] DELETE /identity/v3/roles/fde302acbe5c428688c1ed0a976267b7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:21.692839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.694439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:21.736861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:21.747634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e0df47d3a7f44e06a011ee4e9e983894', 'request_id': 'req-df279fb4-14fe-401f-a5b5-d0a47686ff0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:21.774334 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2258/4525] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:21 2022] DELETE /identity/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:21.776063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:21.784222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:21.839888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279fb4-14fe-401f-a5b5-d0a47686ff0a tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.862697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58734d-6328-48c0-bb99-569e8d3aafb1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:21.886494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.887797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.888087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.888366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.890221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.892512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.974360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:21.974537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:21.975500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:21.975798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:21.976603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:21.978990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:21.999510 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2268/4526] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:21 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 521 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:22.002011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.008430 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2259/4527] 10.222.0.13 () {58 vars in 1134 bytes} [Mon Oct 31 14:37:21 2022] GET /identity/v3/endpoints => generated 4046 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:22.012224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.025335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348c8d3-86ef-4844-83e9-4dcb36f001ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.073641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:22.085618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af695-1de0-4987-8f90-11657b89b9cf tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.091904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.092646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.093305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.093305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.095419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.096558 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:22.096558 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:22.096558 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:22.097532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.098518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.099456 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:22.099456 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:22.099456 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:22.100354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.107548 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2269/4528] 10.222.0.13 () {58 vars in 1345 bytes} [Mon Oct 31 14:37:22 2022] HEAD /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:22.111633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.118233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.119089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.120553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.127253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.127509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872cb6b-9b9b-4cb0-8cf9-96c1097adce3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.146124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:37:22.146230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.146230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.146230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.146600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.146600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.146600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Could not find endpoint: e0df47d3a7f44e06a011ee4e9e983894.: keystone.exception.EndpointNotFound: Could not find endpoint: e0df47d3a7f44e06a011ee4e9e983894. Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.148500 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: e0df47d3a7f44e06a011ee4e9e983894. Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:22.150471 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:37:22.155300 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: e0df47d3a7f44e06a011ee4e9e983894. Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:22.158171 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2260/4529] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:22 2022] DELETE /identity/v3/endpoints/e0df47d3a7f44e06a011ee4e9e983894 => generated 114 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:22.163052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.166113 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2270/4530] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 521 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:22.166113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.180195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe14f1-7e4e-41f0-accd-9b810f05fece tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.180424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71a6f8-3e12-45a7-a5e2-1371a89377d7 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.190011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.191160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.191748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.192349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-1138795955` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.193223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1138795955)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.194904 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:22.194904 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:22.194904 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:22.197527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.199762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.201595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.206987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.206987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.208613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.217339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.312709 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2271/4531] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:22 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:22.319768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.369793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2261/4532] 10.222.0.13 () {58 vars in 1209 bytes} [Mon Oct 31 14:37:22 2022] DELETE /identity/v3/regions/tempest-region-1138795955 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:22.377094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.433165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02633ee-19f5-4eb6-8562-8c442eba8d24 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.548233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.549259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.549606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.549949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.550639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815021b4-cfab-4d40-8c7a-5957b898c74e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.550916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.552832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.565922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2262/4533] 10.222.0.13 () {58 vars in 1134 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/endpoints => generated 4046 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:22.568620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.584084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:22.585543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663535c4-08a5-4571-8891-514ed16bf9b5 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.588643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.589597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.590036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.591403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.593176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.594075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.594449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.594890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.595748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Adding query filter params (service_id=b5be05d9f816427598df093d23f412e1) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:22.602842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.602842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.604467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.606331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.608578 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2263/4534] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/endpoints?service_id=b5be05d9f816427598df093d23f412e1 => generated 501 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:22.613018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9.: keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = query.one() Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.617679 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 14:37:22.618823 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 14:37:22.619765 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 14:37:22.619765 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:22.619765 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.619765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2272/4535] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 137 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:37:22.623176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.634976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974df9d-9ca4-42a3-8d4d-8a02ecd23ec8 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.639630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee54b-1ea9-4a35-aa47-269c7bf91262 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.644069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.644774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.644931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.645300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.645635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.645775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.646213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.646495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Adding query filter params (service_id=58c0b3afb01d4725aca9db19324304ac) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:22.646686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.646982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.648484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.650932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.663408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9.: keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = query.one() Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._iter().one() Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._only_one_row( Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:22.663963 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 31 14:37:22.665152 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 31 14:37:22.666413 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 31 14:37:22.666413 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 31 14:37:22.666413 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 31 14:37:22.666413 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fe48edb872bc4c3884fdcb45d03536df does not imply 188a492630e74b2dbc07e2bc2a3d5ed9. Oct 31 14:37:22.666413 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:22.671450 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2273/4536] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:22 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 137 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:22.672862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.687916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa20469-a4fa-4f29-a0fe-460452efeaf5 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.692059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.692881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.693512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.693951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.699264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2264/4537] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/endpoints?service_id=58c0b3afb01d4725aca9db19324304ac => generated 502 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:22.699430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.699548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.699700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:22.700084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.787922 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2274/4538] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:22 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 521 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:22.787922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.840158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0538-54f3-4388-82fb-7c192f373989 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.898781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:22.907524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d62a4-03c5-4c04-85bc-8309f20f7961 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:22.920585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:22.921304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:22.921601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:22.921878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:22.922556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:22.922895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:22.924193 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:22.924193 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:22.924193 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:22.925097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:22.939999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2275/4539] 10.222.0.13 () {58 vars in 1167 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:22.940974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:22.999119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.000075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.000075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.000341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.003495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:23.025189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.026499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.059670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2265/4540] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:22 2022] GET /identity/v3/auth/tokens => generated 3937 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:23.063222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2fda4-0a4a-4663-8262-14e67dfad0ac tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.067216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.081397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.082076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.082354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.082642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.088240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.089940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.121360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27bfd-e65d-4ccf-9a0f-cf797b77b0fb service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.144388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.146902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.147597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.148115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.149194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:23.149729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.151742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.166251 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2266/4541] 10.222.0.13 () {58 vars in 1171 bytes} [Mon Oct 31 14:37:23 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:23.169872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.199449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586f83-aa37-43fb-8e4e-f7787afc482b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.212564 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2276/4542] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:22 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70 => generated 521 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:23.212564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.407066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:23.414691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.427137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.427443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.427722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.428431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.432978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.459400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67ce97-a441-4f20-b05c-6fcb41dd69b3 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.465413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.466374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.466867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.467318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.479625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9217de5219b14bedb162c176b1070c70, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.484811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.550694 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2267/4543] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:23 2022] POST /identity/v3/services => generated 287 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:23.558368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.592982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b21a-850b-499d-a720-a276e93b1a55 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.601414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.603261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.605353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.606572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.612300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.612300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.704010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2277/4544] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:23 2022] PUT /identity/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 521 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:23.707277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.788351 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1125608809. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:23.788351 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:23.788351 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:23.815895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfbb9-e653-40a7-8cc6-da30af0f7087 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.856781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.857578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.857916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.858314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.859048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.862984 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:23.862984 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:23.862984 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:23.869685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.899231 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2278/4545] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Oct 31 14:37:23 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:23.903537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.915976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8cfd-4e3b-4290-bbd7-1514447fb916 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:23.921257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:23.921906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:23.922189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:23.922513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:23.924554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9217de5219b14bedb162c176b1070c70, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:23.926293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:23.939691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2268/4546] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:37:23 2022] POST /identity/v3/endpoints => generated 361 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:23.943396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:23.989945 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2279/4547] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:23 2022] DELETE /identity/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:23.996534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.008343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885491e2-8d30-4c14-bfe4-6ff559ed3a93 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.098433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:24.117679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5bf94-8027-4075-8277-550409635feb tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.139949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.142834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.142834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.142834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.144076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.145475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.145848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.145969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.146376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.146831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-1125608809` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.147529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1125608809)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.149405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.152100 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2269/4548] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:37:23 2022] GET /identity/v3/regions/tempest-region-1125608809 => generated 180 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:24.156957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.180388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48482-0d3d-4d83-ba84-410f9737c3d9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.225174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.225754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.226067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.226366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/512a83342d8244599018a9b7296f948e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.244238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=512a83342d8244599018a9b7296f948e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.245298 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:24.245298 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:24.245298 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:24.246213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.249795 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2280/4549] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:23 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:24.250546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.291642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:24.371183 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-910137020. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:24.371183 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:24.371183 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:24.376079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b6357-0e1a-49b8-a601-61ce5f31f6c1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.395707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.396938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.397294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.397721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.400564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.403294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.480363 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2281/4550] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:24 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:24.484380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.487854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2270/4551] 10.222.0.13 () {60 vars in 1256 bytes} [Mon Oct 31 14:37:24 2022] PATCH /identity/v3/endpoints/512a83342d8244599018a9b7296f948e => generated 362 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:24.488617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.488866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:24.517789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584dcf9-234c-48d9-89d9-746345a2dff9 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.601229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.602772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.603030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.603531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.604255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.606104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93597d0e-74a5-4529-a7dc-9b10df604972 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.607117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.628918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2271/4552] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:24 2022] GET /identity/v3/roles => generated 2324 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:24.628918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.633316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.633965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.634310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.634641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] PATH_INFO: `/v3/users/afbabe63e86343428ec089655b235cf7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.635676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbabe63e86343428ec089655b235cf7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.637685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.743767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6fa21-26e9-427c-b1dd-e7c80787c358 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.751179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.751881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.752085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.752356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-910137020` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.752949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-910137020)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.754023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.756071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2272/4553] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 14:37:24 2022] GET /identity/v3/regions/tempest-region-910137020 => generated 178 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:24.756867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.768195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ba84-15d5-4e3a-84fd-af1e19ae07dc tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.772884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.773473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.774331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.774608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.777302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.777302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.849477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2273/4554] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:24 2022] POST /identity/v3/roles => generated 234 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:24.849914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:24.863663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbabe63e86343428ec089655b235cf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:24.864931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbabe63e86343428ec089655b235cf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:24.873218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f92b0-c570-4a03-b801-664fa191bfda tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:24.895159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:24.895805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:24.896091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:24.896358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/512a83342d8244599018a9b7296f948e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:24.900234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:24.903078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=512a83342d8244599018a9b7296f948e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:24.904801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:24.987363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '512a83342d8244599018a9b7296f948e', 'request_id': 'req-ff060c81-0d89-4a69-a567-01e0af1a3dfe'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:24.987954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbabe63e86343428ec089655b235cf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.004020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbabe63e86343428ec089655b235cf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.004676 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2274/4555] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:24 2022] DELETE /identity/v3/endpoints/512a83342d8244599018a9b7296f948e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.005780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.007815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:25.007945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbabe63e86343428ec089655b235cf7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.025177 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2282/4556] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:24 2022] DELETE /identity/v3/users/afbabe63e86343428ec089655b235cf7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.026049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.027755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:25.065395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060c81-0d89-4a69-a567-01e0af1a3dfe tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.123280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4bde-eb4d-43a9-a47a-83e2e157da05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.141960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.142999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.143156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.143538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-910137020` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.144225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-910137020)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.145714 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:25.145714 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:25.145714 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:25.155345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.155513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.156106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.156534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.160154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/c2bfe68ef6254299b001b69fa8c18099` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.161815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:25.169789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:update_role(role_id=c2bfe68ef6254299b001b69fa8c18099)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.171093 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:25.171093 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:25.171093 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:25.172687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.331526 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-910137020. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:25.331526 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:25.331526 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:25.339920 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2283/4557] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/regions/tempest-region-910137020 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.341185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2275/4558] 10.222.0.13 () {60 vars in 1243 bytes} [Mon Oct 31 14:37:25 2022] PATCH /identity/v3/roles/c2bfe68ef6254299b001b69fa8c18099 => generated 237 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:25.347406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.348500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.365881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca715-1a4a-45e2-b0e4-711ff3305480 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.376630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1792-dc65-48de-a1a4-acd690ad27ab tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.385146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.385773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.386054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.386472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/c2bfe68ef6254299b001b69fa8c18099` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.396525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:get_role(role_id=c2bfe68ef6254299b001b69fa8c18099)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.402133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.402564 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:25.402564 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:25.402564 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:25.402564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.402954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.402954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.402954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-1125608809` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.402954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1125608809)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.404298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.404575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2276/4559] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:37:25 2022] GET /identity/v3/roles/c2bfe68ef6254299b001b69fa8c18099 => generated 237 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:25.405525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.417151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:25.484319 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1125608809. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:37:25.484319 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:37:25.484319 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:25.499274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2284/4560] 10.222.0.13 () {58 vars in 1209 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/regions/tempest-region-1125608809 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:25.501171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.545842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2e69-898d-45e9-a507-006c2d95193c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.556838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e1fc-99c2-4f76-a1c4-ccd7b11e7ac6 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.568167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.568876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.569216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.569639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.570212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.574321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.574977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.577282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.578248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.578635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] PATH_INFO: `/v3/projects/65a96c3b987247fc8dac51bd32803a38` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.580145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a96c3b987247fc8dac51bd32803a38)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.584973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.591276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2285/4561] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:25 2022] GET /identity/v3/roles => generated 2552 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:25.592643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.621094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ebd9-c377-437f-b2c6-1ceea369aec8 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.627794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.628543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.628832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.629206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services/cd04b9d609934ca09560c8bba00cde13` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.629846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cd04b9d609934ca09560c8bba00cde13)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.630946 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:25.630946 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:25.630946 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:25.635390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.722813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a96c3b987247fc8dac51bd32803a38', 'request_id': 'req-b7719459-fc72-4b19-af65-55523a409a6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.742835 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2286/4562] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/services/cd04b9d609934ca09560c8bba00cde13 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.743936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.768170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c72d-7f20-4de1-a7c4-4c9b92cc1424 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.817491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a96c3b987247fc8dac51bd32803a38', 'request_id': 'req-b7719459-fc72-4b19-af65-55523a409a6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.826078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a96c3b987247fc8dac51bd32803a38', 'request_id': 'req-b7719459-fc72-4b19-af65-55523a409a6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.836007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.837237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.837880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.838161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/c2bfe68ef6254299b001b69fa8c18099` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.839788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c2bfe68ef6254299b001b69fa8c18099)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.841570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.844968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] The token cache is being invalidate because project 65a96c3b987247fc8dac51bd32803a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:25.845431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.846111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.847924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2277/4563] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/projects/65a96c3b987247fc8dac51bd32803a38 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.848506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:25.850209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:25.959649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719459-fc72-4b19-af65-55523a409a6b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:25.977949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:25.978781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.979210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.979604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/4efc1de2058e49e497b2d964a0ad2153` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:25.987728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4efc1de2058e49e497b2d964a0ad2153)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:25.988334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role c2bfe68ef6254299b001b69fa8c18099 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:25.988823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.990602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:25.990935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d275d0e-dbb8-4644-9bc4-d9f12e38d806 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:25.994010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2287/4564] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/roles/c2bfe68ef6254299b001b69fa8c18099 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:25.995205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:25.995487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:25.995789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.028811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:26.030155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:26.103100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2288/4565] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:26.103695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.104982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:26.107821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bcbed97d-b67a-4fb4-b1c9-af3a64964324 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4efc1de2058e49e497b2d964a0ad2153', 'request_id': 'req-bcbed97d-b67a-4fb4-b1c9-af3a64964324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:26.122351 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2278/4566] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:25 2022] DELETE /identity/v3/endpoints/4efc1de2058e49e497b2d964a0ad2153 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:26.122351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.122351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.123054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.146839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:26.147822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:26.181108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78486d8-0e8f-4325-825a-a1f0617c6a48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.182698 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2279/4567] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:26.185221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.187421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:26.199315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.199969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.200259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.200604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.202310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.203981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.270196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5b68-f8b8-461b-b98d-43840b2a7d97 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.274453 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2289/4568] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:26 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 521 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:26.275477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.356084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.356691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.356972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.357424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-629502791` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.358018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-629502791)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.361869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.368097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbf46c-5788-4d5c-97a8-8a5d1c96ab34 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.379008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.380074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.380358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.380634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.381318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:26.381793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.384168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.398107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2290/4569] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:26.399340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.406329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:26.464039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2280/4570] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:37:26 2022] DELETE /identity/v3/regions/tempest-region-629502791 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:26.465425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.499077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca36f-0303-4fd5-ba5b-69de8a292c1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.511993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c883b4e-681c-48b3-bdcc-85986b4f8d5b tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.517215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.518095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.518193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.524178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.524602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.524727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.524818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.524818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.524818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.525056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.542031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.543712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.625748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2281/4571] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:26.628970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.696853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:26.704355 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2291/4572] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:26 2022] PUT /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70 => generated 521 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:26.705112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.727968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9727-7bfd-4744-8521-bf7f3457a2c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.810432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482876e-80fd-44e1-8738-6edd88562be1 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:26.827770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.829361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.829803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.830238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services/58c0b3afb01d4725aca9db19324304ac` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.832376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_service(service_id=58c0b3afb01d4725aca9db19324304ac)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.835297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.835530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:26.836227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:26.836513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:26.836788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:26.837431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:26.840535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:26.906597 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2282/4573] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:26 2022] DELETE /identity/v3/services/58c0b3afb01d4725aca9db19324304ac => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:26.907762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:26.998337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87d1c-2b34-41d6-b7c8-7f71f3d9d458 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.000913 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2292/4574] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:26 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:27.001778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.004954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.005690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.006046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.006414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.010062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9217de5219b14bedb162c176b1070c70, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.011090 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:27.011090 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:27.011090 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:27.012163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.013819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e5de-7837-4e08-99de-35c528fee212 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.032519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.033156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.033435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.033713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/endpoints/16f7613fc1b042d798e7fd6d30b3ace8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.043563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=16f7613fc1b042d798e7fd6d30b3ace8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.047992 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:27.047992 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:27.047992 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:27.047992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.161438 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2283/4575] 10.222.0.13 () {60 vars in 1363 bytes} [Mon Oct 31 14:37:26 2022] PUT /identity/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 521 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:27.162308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.183538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '16f7613fc1b042d798e7fd6d30b3ace8', 'request_id': 'req-120f8405-0049-491f-9bb9-e23773bc7041'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:27.199756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2293/4576] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:37:27 2022] DELETE /identity/v3/endpoints/16f7613fc1b042d798e7fd6d30b3ace8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:27.200720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.228320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8405-0049-491f-9bb9-e23773bc7041 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.278831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809fa0-624b-44fd-a0fb-fc9e9e793c2e tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.297322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.297937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.298220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.298495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.299444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.301973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.313030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.313683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.313949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.314222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70/implies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.315231 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2284/4577] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:27 2022] GET /identity/v3/roles => generated 2324 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:27.315351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.316291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.316426 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:27.316426 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:27.316426 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:27.317287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.327599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2294/4578] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Oct 31 14:37:27 2022] GET /identity/v3/roles/9217de5219b14bedb162c176b1070c70/implies => generated 490 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:27.328479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.361040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ae86-9d6c-466a-99e0-f4e855bbce9a tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.382787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.384411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.384777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.385537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.386277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.388022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.412355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0bef-71d1-47e0-9a50-4914aae5a622 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.414192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2295/4579] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:27 2022] GET /identity/v3/roles => generated 2324 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:27.415225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.421381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.422323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.422735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.423084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/regions/tempest-region-264043131` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.424876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-264043131)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.426836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.428346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a4f4b-d359-419a-bfde-9b485f887d07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.435510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.438101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:27.438822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.439193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.439586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.441918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=fe48edb872bc4c3884fdcb45d03536df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.443405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.454862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2296/4580] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Oct 31 14:37:27 2022] GET /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies => generated 661 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:27.454862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.463593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2982-0760-44c8-a26b-d8158bcc1eea tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.468859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.469616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.469968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.470317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] PATH_INFO: `/v3/projects/d5f02791d3c5413e91ae1da4b515341f/users/30001b220dcf43a387b68674afa792e6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.488000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f02791d3c5413e91ae1da4b515341f, user_id=30001b220dcf43a387b68674afa792e6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.493834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.493956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:27.548927 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2285/4581] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:37:27 2022] DELETE /identity/v3/regions/tempest-region-264043131 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:27.550188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.551751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:27.622969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f9f4-dd13-4811-89d9-bb63ef273a75 tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.628288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.629079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.629359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.629624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.631512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:27.655924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.657339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2297/4582] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:27 2022] PUT /identity/v3/projects/d5f02791d3c5413e91ae1da4b515341f/users/30001b220dcf43a387b68674afa792e6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:27.658365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.679205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.698805 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2286/4583] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:27.700726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:27.738406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b579229-a485-4863-b45b-40695d25702b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.762332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc69231-84eb-4a97-8057-6216194403c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:27.779775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.780428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.780708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.781680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.782685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9217de5219b14bedb162c176b1070c70, implied_role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.784437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d52a9-fd78-4b8c-9b7c-9d6ecad9ba6f tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.844735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd265b97162463883327498987fa0e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52f9e428d1384d8f94bf0310d1c8f606', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:27.845088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.845375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.845649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] PATH_INFO: `/v3/services/b5be05d9f816427598df093d23f412e1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.846323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b5be05d9f816427598df093d23f412e1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:27.848691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:27.899935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2298/4584] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:27 2022] DELETE /identity/v3/roles/9217de5219b14bedb162c176b1070c70/implies/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:27.901609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:27.902195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:27.902692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:27.979929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] MFA Rules not processed for user `30001b220dcf43a387b68674afa792e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:27.981615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.041148 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2287/4585] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:27 2022] DELETE /identity/v3/services/b5be05d9f816427598df093d23f412e1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:28.042141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.095166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1ba9-50de-4381-85a7-193f7f554f4f tempest-EndPointsTestJSON-909443032 tempest-EndPointsTestJSON-909443032-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:28.095260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2299/4586] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:28.095260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.095260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.187826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668f8a-95a6-461e-a04b-1b6cf0f19a3e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:28.190851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:28.191687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:28.193048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:28.193646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:28.194283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:28.196392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:28.196868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:28.197369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] PATH_INFO: `/v3/users/d9f469d7f0214941b363a87d3a481507` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:28.197606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:28.200991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f469d7f0214941b363a87d3a481507)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:28.201668 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:28.201668 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:28.201668 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:28.203165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ba64f-e3a2-4ae7-a207-dbab37330244 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:28.205552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:28.331340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2288/4587] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:28 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/9217de5219b14bedb162c176b1070c70 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:28.333397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:28.333830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:28.334104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:28.361070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] MFA Rules not processed for user `30001b220dcf43a387b68674afa792e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:28.362321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.433182 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2289/4588] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:28.434205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.523540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30bfb5-1c14-4476-87a6-075250c96394 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:28.528022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:28.528636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:28.528914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:28.529184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:28.531282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.541812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:28.543295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:28.553017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2290/4589] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:28.553661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.611334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f469d7f0214941b363a87d3a481507'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:28.612305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f469d7f0214941b363a87d3a481507'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:28.620429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452e8d2-fad9-483b-93e4-afa712b1d681 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:28.625760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:28.626519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:28.626833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:28.627106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:28.628719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fe48edb872bc4c3884fdcb45d03536df, implied_role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:28.630366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:28.748468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f469d7f0214941b363a87d3a481507'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:28.750010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2291/4590] 10.222.0.13 () {58 vars in 1347 bytes} [Mon Oct 31 14:37:28 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df/implies/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:28.751620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.756736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.771119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f469d7f0214941b363a87d3a481507'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:28.771984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f469d7f0214941b363a87d3a481507'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:28.801368 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2300/4591] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:28 2022] DELETE /identity/v3/users/d9f469d7f0214941b363a87d3a481507 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:28.804315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:28.807312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:28.984099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc27a2-0a1c-4e3f-aa30-af87b6f38983 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:29.022006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3189-fb40-4497-95bd-fe7bc5c3a883 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:29.033156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:29.033823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.034107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.034383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/874504daea0d4a968ffe928d44aec52c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.045496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:29.056152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0f77df25-3a5d-4792-a9f6-3b1bfb19c719 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Could not find domain: 874504daea0d4a968ffe928d44aec52c.: keystone.exception.DomainNotFound: Could not find domain: 874504daea0d4a968ffe928d44aec52c. Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 874504daea0d4a968ffe928d44aec52c. Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:29.074195 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:29.075440 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 874504daea0d4a968ffe928d44aec52c. Oct 31 14:37:29.076398 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:29.082862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2301/4592] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:37:28 2022] PATCH /identity/v3/domains/874504daea0d4a968ffe928d44aec52c => generated 112 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:29.085089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.085089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.085089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.085369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:29.130606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:29.132210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:29.205269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:29.208299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.208621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.210892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.220149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:29.250397 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2302/4593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:29.252302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:29.266233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b4cd5-5b91-4650-b9e4-9b9b79d76226 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:29.274087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:29.274087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.274087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.274841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/users/2eb58b044b5e43038137d6d193f93d42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.276436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2eb58b044b5e43038137d6d193f93d42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:29.279266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:29.364888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:29.366504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:29.385492 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2292/4594] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:29.388155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:29.391398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:29.449551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:29.450336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:29.581451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f39669-12d5-460a-be1e-cf2b8153a6bf service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:29.587223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:29.588134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.589844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.590351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.595852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:29.609489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:29.610973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:29.621026 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2293/4595] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:29.686216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:29.729165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:29.729165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb58b044b5e43038137d6d193f93d42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:29.744182 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2303/4596] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:29 2022] DELETE /identity/v3/users/2eb58b044b5e43038137d6d193f93d42 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:29.748355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:29.750110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:29.766889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdbeff-d854-464a-950b-ea615892a5d3 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:29.826584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:29.827428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:29.827712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:29.827988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/de1ac7f8d0d24077b80de46561ba1f57` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:29.829385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de1ac7f8d0d24077b80de46561ba1f57)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:29.830430 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:29.830430 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:29.830430 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:29.831342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:30.000810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role de1ac7f8d0d24077b80de46561ba1f57 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:30.001534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.001892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.004559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2294/4597] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:29 2022] DELETE /identity/v3/roles/de1ac7f8d0d24077b80de46561ba1f57 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:30.009363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:30.026118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc188c-2d41-43c5-9ca8-af38f66c9924 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:30.079751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:30.106062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:30.106888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:30.107171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:30.107444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/groups/eebe4f6b2a784978b097c3a17254421f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:30.108637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_group(group_id=eebe4f6b2a784978b097c3a17254421f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:30.110694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:30.273137 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2304/4598] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:37:30 2022] DELETE /identity/v3/groups/eebe4f6b2a784978b097c3a17254421f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:30.277176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:30.280235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:30.301270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038af564-3c48-47d7-9e43-d897f491da1c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:30.400201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:30.400944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:30.401627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:30.401908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/projects/a2c8115e442f4ebcb51d60121be06486` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:30.403490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2c8115e442f4ebcb51d60121be06486)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:30.406229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:30.509862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:30.512479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:30.623991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c8115e442f4ebcb51d60121be06486', 'request_id': 'req-3c61050c-8a94-4701-aac8-a364c4d4a670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.649118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81fe3b-a8ff-412f-aa3d-220f59b90b86 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:30.730869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c8115e442f4ebcb51d60121be06486', 'request_id': 'req-3c61050c-8a94-4701-aac8-a364c4d4a670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.739288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c8115e442f4ebcb51d60121be06486', 'request_id': 'req-3c61050c-8a94-4701-aac8-a364c4d4a670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.778432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] The token cache is being invalidate because project a2c8115e442f4ebcb51d60121be06486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:30.779093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.781721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.784631 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2295/4599] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:30 2022] DELETE /identity/v3/projects/a2c8115e442f4ebcb51d60121be06486 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:30.785326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:30.785966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:30.786244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:30.787824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] PATH_INFO: `/v3/projects/4049ed468d224779a78a034b837a6130` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:30.790078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:30.791501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4049ed468d224779a78a034b837a6130)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:30.794143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:30.795133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:30.909467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61050c-8a94-4701-aac8-a364c4d4a670 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:30.921130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:30.922020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:30.931142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:30.931142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:30.931142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=343b017b928340cf9dbc677c60fe26a6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:30.931142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:30.975094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:30.976005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.012693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4049ed468d224779a78a034b837a6130', 'request_id': 'req-bd30e654-9493-4355-a920-345193c191e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.163601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4049ed468d224779a78a034b837a6130', 'request_id': 'req-bd30e654-9493-4355-a920-345193c191e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.168804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4049ed468d224779a78a034b837a6130', 'request_id': 'req-bd30e654-9493-4355-a920-345193c191e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.181234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.182449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.182751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] The token cache is being invalidate because project 4049ed468d224779a78a034b837a6130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:31.183050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.183828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.186045 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2305/4600] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:30 2022] DELETE /identity/v3/projects/4049ed468d224779a78a034b837a6130 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:31.187911 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2296/4601] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:37:30 2022] PATCH /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6 => generated 278 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:31.192935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:31.196389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:31.198450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:31.198589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:31.338296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1921e-4402-48d5-b87e-a9b2c8e5e8db tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:31.351103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:31.351799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:31.352129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:31.352383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/domains/343b017b928340cf9dbc677c60fe26a6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:31.357186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e654-9493-4355-a920-345193c191e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:31.369098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=343b017b928340cf9dbc677c60fe26a6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:31.371008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:31.393714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:31.419130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.423545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '343b017b928340cf9dbc677c60fe26a6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.442641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:31.443391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:31.443517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:31.443868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] PATH_INFO: `/v3/users/3dd265b97162463883327498987fa0e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:31.446181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd265b97162463883327498987fa0e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:31.449275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:31.605646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.696422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.705930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.723688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] The token cache is being invalidate because project 343b017b928340cf9dbc677c60fe26a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:31.723980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.724643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.733772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.734446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.735082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '343b017b928340cf9dbc677c60fe26a6', 'request_id': 'req-d6104278-557b-4699-9f2c-eb4a78a36067'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.760146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2297/4602] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:37:31 2022] DELETE /identity/v3/domains/343b017b928340cf9dbc677c60fe26a6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:31.763998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:31.765446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:31.836553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6104278-557b-4699-9f2c-eb4a78a36067 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:31.841548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:31.842187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:31.842568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:31.842994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/9217de5219b14bedb162c176b1070c70` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:31.844292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9217de5219b14bedb162c176b1070c70)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:31.845878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:31.886955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd265b97162463883327498987fa0e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.887662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd265b97162463883327498987fa0e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.970968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd265b97162463883327498987fa0e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.979722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role 9217de5219b14bedb162c176b1070c70 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:31.980021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.980749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.982864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2298/4603] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:31 2022] DELETE /identity/v3/roles/9217de5219b14bedb162c176b1070c70 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:31.986649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:31.987954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd265b97162463883327498987fa0e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:31.988088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:31.988659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd265b97162463883327498987fa0e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.006985 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2306/4604] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:31 2022] DELETE /identity/v3/users/3dd265b97162463883327498987fa0e6 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:32.068566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f83d2e-6d29-4eab-ad83-a09f41cf5769 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:32.134068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:32.134726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:32.135120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:32.135392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/188a492630e74b2dbc07e2bc2a3d5ed9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:32.136770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_role(role_id=188a492630e74b2dbc07e2bc2a3d5ed9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:32.138353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:32.297478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role 188a492630e74b2dbc07e2bc2a3d5ed9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:32.297478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.298469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.306914 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2299/4605] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:31 2022] DELETE /identity/v3/roles/188a492630e74b2dbc07e2bc2a3d5ed9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:32.310838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:32.312461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:32.327659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0cd72-1f1f-417b-9990-ec5be73dff4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:32.334132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:32.407806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac94ff7a59a40e6bdb5246be63b37dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '265b2488fa1f4ad8bc333872a4165c75', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:32.408510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:32.408782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:32.409397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] PATH_INFO: `/v3/roles/fe48edb872bc4c3884fdcb45d03536df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:32.410526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fe48edb872bc4c3884fdcb45d03536df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:32.412144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:32.546252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invalidating the token cache because role fe48edb872bc4c3884fdcb45d03536df has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:32.546252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.546252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.546977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:32.547561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2307/4606] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:32 2022] DELETE /identity/v3/roles/fe48edb872bc4c3884fdcb45d03536df => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:32.552393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:32.567917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:32.571024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:32.646602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9189828-444b-4b7c-acc1-4852cf92da4c tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:32.660566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064982e-d7ed-457c-a78f-7300927f7640 tempest-RolesV3TestJSON-1831308757 tempest-RolesV3TestJSON-1831308757-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:32.665832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:32.666460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:32.666804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:32.667057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] PATH_INFO: `/v3/users/0b68ac2e2e3b4cfa9111c5af3d5565fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:32.668357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b68ac2e2e3b4cfa9111c5af3d5565fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:32.670355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:32.704544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:32.705469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:32.705753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:32.706023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] PATH_INFO: `/v3/projects/52f9e428d1384d8f94bf0310d1c8f606` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:32.707260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f9e428d1384d8f94bf0310d1c8f606)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:32.709900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:32.890235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b68ac2e2e3b4cfa9111c5af3d5565fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.891716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f9e428d1384d8f94bf0310d1c8f606', 'request_id': 'req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.892185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b68ac2e2e3b4cfa9111c5af3d5565fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.976964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f9e428d1384d8f94bf0310d1c8f606', 'request_id': 'req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.985523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f9e428d1384d8f94bf0310d1c8f606', 'request_id': 'req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.997763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] The token cache is being invalidate because project 52f9e428d1384d8f94bf0310d1c8f606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:32.998048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:32.998867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb1acdd1-fbc8-4b55-b4ca-e284fa52f4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:33.000651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2300/4607] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:32 2022] DELETE /identity/v3/projects/52f9e428d1384d8f94bf0310d1c8f606 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:33.005076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609f88-fd5d-4485-95f9-3742a10b0768 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.005357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609f88-fd5d-4485-95f9-3742a10b0768 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.005628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609f88-fd5d-4485-95f9-3742a10b0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.017133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:33.028362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-33609f88-fd5d-4485-95f9-3742a10b0768 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:33.029586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-33609f88-fd5d-4485-95f9-3742a10b0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:33.067891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b68ac2e2e3b4cfa9111c5af3d5565fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:33.091772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b68ac2e2e3b4cfa9111c5af3d5565fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:33.092390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9b99efc-8f32-4237-b3b2-6298ae478b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b68ac2e2e3b4cfa9111c5af3d5565fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:33.094883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2301/4608] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:33.102276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.102835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.103186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.122445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2308/4609] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:32 2022] DELETE /identity/v3/users/0b68ac2e2e3b4cfa9111c5af3d5565fe => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:33.126782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.127348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.127894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.147800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:33.150456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:33.161311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:33.163115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:33.246833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2302/4610] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:33.251167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.254665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2309/4611] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:33.265242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.267370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:33.271402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc0c91-3427-4391-8ba7-def6514d08aa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.277549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.279322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.279322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.279322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.280372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:33.280372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.282278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.298689 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2303/4612] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:33.305549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.338979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad915e-7cb2-4c0a-80b9-517691322b13 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.344016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.344629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.345029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.345396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.346023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.347985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.365211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5bdd5-cec1-4f88-9d82-ecb0ce11c8c2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.369483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.370094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.370400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.370702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.380509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.382637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.393258 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2310/4613] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:37:33.483075 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2304/4614] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:33 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:33.487487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.499671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4fb5-88ff-4ee5-87ad-e84b088c4271 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.563528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.564253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.564528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.564797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.565442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.567419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.708340 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2311/4615] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:33 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:33.711967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.727576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73bb8-d8a0-4012-be86-75a9d0545513 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.736804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.739006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.739461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.739751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.740414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.742143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.755526 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2305/4616] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:33.759461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.771783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3b6d-4a32-4f30-81a8-374a86aaf752 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.777493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.778260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.778919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.779210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.779869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.781821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01833e-1096-43f4-b7bf-671977c4808e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:33.797682 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2312/4617] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:33.802534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:33.834298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2703ec-0274-489c-a468-19ade054e157 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:33.853342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:33.854025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:33.854304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:33.854572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] PATH_INFO: `/v3/projects/06c5038872384b63bf9928e159dd8c9b/users/7648938807f44d95b43aee638d3cf22e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:33.876221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c5038872384b63bf9928e159dd8c9b, user_id=7648938807f44d95b43aee638d3cf22e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:33.878173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.067600 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2306/4618] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:33 2022] PUT /identity/v3/projects/06c5038872384b63bf9928e159dd8c9b/users/7648938807f44d95b43aee638d3cf22e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:34.069962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.070278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.070553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.082876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:34.107964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] MFA Rules not processed for user `7648938807f44d95b43aee638d3cf22e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:34.109220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:34.202972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2313/4619] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:34.208110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.292452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545c15-c221-4bda-975f-63510ff5016f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.299768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.300919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.301278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.301632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.302331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.305086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.366122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:34.438752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2307/4620] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:34 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:34.442484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.454340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6fd7-fa4c-4968-aaca-f69f644b3554 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.542650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.543306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.545511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.545511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.545511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.546944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.610277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.612077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:34.702652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400961-c33a-4bb7-9294-346b0a595b96 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.718609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.719347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.719631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.719908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.721804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:34.734770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2314/4621] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:34 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:34.735863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.737570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:34.754677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002100e-fc45-4685-8f43-7eef382acccf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.762879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.763660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.764000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.764277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] PATH_INFO: `/v3/projects/3602353c3ff44b029685b0091fdd780b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.765434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3602353c3ff44b029685b0091fdd780b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.767378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.785261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.787680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.808893 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2308/4622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:34.810041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.826160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c3c9-b99a-40e3-9809-431a354f4a22 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.832841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.833308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.833698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.834146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.834772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.837596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.857439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2309/4623] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:34.865135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:34.894058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e679-df8c-4c4a-b138-63f096f4de1a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:34.899366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:34.902892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:34.903274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:34.904274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] PATH_INFO: `/v3/projects/09660c3dd89b4c11adfaa781e2202017/users/a58b7325f8d64402a082f6ef4c90aa7a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:34.924570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09660c3dd89b4c11adfaa781e2202017, user_id=a58b7325f8d64402a082f6ef4c90aa7a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:34.927759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:34.932409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3602353c3ff44b029685b0091fdd780b', 'request_id': 'req-1baefd70-74f2-4150-b3f0-9b381c05626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.050705 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2310/4624] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:34 2022] PUT /identity/v3/projects/09660c3dd89b4c11adfaa781e2202017/users/a58b7325f8d64402a082f6ef4c90aa7a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:35.052591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.067474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3602353c3ff44b029685b0091fdd780b', 'request_id': 'req-1baefd70-74f2-4150-b3f0-9b381c05626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.077276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3602353c3ff44b029685b0091fdd780b', 'request_id': 'req-1baefd70-74f2-4150-b3f0-9b381c05626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.115055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] The token cache is being invalidate because project 3602353c3ff44b029685b0091fdd780b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:35.115655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.118845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.122175 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2315/4625] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:34 2022] DELETE /identity/v3/projects/3602353c3ff44b029685b0091fdd780b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:35.125689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.143769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:35.251104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9360b-cbfb-4742-b98d-f4d42119d5c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.267157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.267799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.268077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.268525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.271449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.273212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.287818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baefd70-74f2-4150-b3f0-9b381c05626e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.297037 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2311/4626] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:35.297941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.301167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.301167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.301456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.301581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] PATH_INFO: `/v3/users/1ac94ff7a59a40e6bdb5246be63b37dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.302015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:35.302682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac94ff7a59a40e6bdb5246be63b37dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.304682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.317526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c1d-e65e-421d-93e6-532cc2052b73 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.328269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.334805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.334805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.334805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] PATH_INFO: `/v3/projects/09660c3dd89b4c11adfaa781e2202017/users/a58b7325f8d64402a082f6ef4c90aa7a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.334805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09660c3dd89b4c11adfaa781e2202017, user_id=a58b7325f8d64402a082f6ef4c90aa7a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.336815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c1876-6bdb-4e48-8934-31773b8cdd72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.350287 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2312/4627] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:35 2022] PUT /identity/v3/projects/09660c3dd89b4c11adfaa781e2202017/users/a58b7325f8d64402a082f6ef4c90aa7a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:35.364114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.364383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.364662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.425350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] MFA Rules not processed for user `a58b7325f8d64402a082f6ef4c90aa7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:35.427912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:35.516903 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2313/4628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:35.521915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.532494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d75cc-741f-4419-9269-67aced8dd288 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.537559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.538182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.538466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.538784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.540076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.541021 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:35.541021 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:35.541021 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:35.541912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.590522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac94ff7a59a40e6bdb5246be63b37dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.591212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac94ff7a59a40e6bdb5246be63b37dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.659183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac94ff7a59a40e6bdb5246be63b37dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.670696 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2314/4629] 10.222.0.13 () {60 vars in 1185 bytes} [Mon Oct 31 14:37:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:35.676192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.681806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:35.685265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac94ff7a59a40e6bdb5246be63b37dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.687863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac94ff7a59a40e6bdb5246be63b37dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.714856 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2316/4630] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:35 2022] DELETE /identity/v3/users/1ac94ff7a59a40e6bdb5246be63b37dd => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:35.715072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa0e8-8633-4da2-9bb5-0a0714773017 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.834286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.835071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.835354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.835629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eeeae5ef1b354954b6c1ff7601330b36` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.836802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=eeeae5ef1b354954b6c1ff7601330b36)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.838128 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:35.838128 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:35.838128 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:35.839380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.846250 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2315/4631] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 14:37:35 2022] GET /identity/v3/OS-OAUTH1/consumers/eeeae5ef1b354954b6c1ff7601330b36 => generated 221 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:35.850390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:35.861099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc5b1-bc8d-4c2c-879a-824e379ba7f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:35.865688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:35.866330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:35.867928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:35.868227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eeeae5ef1b354954b6c1ff7601330b36` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:35.868854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=eeeae5ef1b354954b6c1ff7601330b36)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:35.869861 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:35.869861 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:35.869861 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:35.870782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:35.871053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer eeeae5ef1b354954b6c1ff7601330b36 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:35.871331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.872016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:35.965686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:35.987535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'eeeae5ef1b354954b6c1ff7601330b36', 'request_id': 'req-6263eb00-1fbc-4ba7-b4e3-027e442fb122'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.096057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2317/4632] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:35 2022] DELETE /identity/v3/OS-OAUTH1/consumers/eeeae5ef1b354954b6c1ff7601330b36 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:36.100919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.102847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.115612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7616-2f7f-477b-bdda-dcf92b948f43 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.120887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.121523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.121824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.122092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.123161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.124489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.235486 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2316/4633] 10.222.0.13 () {60 vars in 1185 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:36.239519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.251297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263eb00-1fbc-4ba7-b4e3-027e442fb122 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.255974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.256611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.256895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.257166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.257816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=9a96bd5665404530bf3b2fabb333475b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.258940 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:36.258940 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:36.258940 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:36.265429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.265429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2318/4634] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 14:37:36 2022] GET /identity/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b => generated 221 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:36.269046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.280277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9d17c-8ef5-475b-b89b-ff0cd586fc8f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.285192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.285937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.286290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.287032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.287353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9a96bd5665404530bf3b2fabb333475b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.288445 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:36.288445 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:36.288445 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:36.289492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.289763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer 9a96bd5665404530bf3b2fabb333475b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:36.290041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.290778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.381093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.382949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.408789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9a96bd5665404530bf3b2fabb333475b', 'request_id': 'req-dfbad187-a997-45b9-baca-76e9a730f519'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.462112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2c24-b12a-45c7-a191-24cfcab4a112 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.466710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.467322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.467599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.467874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] PATH_INFO: `/v3/projects/265b2488fa1f4ad8bc333872a4165c75` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.468998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265b2488fa1f4ad8bc333872a4165c75)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.471227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.504099 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2317/4635] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:36.508643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.510467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.524253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbad187-a997-45b9-baca-76e9a730f519 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.529419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.530415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.530739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.531022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.538605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=9a96bd5665404530bf3b2fabb333475b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.542582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 31 14:37:36.550675 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 31 14:37:36.551783 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:36.555620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2318/4636] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 14:37:36 2022] GET /identity/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b => generated 74 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:37:36.556326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.567810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074012-29d1-4d20-886b-a45ed29bcbcb tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.573006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.573619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.573901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.574173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.574793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9a96bd5665404530bf3b2fabb333475b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.576385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.576659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer 9a96bd5665404530bf3b2fabb333475b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:36.576934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.577598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 31 14:37:36.590692 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 31 14:37:36.591887 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:36.592555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2319/4637] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9a96bd5665404530bf3b2fabb333475b => generated 74 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:37:36.597789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.599206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.613225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2c43-e153-4338-a3b5-6b1fe31e760f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.618022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.618643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.618941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.619214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.619854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.621446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.668275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265b2488fa1f4ad8bc333872a4165c75', 'request_id': 'req-c28ce529-f10f-4d70-8421-85f2c87d6969'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.731262 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2320/4638] 10.222.0.13 () {60 vars in 1185 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:36.736781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.748571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1840116-4769-434c-918c-c02ec2465a97 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.755214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:36.757547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265b2488fa1f4ad8bc333872a4165c75', 'request_id': 'req-c28ce529-f10f-4d70-8421-85f2c87d6969'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.764816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265b2488fa1f4ad8bc333872a4165c75', 'request_id': 'req-c28ce529-f10f-4d70-8421-85f2c87d6969'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.777829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] The token cache is being invalidate because project 265b2488fa1f4ad8bc333872a4165c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:36.778137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.779015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c28ce529-f10f-4d70-8421-85f2c87d6969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:36.784372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2319/4639] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:36 2022] DELETE /identity/v3/projects/265b2488fa1f4ad8bc333872a4165c75 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:36.792719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb106c-476e-47e4-b1df-30bcf694edf8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.793858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb106c-476e-47e4-b1df-30bcf694edf8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.794162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb106c-476e-47e4-b1df-30bcf694edf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.826050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75cb106c-476e-47e4-b1df-30bcf694edf8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:36.826590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.827255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.827501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75cb106c-476e-47e4-b1df-30bcf694edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.830718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.830718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.830718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.830718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.897669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2320/4640] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:36.906875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.907165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.907440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.929124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:36.930954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.947115 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2321/4641] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:36.947311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2321/4642] 10.222.0.13 () {60 vars in 1185 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:36.947654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.948451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.949057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:36.961721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb6-eae9-43bf-a8a7-7d5943be3307 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.964737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d6aba-1b75-4631-bfd3-ce251ef2a189 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:36.968050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.968879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.969165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.969584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.969757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:36.970519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:36.970841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:36.970967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:36.971140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:36.971238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.971688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:36.972744 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:36.972744 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:36.972744 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:36.973008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.973620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:36.981038 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2322/4643] 10.222.0.13 () {58 vars in 1164 bytes} [Mon Oct 31 14:37:36 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:36.985987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.987608 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2322/4644] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:36.991760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:36.999085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6354-e6a3-420c-8cf5-8e250afd9229 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.004301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.005113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.005405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.005680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e4f5d683e1ae4fa7a9416081b2a363d4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.006216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b3ee-7344-4d0a-bf24-f539af234110 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.006329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e4f5d683e1ae4fa7a9416081b2a363d4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.008518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.015433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer e4f5d683e1ae4fa7a9416081b2a363d4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:37.015433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.015433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.015816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.015816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.015816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.015816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.016210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.023397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.101166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e4f5d683e1ae4fa7a9416081b2a363d4', 'request_id': 'req-b739e886-4da4-4dc9-a192-d83c6da47b9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.141467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2323/4645] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:36 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:37.145401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.147262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:37.205296 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2323/4646] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e4f5d683e1ae4fa7a9416081b2a363d4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:37.210668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.215411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:37.250966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0560d-64ae-4447-bea0-688b53c675d6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.251668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.252380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.252566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.252806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.252912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739e886-4da4-4dc9-a192-d83c6da47b9f tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.253433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.255393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.335290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.335977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.336260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.336541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/84a90f83670a4460b62a01caded1f324` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.337134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=84a90f83670a4460b62a01caded1f324)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.338744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.339014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer 84a90f83670a4460b62a01caded1f324 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:37.339292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.339944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.403624 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2324/4647] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:37 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:37.406195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.407532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:37.420575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644668-56cf-43da-82e8-beb7d7afb605 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.423606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '84a90f83670a4460b62a01caded1f324', 'request_id': 'req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:37.426091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.426729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.426978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.427239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.428183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.430187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.444565 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2325/4648] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:37.445505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.456123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ed563-c72a-40ca-80bf-031882f86279 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.463833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.463833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.463833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.463833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.464257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.465201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.477330 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2326/4649] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:37.483563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.495970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b2594-e047-4aff-a03c-86a3f0679c95 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.500855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.501691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.502340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.502340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] PATH_INFO: `/v3/projects/5b1c8f7229e649548aafacdf6bc1b9d6/users/f5aa4537f95249a08362c571194bf067/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.525841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1c8f7229e649548aafacdf6bc1b9d6, user_id=f5aa4537f95249a08362c571194bf067, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.528680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e8039-90ed-4e80-8ff6-e60bf81be1e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.597042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2324/4650] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/84a90f83670a4460b62a01caded1f324 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:37.603015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.615332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:37.627806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746bb2-b7ae-4a65-8cd4-97155c34ac6c tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.632749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.633374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.633645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.633922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.634568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.635599 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:37.635599 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:37.635599 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:37.636583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.726464 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2327/4651] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:37 2022] PUT /identity/v3/projects/5b1c8f7229e649548aafacdf6bc1b9d6/users/f5aa4537f95249a08362c571194bf067/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:37.736821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.737103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.737381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.768544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] MFA Rules not processed for user `f5aa4537f95249a08362c571194bf067`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:37.769839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:37.837210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2328/4652] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:37.840355 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2325/4653] 10.222.0.13 () {60 vars in 1185 bytes} [Mon Oct 31 14:37:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:37.841735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.844107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:37.855860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4eca4f-f144-4a06-be15-2528443b4fec tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.911274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dad310-4455-468b-9a75-8d0a973f2a8a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:37.915807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.916407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.916686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.916956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.917589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.919562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:37.922433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:37.923159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:37.923438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:37.923710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:37.924815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=eb983d9ee0734402bb7deca843e0a1ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:37.926259 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:37.926259 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:37.926259 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:37.927159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.033535 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2326/4654] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Oct 31 14:37:37 2022] PATCH /identity/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce => generated 221 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:38.037485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.049629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2d5c-dd77-46d1-8072-4114115a2aba tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.054480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.055779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.056061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.056336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.056917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=eb983d9ee0734402bb7deca843e0a1ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.058502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.064475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2327/4655] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 14:37:38 2022] GET /identity/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce => generated 221 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:38.067853 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2329/4656] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:37 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:38.070434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.071042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.081148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4836-2455-41cb-8157-4ad6ea94258d tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.137099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0379cb-ca76-4027-ae1b-8ba1204819d3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.141086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b7325f8d64402a082f6ef4c90aa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09660c3dd89b4c11adfaa781e2202017', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.141745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.148026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.148156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.148156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.148378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.148378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.148536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=eb983d9ee0734402bb7deca843e0a1ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.148617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.148617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.148750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.148750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invalidating token cache because consumer eb983d9ee0734402bb7deca843e0a1ce has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:38.148750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.149004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.149085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.174968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:38.221685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'eb983d9ee0734402bb7deca843e0a1ce', 'request_id': 'req-9939ee29-e3ea-4f0b-8738-184e41eb1851'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.266283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2330/4657] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:38 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:38.267359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.268939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.283408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2831-05ce-4fa8-8d0e-22adb27e46cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.288608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.290209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.290558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.290947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.291679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.293349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.309839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2331/4658] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:38.311290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.323583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625c72-82e0-4e0d-b1df-f285df2a9db1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.329313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.330287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.330565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.330868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] PATH_INFO: `/v3/projects/801bd424c6514c6487addf38219a2ec8/users/971439557b624194b69bc26d279b8ba6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.344121 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2328/4659] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 14:37:38 2022] DELETE /identity/v3/OS-OAUTH1/consumers/eb983d9ee0734402bb7deca843e0a1ce => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:38.348212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=801bd424c6514c6487addf38219a2ec8, user_id=971439557b624194b69bc26d279b8ba6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.349622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.351169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.351299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.365977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ee29-e3ea-4f0b-8738-184e41eb1851 tempest-OAUTHConsumersV3Test-856861486 tempest-OAUTHConsumersV3Test-856861486-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.371458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.372108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.372382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.377415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] PATH_INFO: `/v3/users/7648938807f44d95b43aee638d3cf22e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.377415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7648938807f44d95b43aee638d3cf22e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.377415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.441229 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2332/4660] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:38 2022] PUT /identity/v3/projects/801bd424c6514c6487addf38219a2ec8/users/971439557b624194b69bc26d279b8ba6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:38.444931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.520818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868dab-ea66-4a9b-b682-3442f4d04e5a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.526788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.532298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.532298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.532298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.532298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.532298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.542659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2333/4661] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:38.546891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.560305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38f53-eb5c-489a-af25-5216dcc7c975 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.565290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.565971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.566249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.566653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] PATH_INFO: `/v3/projects/801bd424c6514c6487addf38219a2ec8/users/971439557b624194b69bc26d279b8ba6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.568466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801bd424c6514c6487addf38219a2ec8, user_id=971439557b624194b69bc26d279b8ba6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.571459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd57c1-e61d-4b9f-87e4-e87dc5c48bd5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.582128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2334/4662] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:38 2022] PUT /identity/v3/projects/801bd424c6514c6487addf38219a2ec8/users/971439557b624194b69bc26d279b8ba6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:38.600739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.601026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.601297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.636144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] MFA Rules not processed for user `971439557b624194b69bc26d279b8ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:38.637395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.708600 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2335/4663] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:38.713781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.723305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc280-75e1-47b8-ac1f-d05f2a6d4045 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.728635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.729233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.729518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.729796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.730419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.732394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.739413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7648938807f44d95b43aee638d3cf22e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.740075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7648938807f44d95b43aee638d3cf22e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.806891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7648938807f44d95b43aee638d3cf22e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.821889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7648938807f44d95b43aee638d3cf22e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.823055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-10474e73-12e3-47d5-a536-d7e35f9c76a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7648938807f44d95b43aee638d3cf22e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:38.837037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2329/4664] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:38 2022] DELETE /identity/v3/users/7648938807f44d95b43aee638d3cf22e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:38.841333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.841907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.841907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.861441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:38.862666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.876487 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2336/4665] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:37:38 2022] POST /identity/v3/projects => generated 329 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:38.880586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.882396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.929102 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2330/4666] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:38.940062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:38.941465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:38.949394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48a0f-e213-4c2c-8228-2a42b7fec5e3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:38.954117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:38.954755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:38.955053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:38.955311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:38.955945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:38.957863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:38.998384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3718bf9-5364-45ec-9d42-176bd0d87e48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.046965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.047593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.047876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.048151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.104485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2337/4667] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:38 2022] POST /identity/v3/users => generated 413 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:39.109099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:39.110284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.111023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:39.121054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1548-ce0c-48db-a234-8310813a8280 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.122581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2331/4668] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:39.126063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.126698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.126980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.127250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.127909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:39.129597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:39.177170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:39.259975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2338/4669] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:39 2022] POST /identity/v3/roles => generated 244 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:39.260237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.268247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeb100-cf91-432e-8abe-23d98ba4e87c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.272893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.273488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.273765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.274039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.274743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:39.276341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:39.405263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2332/4670] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:39 2022] POST /identity/v3/roles => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:39.406229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.422034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564b7a5-9be7-4d5a-8e82-e2d5e6213aec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.433145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.433754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.434234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.434676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2/users/3da262ecb8d04a4f8ffe81b368bd6793/roles/cd9b527a5856407da0f6d0604b5b6859` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.456939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b254e61fbc2d4ec8b52c74026a0a24d2, user_id=3da262ecb8d04a4f8ffe81b368bd6793, role_id=cd9b527a5856407da0f6d0604b5b6859)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:39.460807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:39.655534 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2339/4671] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:39 2022] PUT /identity/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2/users/3da262ecb8d04a4f8ffe81b368bd6793/roles/cd9b527a5856407da0f6d0604b5b6859 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:39.660381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.673750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2ec1-b6da-4ba8-bb53-eb08fb70e33e tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.760873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.761945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.762668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.763289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2/users/3da262ecb8d04a4f8ffe81b368bd6793/roles/fccab9f44f7d444692ae0857ac3c09fd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.765927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b254e61fbc2d4ec8b52c74026a0a24d2, user_id=3da262ecb8d04a4f8ffe81b368bd6793, role_id=fccab9f44f7d444692ae0857ac3c09fd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:39.768896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:39.854651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2333/4672] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:39 2022] PUT /identity/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2/users/3da262ecb8d04a4f8ffe81b368bd6793/roles/fccab9f44f7d444692ae0857ac3c09fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:39.859082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.877594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350d8a-d87d-41bd-8d39-85beb566caec tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:39.959486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:39.962816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:39.982271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:39.991413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:39.991413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:39.991413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:39.991705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:39.999574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.004244 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:40.004244 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:40.004244 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:40.005428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb38f-44a5-4964-9344-552c2f363ae0 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.059576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c82a58-e251-4842-b3ca-12009a8bbbee tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:40.065853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:40.066723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.067402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.067898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] PATH_INFO: `/v3/projects/06c5038872384b63bf9928e159dd8c9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.069295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c5038872384b63bf9928e159dd8c9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.072941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.103703 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2340/4673] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:39 2022] GET /identity/v3/users => generated 8608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:40.105137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508e3-a304-41b2-abae-dd5976af3d93 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.105523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508e3-a304-41b2-abae-dd5976af3d93 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.105735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508e3-a304-41b2-abae-dd5976af3d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.161948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b3f508e3-a304-41b2-abae-dd5976af3d93 None None] MFA Rules not processed for user `3da262ecb8d04a4f8ffe81b368bd6793`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:40.163434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3f508e3-a304-41b2-abae-dd5976af3d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:40.241849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c5038872384b63bf9928e159dd8c9b', 'request_id': 'req-76adc960-5ef0-453a-8f36-032b9c55752a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.252856 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2341/4674] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:40 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:40.262107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.262654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.262979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.292200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] MFA Rules not processed for user `3da262ecb8d04a4f8ffe81b368bd6793`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:40.293300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:40.349239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c5038872384b63bf9928e159dd8c9b', 'request_id': 'req-76adc960-5ef0-453a-8f36-032b9c55752a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.350522 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2342/4675] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:40 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:40.354554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:40.356706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c5038872384b63bf9928e159dd8c9b', 'request_id': 'req-76adc960-5ef0-453a-8f36-032b9c55752a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.363162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98caa72-2212-459c-a320-2d9e54320797 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:40.367859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da262ecb8d04a4f8ffe81b368bd6793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1505883605', 'tempest-NotDelegatedRole-336989414'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:40.368732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.368878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] The token cache is being invalidate because project 06c5038872384b63bf9928e159dd8c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:40.369073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.369279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.369745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.369866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.371326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: Authorizing `identity:create_trust()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.371580 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2334/4676] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:39 2022] DELETE /identity/v3/projects/06c5038872384b63bf9928e159dd8c9b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:40.372285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.375142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:40.376676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:40.501053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc960-5ef0-453a-8f36-032b9c55752a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:40.507098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:40.508360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.508644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.508919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] PATH_INFO: `/v3/users/a58b7325f8d64402a082f6ef4c90aa7a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.510123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58b7325f8d64402a082f6ef4c90aa7a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.512061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.609991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2343/4677] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:37:40 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:40.609991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:40.609991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:40.701867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0fe2b-8e1a-4f1a-9387-56deca21ef9b tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:40.707852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:40.708547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.708922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.709488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.710192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.711388 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:40.711388 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:40.711388 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:40.712363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.722351 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2344/4678] 10.222.0.13 () {58 vars in 1155 bytes} [Mon Oct 31 14:37:40 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:40.730542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:40.730542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:40.743258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ace98-8127-4053-b4d3-a1570572b6f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:40.749794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da262ecb8d04a4f8ffe81b368bd6793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1505883605', 'tempest-NotDelegatedRole-336989414'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:40.749794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:40.750232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:40.750603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] PATH_INFO: `/v3/OS-TRUST/trusts/33a64ff45ea6431d9ee022e273a72577` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:40.761181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: Authorizing `identity:delete_trust(trust_id=33a64ff45ea6431d9ee022e273a72577)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:40.762805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:40.842462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58b7325f8d64402a082f6ef4c90aa7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.842462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58b7325f8d64402a082f6ef4c90aa7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.902065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '33a64ff45ea6431d9ee022e273a72577', 'request_id': 'req-5f2b9e68-dfd7-4082-8331-f222c21051e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.902975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '33a64ff45ea6431d9ee022e273a72577', 'request_id': 'req-5f2b9e68-dfd7-4082-8331-f222c21051e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.937204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58b7325f8d64402a082f6ef4c90aa7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.971119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58b7325f8d64402a082f6ef4c90aa7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.974982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58b7325f8d64402a082f6ef4c90aa7a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:40.992069 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2335/4679] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:40 2022] DELETE /identity/v3/users/a58b7325f8d64402a082f6ef4c90aa7a => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:41.040992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '33a64ff45ea6431d9ee022e273a72577', 'request_id': 'req-5f2b9e68-dfd7-4082-8331-f222c21051e1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:41.048647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2345/4680] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 14:37:40 2022] DELETE /identity/v3/OS-TRUST/trusts/33a64ff45ea6431d9ee022e273a72577 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:41.059370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:41.061340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:41.168729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d536a-96cc-452d-9fda-0a0206416453 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:41.173212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da262ecb8d04a4f8ffe81b368bd6793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1505883605', 'tempest-NotDelegatedRole-336989414'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:41.173866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:41.174147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:41.174901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] PATH_INFO: `/v3/OS-TRUST/trusts/33a64ff45ea6431d9ee022e273a72577` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Could not find trust: 33a64ff45ea6431d9ee022e273a72577.: keystone.exception.TrustNotFound: Could not find trust: 33a64ff45ea6431d9ee022e273a72577. Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 14:37:41.209562 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 33a64ff45ea6431d9ee022e273a72577. Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:41.215981 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2336/4681] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:37:41 2022] GET /identity/v3/OS-TRUST/trusts/33a64ff45ea6431d9ee022e273a72577 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:41.216845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:41.216929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:41.259359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b9e68-dfd7-4082-8331-f222c21051e1 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:41.336559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:41.341345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:41.341695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:41.342011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/fccab9f44f7d444692ae0857ac3c09fd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:41.345052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fccab9f44f7d444692ae0857ac3c09fd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:41.346906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:41.631083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role fccab9f44f7d444692ae0857ac3c09fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:41.631741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:41.632158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:41.635264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2346/4682] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:41 2022] DELETE /identity/v3/roles/fccab9f44f7d444692ae0857ac3c09fd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:41.640189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:41.641999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:41.659067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab82c-ea43-4ff5-bc15-4657f916a841 tempest-TrustsV3TestJSON-1513240193 tempest-user-812461269] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:41.778086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:41.780118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:41.780912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:41.782862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/cd9b527a5856407da0f6d0604b5b6859` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:41.783476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cd9b527a5856407da0f6d0604b5b6859)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:41.785445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:41.862768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:42.053783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role cd9b527a5856407da0f6d0604b5b6859 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:42.054585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.055947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.059858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2337/4683] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:41 2022] DELETE /identity/v3/roles/cd9b527a5856407da0f6d0604b5b6859 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:42.063518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:42.073330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:42.076598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:42.090671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f790-e0d5-49e9-9add-c2946fbb5930 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:42.208217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:42.210492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.211673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.212540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/3da262ecb8d04a4f8ffe81b368bd6793` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.217562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3da262ecb8d04a4f8ffe81b368bd6793)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:42.218510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e67800-0b72-40a4-a235-7bbd3af26772 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:42.220642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:42.225607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:42.227378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.227857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.228364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.231182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:42.247970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:42.250188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:42.264726 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2338/4684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:37:42.266588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:42.267712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:42.389600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da262ecb8d04a4f8ffe81b368bd6793'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.390653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da262ecb8d04a4f8ffe81b368bd6793'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.413157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0076c-44e8-4e6b-9303-61cac44325c0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:42.421845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:42.423536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.424003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.424749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] PATH_INFO: `/v3/projects/09660c3dd89b4c11adfaa781e2202017` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.426533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09660c3dd89b4c11adfaa781e2202017)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:42.430118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:42.502802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da262ecb8d04a4f8ffe81b368bd6793'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.527060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da262ecb8d04a4f8ffe81b368bd6793'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.529688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da262ecb8d04a4f8ffe81b368bd6793'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.550735 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2347/4685] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:42 2022] DELETE /identity/v3/users/3da262ecb8d04a4f8ffe81b368bd6793 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:42.555630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:42.560600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:42.609931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09660c3dd89b4c11adfaa781e2202017', 'request_id': 'req-18995229-5055-43bb-ba42-2a675240196d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.679951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2edc1b-cb80-46b2-abdd-c54d003b60d9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:42.712734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09660c3dd89b4c11adfaa781e2202017', 'request_id': 'req-18995229-5055-43bb-ba42-2a675240196d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.725162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09660c3dd89b4c11adfaa781e2202017', 'request_id': 'req-18995229-5055-43bb-ba42-2a675240196d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.742527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] The token cache is being invalidate because project 09660c3dd89b4c11adfaa781e2202017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:42.743094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.744112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18995229-5055-43bb-ba42-2a675240196d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:42.745871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2339/4686] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:42 2022] DELETE /identity/v3/projects/09660c3dd89b4c11adfaa781e2202017 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:42.751547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bc1c-a95a-4967-a946-23a528f25773 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.751834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bc1c-a95a-4967-a946-23a528f25773 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.752646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bc1c-a95a-4967-a946-23a528f25773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.798884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:42.799803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.800084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.800543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.802004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d39bc1c-a95a-4967-a946-23a528f25773 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:42.803266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d39bc1c-a95a-4967-a946-23a528f25773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:42.806006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b254e61fbc2d4ec8b52c74026a0a24d2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:42.807429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:42.942545 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2340/4687] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:42.944303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:42.944587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:42.944859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:42.997834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:43.005623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:43.047816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'request_id': 'req-93e51b71-64e4-4763-9422-fcb590d2b227'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:43.133302 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2341/4688] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:43.137402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.159674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a60f6-b2cf-4903-b063-d96c953e2660 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.163486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'request_id': 'req-93e51b71-64e4-4763-9422-fcb590d2b227'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:43.164666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.165296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.165580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.165852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.166674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:43.166861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.168486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.173613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b254e61fbc2d4ec8b52c74026a0a24d2', 'request_id': 'req-93e51b71-64e4-4763-9422-fcb590d2b227'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:43.194915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project b254e61fbc2d4ec8b52c74026a0a24d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:43.195742 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2342/4689] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:43.198160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:43.200428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.200650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:43.204651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2348/4690] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:42 2022] DELETE /identity/v3/projects/b254e61fbc2d4ec8b52c74026a0a24d2 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:43.209245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:43.212598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.216180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:43.257101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d750be-c081-4833-92d5-bda30dfa26a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.280183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.280808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.281091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.281394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.281989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.284231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.399912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2343/4691] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:43 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:43.403877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.434929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51b71-64e4-4763-9422-fcb590d2b227 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.542811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.544044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.544511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.544958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.545776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.548325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.605703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dc33d-0a76-4b55-ba3c-5b2d35cba5f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.614962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.617610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.617923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.618206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.618903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.621693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.660895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2349/4692] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:37:43 2022] POST /identity/v3/projects => generated 328 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:43.667624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.770849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2344/4693] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:43 2022] POST /identity/v3/users => generated 285 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:43.774862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.792904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68838a-ea8b-4a76-8f46-6242d66ce89f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.819213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f690-d5cd-494f-84b7-aa869d92421b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.833668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.834785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.835093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.835369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.836659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.839339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.938158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.938833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.939140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.939399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.940052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:43.941688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:43.959281 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2345/4694] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:43.962063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:43.986728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3abc-358e-4efe-a3ab-6b1a88cc15be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:43.990807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2350/4695] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:43 2022] POST /identity/v3/users => generated 410 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:43.996611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:43.997245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:43.997530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:43.997840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:43.998474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.000195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.000364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.036354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2346/4696] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:44.036984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe50e2-8a12-4575-946a-7134a27bdecc tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.039317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.046918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.047672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.048107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.048502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.052065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.053759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.067764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865b836-92a0-4d36-b3ee-53239ab752ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.083982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.084666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.084951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.085224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] PATH_INFO: `/v3/projects/d67f947d3e414c22a703047081ade33e/users/5609669d4b4d460aadef0b321c40f220/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.115900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67f947d3e414c22a703047081ade33e, user_id=5609669d4b4d460aadef0b321c40f220, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.120053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afec24-edd9-41cb-b2fa-ebd27adabc89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.202159 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2351/4697] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:43 2022] POST /identity/v3/roles => generated 244 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:44.203625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.218996 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2347/4698] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:44 2022] PUT /identity/v3/projects/d67f947d3e414c22a703047081ade33e/users/5609669d4b4d460aadef0b321c40f220/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:44.221085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7074-af9f-4d22-aa11-31fc2f55a506 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.229595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.230560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.230963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.284551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] MFA Rules not processed for user `5609669d4b4d460aadef0b321c40f220`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:44.286736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:44.304177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:44.361092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.361948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.362469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.362868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.363692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.365468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.416368 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2348/4699] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:44.421011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.470668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2352/4700] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:44 2022] POST /identity/v3/roles => generated 247 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:44.475140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.494124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7e4f-4f22-451b-a361-8fe59f3313f3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.510191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.511131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.511480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.511829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/571c49c5208641f3914cb83258b2f400/users/b508cb492357428daf711fc8a1aa4162/roles/d22d96c1168a4a39aa699a20e04b05fd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.547112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=571c49c5208641f3914cb83258b2f400, user_id=b508cb492357428daf711fc8a1aa4162, role_id=d22d96c1168a4a39aa699a20e04b05fd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.550177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.558676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c996f-c1c0-429a-a65f-81605b9a3e2d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.565226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.566047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.566403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.566781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.567585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.569590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.640404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2353/4701] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:44 2022] PUT /identity/v3/projects/571c49c5208641f3914cb83258b2f400/users/b508cb492357428daf711fc8a1aa4162/roles/d22d96c1168a4a39aa699a20e04b05fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:44.642096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.707781 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2349/4702] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:44 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:44.708834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:44.780229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051531c5-4a8a-4a8a-8915-865fa8502a2d tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.917708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65602c6-4317-4d80-a670-7d44a3fd4bad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:44.926289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.927359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:44.927782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.927976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:44.928295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.928633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.928816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:44.931695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/571c49c5208641f3914cb83258b2f400/users/b508cb492357428daf711fc8a1aa4162/roles/62d312e0cf0d4080befe09864451a1c6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:44.934536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.934867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.940467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=571c49c5208641f3914cb83258b2f400, user_id=b508cb492357428daf711fc8a1aa4162, role_id=62d312e0cf0d4080befe09864451a1c6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:44.946280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:44.982537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:45.049121 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2350/4703] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:44 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:45.051627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.069118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb590-aac4-4453-b149-20649a48547f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.081821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2354/4704] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:44 2022] PUT /identity/v3/projects/571c49c5208641f3914cb83258b2f400/users/b508cb492357428daf711fc8a1aa4162/roles/62d312e0cf0d4080befe09864451a1c6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:45.083079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.183922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.184806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.186263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.190906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.192280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.193302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f696d-3130-49e2-bb8a-e2e7f6ec08b3 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.196810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.207761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2351/4705] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:45 2022] GET /identity/v3/roles => generated 1893 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:45.212091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.216857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.217727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.223036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.231337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.231337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.231337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798ac26-b9ee-4c34-b34e-82882819ece8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.231621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8bd7-c1bd-4111-8b2c-688615e69c25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.241044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.242508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.243008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.243946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] PATH_INFO: `/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5/users/71073d0329d14c6083417a095c6e71e5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.274152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dae9d3b6534fa5a7a8f6abe7ac10e5, user_id=71073d0329d14c6083417a095c6e71e5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.280355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.287658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2355/4706] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:45 2022] GET /identity/v3/users => generated 8878 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:45.293553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d252e0-4658-41fc-82f1-9d19a6c2ab4a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.294123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d252e0-4658-41fc-82f1-9d19a6c2ab4a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.294576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d252e0-4658-41fc-82f1-9d19a6c2ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.340313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f2d252e0-4658-41fc-82f1-9d19a6c2ab4a None None] MFA Rules not processed for user `b508cb492357428daf711fc8a1aa4162`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:45.341813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f2d252e0-4658-41fc-82f1-9d19a6c2ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:45.394476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2352/4707] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:45 2022] PUT /identity/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5/users/71073d0329d14c6083417a095c6e71e5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:45.399018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.412972 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2356/4708] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:45.424717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.425075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.425410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.468176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] MFA Rules not processed for user `b508cb492357428daf711fc8a1aa4162`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:45.479066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:45.530952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23be780-25f0-4552-84b8-e8e52d440873 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.547695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.548900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.549242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.549838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.550545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.553355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.571272 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2353/4709] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:45 2022] GET /identity/v3/roles => generated 1893 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:45.574080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.591637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01506-2b41-4ee3-86cc-fc9cb36b84ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.598181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.599747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.600024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.600405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] PATH_INFO: `/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5/users/71073d0329d14c6083417a095c6e71e5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.606411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05dae9d3b6534fa5a7a8f6abe7ac10e5, user_id=71073d0329d14c6083417a095c6e71e5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.611681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648ac0-ee6f-409f-8e75-4cd3d6d900b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.613419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2357/4710] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:45.617367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.625603 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2354/4711] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:45 2022] PUT /identity/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5/users/71073d0329d14c6083417a095c6e71e5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:45.628168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7358-7676-491d-9fc2-b08a8d179ee8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.637485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.637485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.637710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.680826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] MFA Rules not processed for user `71073d0329d14c6083417a095c6e71e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:45.682244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:45.760645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b508cb492357428daf711fc8a1aa4162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '571c49c5208641f3914cb83258b2f400', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1900637062', 'tempest-NotDelegatedRole-2100907575'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.761866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.762160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.762446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.763164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorizing `identity:create_trust()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.764904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.792718 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2355/4712] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:45.797720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.819199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06fec2-4f40-4446-b67d-0707b3afd21b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:45.826004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:45.827230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:45.827515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:45.827794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:45.828578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:45.830813 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:45.830813 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:45.830813 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:45.831742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:45.938796 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2356/4713] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:37:45 2022] POST /identity/v3/services => generated 241 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:45.939892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.945403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2358/4714] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:37:45 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:45.949135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:45.975841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da32f-1e5b-4cb3-9724-498fb951981e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.001644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009521-966c-4d38-9821-e56ed415c725 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.012993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.013655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.013946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.014226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/5b202a5482004fa19d7e671c12b233d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.014849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5b202a5482004fa19d7e671c12b233d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.022241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.031605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b508cb492357428daf711fc8a1aa4162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '571c49c5208641f3914cb83258b2f400', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1900637062', 'tempest-NotDelegatedRole-2100907575'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.032543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.032687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.032915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.035232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.036843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.062580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2359/4715] 10.222.0.13 () {58 vars in 1252 bytes} [Mon Oct 31 14:37:45 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=b508cb492357428daf711fc8a1aa4162 => generated 611 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:46.062580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.101115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180fc50-6c3e-437b-8a85-7eaa8e6007c7 tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.116340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b508cb492357428daf711fc8a1aa4162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '571c49c5208641f3914cb83258b2f400', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1900637062', 'tempest-NotDelegatedRole-2100907575'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.117640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.120286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.120572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] PATH_INFO: `/v3/OS-TRUST/trusts/c7319a6d83f04065918025eda063339a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.142583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorizing `identity:delete_trust(trust_id=c7319a6d83f04065918025eda063339a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.144122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.160277 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2357/4716] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:45 2022] DELETE /identity/v3/services/5b202a5482004fa19d7e671c12b233d7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:46.165450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.219799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdba91-08c5-4de4-9674-cd7bd5416ae0 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.230221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.230968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.231374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.231817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.232725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.233680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c7319a6d83f04065918025eda063339a', 'request_id': 'req-49523109-213c-41a3-ace9-a258ac75f24e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:46.235292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c7319a6d83f04065918025eda063339a', 'request_id': 'req-49523109-213c-41a3-ace9-a258ac75f24e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:46.236020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.331986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c7319a6d83f04065918025eda063339a', 'request_id': 'req-49523109-213c-41a3-ace9-a258ac75f24e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:46.342879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2360/4717] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 14:37:46 2022] DELETE /identity/v3/OS-TRUST/trusts/c7319a6d83f04065918025eda063339a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:46.343993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.348695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:46.370461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523109-213c-41a3-ace9-a258ac75f24e tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.385212 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2358/4718] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:46 2022] POST /identity/v3/services => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:46.389332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.401542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:46.418960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b508cb492357428daf711fc8a1aa4162', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '571c49c5208641f3914cb83258b2f400', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1900637062', 'tempest-NotDelegatedRole-2100907575'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.418960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.418960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.419371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] PATH_INFO: `/v3/OS-TRUST/trusts/c7319a6d83f04065918025eda063339a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Could not find trust: c7319a6d83f04065918025eda063339a.: keystone.exception.TrustNotFound: Could not find trust: c7319a6d83f04065918025eda063339a. Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 14:37:46.433518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c7319a6d83f04065918025eda063339a. Oct 31 14:37:46.434633 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:46.439948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:46.451397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2361/4719] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:37:46 2022] GET /identity/v3/OS-TRUST/trusts/c7319a6d83f04065918025eda063339a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:37:46.451397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.452990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:46.477304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cfd84-ff0b-4324-b78d-418109ef2bc6 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.488147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.489173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.489667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.490175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/a5b63644971446aeada4c8eae5489100` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.491135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:update_service(service_id=a5b63644971446aeada4c8eae5489100)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.492414 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:46.492414 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:46.492414 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:46.497316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.574002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2359/4720] 10.222.0.13 () {60 vars in 1252 bytes} [Mon Oct 31 14:37:46 2022] PATCH /identity/v3/services/a5b63644971446aeada4c8eae5489100 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:46.578160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.622149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40269c-71ff-488a-b395-6573c3907d0d tempest-TrustsV3TestJSON-811993643 tempest-user-53866550] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.624057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015c4d-fb08-4a67-97ae-2a90f3d327c4 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.638925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.639667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.639966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.640404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/a5b63644971446aeada4c8eae5489100` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.641059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:get_service(service_id=a5b63644971446aeada4c8eae5489100)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.646334 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:46.646334 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:46.646334 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:46.649054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.658008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.660649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.663169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.663169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/62d312e0cf0d4080befe09864451a1c6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.663505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2360/4721] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:37:46 2022] GET /identity/v3/services/a5b63644971446aeada4c8eae5489100 => generated 283 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:46.664365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=62d312e0cf0d4080befe09864451a1c6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.666329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.667988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.685557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513304fd-11ae-4d75-a698-f63184fb291e tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.697371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.698149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.698863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.699237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/a5b63644971446aeada4c8eae5489100` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.699922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a5b63644971446aeada4c8eae5489100)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.701838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.803988 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2361/4722] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:46 2022] DELETE /identity/v3/services/a5b63644971446aeada4c8eae5489100 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:46.808170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.837203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333753-a530-4e96-8614-c3cd5e1ad01c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.842754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:46.843828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:46.843977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:46.844235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/a5b63644971446aeada4c8eae5489100` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:46.845274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:get_service(service_id=a5b63644971446aeada4c8eae5489100)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:46.847024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:46.861574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role 62d312e0cf0d4080befe09864451a1c6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:46.861574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:46.861574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:46.863129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2362/4723] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:46 2022] DELETE /identity/v3/roles/62d312e0cf0d4080befe09864451a1c6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:46.867687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.872062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Could not find service: a5b63644971446aeada4c8eae5489100.: keystone.exception.ServiceNotFound: Could not find service: a5b63644971446aeada4c8eae5489100. Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a5b63644971446aeada4c8eae5489100. Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:46.880478 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:37:46.881519 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a5b63644971446aeada4c8eae5489100. Oct 31 14:37:46.882484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:46.888715 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2362/4724] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:37:46 2022] GET /identity/v3/services/a5b63644971446aeada4c8eae5489100 => generated 113 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:37:46.894468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:46.896278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:46.927648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0adea-680a-4f5f-b2ef-86224e33c251 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:46.977154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b420a-fcc9-4fd0-b3e8-03fe9848a03f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:47.007380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:47.008758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:47.011061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:47.013037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:47.013349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/d22d96c1168a4a39aa699a20e04b05fd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:47.016096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d22d96c1168a4a39aa699a20e04b05fd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:47.031281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:47.032060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:47.032298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:47.032891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:47.034246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:47.046096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:47.050229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:47.222950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2363/4725] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:46 2022] POST /identity/v3/services => generated 274 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:47.228442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:47.269280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role d22d96c1168a4a39aa699a20e04b05fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:47.269852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.271406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.276587 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2363/4726] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:46 2022] DELETE /identity/v3/roles/d22d96c1168a4a39aa699a20e04b05fd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:47.276697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2eb15-5e52-47a0-8d69-b7f39caf62fc tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:47.277728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:47.284361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:47.387322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e6620-1c2e-44a8-9293-22f07a067b37 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:47.409912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:47.410586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:47.410750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:47.411009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:47.411349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/b508cb492357428daf711fc8a1aa4162` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:47.412169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:47.412991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:47.413342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:47.414122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:47.414566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b508cb492357428daf711fc8a1aa4162)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:47.416063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:47.418464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:47.581388 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2364/4727] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:47 2022] POST /identity/v3/services => generated 274 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:47.585167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:47.589421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:47.637894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b508cb492357428daf711fc8a1aa4162'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.638578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b508cb492357428daf711fc8a1aa4162'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.700734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271dd2-4bb4-42e1-b921-099d9ace32e2 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:47.711725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:47.712666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:47.713167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:47.713659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:47.715001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:47.716870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:47.760173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b508cb492357428daf711fc8a1aa4162'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.784933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b508cb492357428daf711fc8a1aa4162'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.785691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b508cb492357428daf711fc8a1aa4162'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:47.816993 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2364/4728] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:47 2022] DELETE /identity/v3/users/b508cb492357428daf711fc8a1aa4162 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:47.820885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:47.822409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:47.854479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2365/4729] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:47 2022] POST /identity/v3/services => generated 273 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:47.856239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:47.864616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:47.935803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a190c-a01a-4e87-b525-841f6b24aa2c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.007892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:48.031083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fa9c3-a16b-421e-9771-98b2d0e33b4a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.103987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.104660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.104909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.105672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.105948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.106946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.107083 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:48.107083 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:37:48.107083 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:37:48.107621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.112182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.112653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.112763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/571c49c5208641f3914cb83258b2f400` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.112763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=571c49c5208641f3914cb83258b2f400)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.112763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.129707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2366/4730] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:37:47 2022] GET /identity/v3/services => generated 2976 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:48.134073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.168289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5ebb-bd74-4e33-9044-cfb4a726512f tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.173590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.174358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.175956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.176342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.177709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1586178851) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:48.178092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.180898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.190755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2367/4731] 10.222.0.13 () {58 vars in 1222 bytes} [Mon Oct 31 14:37:48 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1586178851 => generated 417 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:48.190755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.194972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:48.295931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f7c7-5c2e-4d92-8271-78c7ae47c150 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.300949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.301568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.301864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.302117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] PATH_INFO: `/v3/users/d987718cdcfd4f3aa06cacb2e33dcca1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.303248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d987718cdcfd4f3aa06cacb2e33dcca1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.305203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.449638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571c49c5208641f3914cb83258b2f400', 'request_id': 'req-0b3c3a10-4c52-4612-9656-4632cd070aff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.573190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd987718cdcfd4f3aa06cacb2e33dcca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.573879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd987718cdcfd4f3aa06cacb2e33dcca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.623324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571c49c5208641f3914cb83258b2f400', 'request_id': 'req-0b3c3a10-4c52-4612-9656-4632cd070aff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.631313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571c49c5208641f3914cb83258b2f400', 'request_id': 'req-0b3c3a10-4c52-4612-9656-4632cd070aff'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.644562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project 571c49c5208641f3914cb83258b2f400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:48.644771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.645433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.647018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2365/4732] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:47 2022] DELETE /identity/v3/projects/571c49c5208641f3914cb83258b2f400 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:48.652006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.652006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:48.723329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c3a10-4c52-4612-9656-4632cd070aff tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.731400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.732955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd987718cdcfd4f3aa06cacb2e33dcca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.733406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.734027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.734374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.735133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1027043128) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:48.735454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.737195 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:37:48.737195 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:37:48.737195 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:37:48.738145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.744919 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2366/4733] 10.222.0.13 () {58 vars in 1222 bytes} [Mon Oct 31 14:37:48 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1027043128 => generated 417 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:48.745908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.748831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:48.754011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd987718cdcfd4f3aa06cacb2e33dcca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.758352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd987718cdcfd4f3aa06cacb2e33dcca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:48.785100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2368/4734] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:48 2022] DELETE /identity/v3/users/d987718cdcfd4f3aa06cacb2e33dcca1 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:48.786791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.803721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:48.866667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9d048-3fc4-49ef-bcac-54ba3a25ee3c tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.906534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13714460-e0d9-47bd-990b-f7736513f59d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.912403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.913066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.913416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.913807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.914436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-56836935) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:48.914854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.916757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.926199 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2369/4735] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Oct 31 14:37:48 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-56836935 => generated 414 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:48.927231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:48.938942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c1f9-b570-4acc-8981-92fa1098cd4b tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:48.947438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.948736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.950151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.950537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/13bd5579d8f9436e8caf7108bc00839d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.951297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=13bd5579d8f9436e8caf7108bc00839d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.953369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.955550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:48.956386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:48.956736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:48.957364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:48.958065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:48.960215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:48.999272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:49.046083 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2370/4736] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:48 2022] DELETE /identity/v3/services/13bd5579d8f9436e8caf7108bc00839d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:49.050464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.097800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da9b72-8597-479d-b31b-537529d1672d tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.113459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.114386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.114939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.115429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/4dbc59a7a7f141a5ad67f1192fce6cea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.116228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4dbc59a7a7f141a5ad67f1192fce6cea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.119134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.135446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2367/4737] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:37:48 2022] POST /identity/v3/projects => generated 329 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:49.137052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.251845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea06f-8d30-4a2f-9600-c4501905a666 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.271243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.271864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.272260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.272810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.286148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.286148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.319009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2371/4738] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:49 2022] DELETE /identity/v3/services/4dbc59a7a7f141a5ad67f1192fce6cea => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:49.320577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.322498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:49.409236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40cf93-ac66-4fcd-b818-19557ef482fa tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.409446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2368/4739] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:49 2022] POST /identity/v3/users => generated 416 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:49.410420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.499738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.500666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.500953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.501225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] PATH_INFO: `/v3/projects/77df1a191e7d46cdbc64b53f0ad985b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.503462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77df1a191e7d46cdbc64b53f0ad985b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.505525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.519482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573e2b5-a2b0-4de2-b301-b9e3deb68ccf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.537129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71073d0329d14c6083417a095c6e71e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.538024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.538311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.538583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] PATH_INFO: `/v3/services/c43e7bd51f5e4fe19a59065328b38d30` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.539746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c43e7bd51f5e4fe19a59065328b38d30)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.541371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.707541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77df1a191e7d46cdbc64b53f0ad985b9', 'request_id': 'req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:49.737989 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2369/4740] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:49 2022] DELETE /identity/v3/services/c43e7bd51f5e4fe19a59065328b38d30 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:49.738856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.763587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457972-b9c6-4512-9cd1-127c656d6e69 tempest-ServicesTestJSON-2002642889 tempest-ServicesTestJSON-2002642889-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.820941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.821551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.821831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.822226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.822595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77df1a191e7d46cdbc64b53f0ad985b9', 'request_id': 'req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:49.822928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.824889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35d463-6e47-45db-9927-1c2590869466 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.831991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77df1a191e7d46cdbc64b53f0ad985b9', 'request_id': 'req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:49.842528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] The token cache is being invalidate because project 77df1a191e7d46cdbc64b53f0ad985b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:49.842916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:49.843663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:49.845222 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2372/4741] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:49 2022] DELETE /identity/v3/projects/77df1a191e7d46cdbc64b53f0ad985b9 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:49.850478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.853337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:49.915720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2370/4742] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:49 2022] POST /identity/v3/roles => generated 244 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:49.917763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.918362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4fb8a-b9e7-4d5b-a8a5-a54aef5325c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.918588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.919551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.933723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.934352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.934643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.934939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] PATH_INFO: `/v3/users/5609669d4b4d460aadef0b321c40f220` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.936093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5609669d4b4d460aadef0b321c40f220)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.938024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:49.947208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:49.948778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:49.958797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2371/4743] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:49.959844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:49.962105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:49.976439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ec40a-5a5a-411b-aba4-f8c7c21bfb19 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:49.981477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:49.982134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:49.982446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:49.982781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:49.983455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:49.985050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060dde-a6d0-4164-b170-2232aa737afe tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.089703 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2372/4744] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:49 2022] POST /identity/v3/roles => generated 247 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:50.091045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.091339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.091615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.110784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:50.111977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.119921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2373/4745] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:50.120742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.131622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080e9fc-5c67-4e5d-bd85-94ccc08c72f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.136917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.137606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.137890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.138276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff/users/39f7ff618a7c45e986c87b9af617433f/roles/0a9b217d56094d328a5f2a1894f37bea` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.149387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:50.155855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=91d7e6a5d1e143849fc25fd2b57e57ff, user_id=39f7ff618a7c45e986c87b9af617433f, role_id=0a9b217d56094d328a5f2a1894f37bea)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.158568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.187174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5609669d4b4d460aadef0b321c40f220'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:50.187905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5609669d4b4d460aadef0b321c40f220'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:50.235132 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2374/4746] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:50 2022] PUT /identity/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff/users/39f7ff618a7c45e986c87b9af617433f/roles/0a9b217d56094d328a5f2a1894f37bea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:50.239032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.240744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.256804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5609669d4b4d460aadef0b321c40f220'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:50.274554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5609669d4b4d460aadef0b321c40f220'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:50.275869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5609669d4b4d460aadef0b321c40f220'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:50.293934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2373/4747] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:49 2022] DELETE /identity/v3/users/5609669d4b4d460aadef0b321c40f220 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:50.293934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.294428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.321062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931d90-cdcd-4c89-8c9d-65c8ebefcd17 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.375459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4b3d4-6df6-4fd0-a4b2-49d8245b3b2d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.381657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.383137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.383496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.383859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff/users/39f7ff618a7c45e986c87b9af617433f/roles/04e7eef8bc264f339c26ea3ad404fcb9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.386346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=91d7e6a5d1e143849fc25fd2b57e57ff, user_id=39f7ff618a7c45e986c87b9af617433f, role_id=04e7eef8bc264f339c26ea3ad404fcb9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.389176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.391730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.392952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.392952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.393238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.394094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:50.394499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.396843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6604a-ccf8-4b41-9ed7-ea834571e025 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.413565 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2375/4748] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:50.415025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.415311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.415584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.441244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:50.442641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.451486 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2376/4749] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:50.452251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.463051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93dd82-2856-4353-9c4e-d8f28f78c78f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.467977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.468589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.468865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.469239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.469821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.471774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.506160 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2374/4750] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:50 2022] PUT /identity/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff/users/39f7ff618a7c45e986c87b9af617433f/roles/04e7eef8bc264f339c26ea3ad404fcb9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:50.507012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.510470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.582802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2377/4751] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:50.583711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.592721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f45c-fb4f-4284-8e5c-d51368faaf58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.654006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.654929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.655060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.655304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.681487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572718-4c30-45e6-81b6-c3b17169cbb6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.687047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.689630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.689630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.689630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.689630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.691736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.732285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.733809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e73111-d2b6-4af9-ba6b-c4751551ddc5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.743575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2378/4752] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:50 2022] GET /identity/v3/users => generated 8333 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:50.744672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.748022 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2375/4753] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:50.749298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8eae-77db-4540-ab25-40ac401492a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.749691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8eae-77db-4540-ab25-40ac401492a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.749968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8eae-77db-4540-ab25-40ac401492a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.759118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f25b3b-c019-4978-94aa-64700ce1850f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.766828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.768399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.768904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.769358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.770172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.774570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.797962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-047e8eae-77db-4540-ab25-40ac401492a0 None None] MFA Rules not processed for user `39f7ff618a7c45e986c87b9af617433f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:50.799831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-047e8eae-77db-4540-ab25-40ac401492a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.891440 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2376/4754] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:50.902063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.902389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.902694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.923412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] MFA Rules not processed for user `39f7ff618a7c45e986c87b9af617433f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:50.924899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:50.933251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2377/4755] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:37:50.937395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.947751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d929f9-9c72-41c2-9213-e6f570f19f70 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.952236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.953034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.953310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.953677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.954343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.955436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:50.963345 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2379/4756] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:50.964553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:50.983991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb568b4-0d86-492c-b17e-f9e7fff6c912 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:50.991509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:50.994795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:50.994795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:50.994795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:50.994795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:50.997020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.024015 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2380/4757] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:50 2022] GET /identity/v3/roles => generated 1893 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:37:51.027845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.042053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0ef4f-62ba-450f-b60b-d05b72977fa2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.047397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.048010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.048288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.048560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.049201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.051903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.070204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2381/4758] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/roles => generated 1893 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:51.071345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.086206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd15b-154b-491f-8ea5-32c63cec9750 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.093585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.094586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.094893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.095162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce/users/a7f0164cc4b049938115f1817ee885ea/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.121190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2764f613cfe24ad4b610ffe80a0c02ce, user_id=a7f0164cc4b049938115f1817ee885ea, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.125455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc7546-3501-4739-8985-bcc8149b1b05 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.183738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2378/4759] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:37:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:37:51.187995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.197439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d8ce9-93ed-45de-b774-8e5dd3183e1b tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.201825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.202471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.202785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.203060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.212476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:get_trust(trust_id=013bd12169654dcfb441ed58748a2fcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.217288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.225566 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2379/4760] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd => generated 859 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:51.228684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.249012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbb22b-d533-49ba-a680-6870b8682ec1 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.252156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.254959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.255247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.255535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.262933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=013bd12169654dcfb441ed58748a2fcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.265032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.274747 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2380/4761] 10.222.0.13 () {58 vars in 1269 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:51.279116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.284821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2382/4762] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:51 2022] PUT /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce/users/a7f0164cc4b049938115f1817ee885ea/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:51.296771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.297054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.297332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.302408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd644a-e8e9-455e-90b5-5fb250aa12df tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.389915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] MFA Rules not processed for user `a7f0164cc4b049938115f1817ee885ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:51.391256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:51.416839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:51.423258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.424016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.424377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.424985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/0a9b217d56094d328a5f2a1894f37bea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.444186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:get_role_for_trust(trust_id=013bd12169654dcfb441ed58748a2fcd, role_id=0a9b217d56094d328a5f2a1894f37bea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.445591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.467332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2381/4763] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/0a9b217d56094d328a5f2a1894f37bea => generated 244 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:51.467332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.472390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:51.506701 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2383/4764] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:51.506701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.524554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4f06-e14b-4135-8ce7-60b5cacade38 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.532557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.533504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.534162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.534647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/0a9b217d56094d328a5f2a1894f37bea` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.544269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:get_role_for_trust(trust_id=013bd12169654dcfb441ed58748a2fcd, role_id=0a9b217d56094d328a5f2a1894f37bea)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.546083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.556174 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2384/4765] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:37:51 2022] HEAD /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/0a9b217d56094d328a5f2a1894f37bea => generated 0 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 14:37:51.557329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.559296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:51.588696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:51.616076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b948f6-ed8d-439d-99f0-733f04bc0262 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.622216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.622530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.622727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.623007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] PATH_INFO: `/v3/projects/d67f947d3e414c22a703047081ade33e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.624283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67f947d3e414c22a703047081ade33e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.629356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.666917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b1389-9d58-40ad-bd34-a982b391727a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.673398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.674014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.674287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.674829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.683999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.685525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.694771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2385/4766] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:51.699762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.716249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd214d55-67e9-4c1e-913e-6a3b8196ad34 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.723787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.724521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.724865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.725648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/04e7eef8bc264f339c26ea3ad404fcb9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.733612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:get_role_for_trust(trust_id=013bd12169654dcfb441ed58748a2fcd, role_id=04e7eef8bc264f339c26ea3ad404fcb9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.735652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-79abce68-24fa-45cd-9436-0a632fe99863 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9.: keystone.exception.RoleNotFound: Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9. Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:37:51.748931 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9. Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2386/4767] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/04e7eef8bc264f339c26ea3ad404fcb9 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1188a-92d9-445d-a05c-a5284a76cea9 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1188a-92d9-445d-a05c-a5284a76cea9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1188a-92d9-445d-a05c-a5284a76cea9 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.753868 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2387/4768] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:37:51.757663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1188a-92d9-445d-a05c-a5284a76cea9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.770194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1188a-92d9-445d-a05c-a5284a76cea9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.774681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.779267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.782713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.788293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/04e7eef8bc264f339c26ea3ad404fcb9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.800824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:get_role_for_trust(trust_id=013bd12169654dcfb441ed58748a2fcd, role_id=04e7eef8bc264f339c26ea3ad404fcb9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.802995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67f947d3e414c22a703047081ade33e', 'request_id': 'req-7ecb58e4-f600-4a62-9852-1cd9013d98ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:51.803815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9.: keystone.exception.RoleNotFound: Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9. Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:37:51.820445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 04e7eef8bc264f339c26ea3ad404fcb9. Oct 31 14:37:51.826937 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:51.826937 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2388/4769] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:37:51 2022] HEAD /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd/roles/04e7eef8bc264f339c26ea3ad404fcb9 => generated 0 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:51.826937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:37:51.846656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.858832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba35a-2459-4e0d-bf6b-f324ff8854b3 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:51.880108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67f947d3e414c22a703047081ade33e', 'request_id': 'req-7ecb58e4-f600-4a62-9852-1cd9013d98ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:51.886537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67f947d3e414c22a703047081ade33e', 'request_id': 'req-7ecb58e4-f600-4a62-9852-1cd9013d98ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:51.909251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] The token cache is being invalidate because project d67f947d3e414c22a703047081ade33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:51.909551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:51.910236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:51.913318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2382/4770] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:51 2022] DELETE /identity/v3/projects/d67f947d3e414c22a703047081ade33e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:51.918706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:51.923087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:51.976737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f0164cc4b049938115f1817ee885ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2764f613cfe24ad4b610ffe80a0c02ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:51.977925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:51.978267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:51.978608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:51.979581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorizing `identity:get_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:51.981517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:51.984479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2389/4771] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:37:51 2022] GET /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 365 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:51.997197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:52.007375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.075608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb58e4-f600-4a62-9852-1cd9013d98ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:52.089619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:52.090348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.090639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.090933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.099912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorizing `identity:delete_trust(trust_id=013bd12169654dcfb441ed58748a2fcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:52.101429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:52.155640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34a6d-69cd-4d96-91e9-d7107ef069ff tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:52.160766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:52.161436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.161787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.162201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] PATH_INFO: `/v3/users/71073d0329d14c6083417a095c6e71e5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.163465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71073d0329d14c6083417a095c6e71e5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:52.165495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:52.198224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '013bd12169654dcfb441ed58748a2fcd', 'request_id': 'req-3a1ba194-4a63-4b6b-a3df-501afc1d222a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.199049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '013bd12169654dcfb441ed58748a2fcd', 'request_id': 'req-3a1ba194-4a63-4b6b-a3df-501afc1d222a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.200657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a1ba194-4a63-4b6b-a3df-501afc1d222a tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '013bd12169654dcfb441ed58748a2fcd', 'request_id': 'req-3a1ba194-4a63-4b6b-a3df-501afc1d222a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.298841 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2383/4772] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 14:37:51 2022] DELETE /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:52.302275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.302776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.303214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.312639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2384/4773] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:37:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:37:52.313807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:52.318058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.339414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba6f18-b397-4e4f-9ea3-0835622887ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:52.345813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f7ff618a7c45e986c87b9af617433f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d7e6a5d1e143849fc25fd2b57e57ff', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1800125329', 'tempest-NotDelegatedRole-2101254292'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:52.346658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.346946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.347228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] PATH_INFO: `/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Could not find trust: 013bd12169654dcfb441ed58748a2fcd.: keystone.exception.TrustNotFound: Could not find trust: 013bd12169654dcfb441ed58748a2fcd. Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 14:37:52.359909 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 013bd12169654dcfb441ed58748a2fcd. Oct 31 14:37:52.361139 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:52.385037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2385/4774] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:37:52 2022] GET /identity/v3/OS-TRUST/trusts/013bd12169654dcfb441ed58748a2fcd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:37:52.386068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:37:52.388509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.426638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71073d0329d14c6083417a095c6e71e5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.427506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71073d0329d14c6083417a095c6e71e5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.514824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71073d0329d14c6083417a095c6e71e5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.541071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71073d0329d14c6083417a095c6e71e5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.543556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71073d0329d14c6083417a095c6e71e5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:52.578384 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2390/4775] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:51 2022] DELETE /identity/v3/users/71073d0329d14c6083417a095c6e71e5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:52.579310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:52.583042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.600120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:52.614249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:52.616279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.630607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb2c75-ccbb-41ca-8aee-96ba5dd3f502 tempest-TrustsV3TestJSON-2041114684 tempest-user-1562157709] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:52.770704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f0164cc4b049938115f1817ee885ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2764f613cfe24ad4b610ffe80a0c02ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:52.772357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.772647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.773472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.774725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorizing `identity:get_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:52.776570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1595ce-762e-4899-b015-179948566128 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:52.781039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2386/4776] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:37:52 2022] GET /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 365 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:52.808306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64347c1c-cf09-4858-88ae-cc97acc3c20a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:52.815007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:52.815745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.816099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.816445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/04e7eef8bc264f339c26ea3ad404fcb9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.817927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=04e7eef8bc264f339c26ea3ad404fcb9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:52.819581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:52.833186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:52.833604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:52.833888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:52.836706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2387/4777] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:37:52.843259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:37:52.843733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:52.857921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.003415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.005951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.031862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564e340-928d-43dc-ad29-6bbae7bb4d92 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.038570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f0164cc4b049938115f1817ee885ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2764f613cfe24ad4b610ffe80a0c02ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.039448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.039736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.040012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.041877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorizing `identity:get_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.049575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.051137 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2388/4778] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:37:52 2022] GET /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 365 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:53.058733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role 04e7eef8bc264f339c26ea3ad404fcb9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:53.059026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.059724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-580309fe-aeee-4e31-870d-cee9929e93d2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.063809 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2391/4779] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:52 2022] DELETE /identity/v3/roles/04e7eef8bc264f339c26ea3ad404fcb9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:53.072376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.076115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.090595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.090936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.091214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.092739 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2392/4780] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:37:53.098072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:37:53.100054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.136180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380ca22-4ac9-4e59-8dc7-98bb0dc5a9f1 tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.283525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.285148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.290929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.291933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.292329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.292710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/0a9b217d56094d328a5f2a1894f37bea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.297744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0a9b217d56094d328a5f2a1894f37bea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.304112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.371820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.425672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74135c-4ac0-4c15-9a78-b3603bba6bf7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.443686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f0164cc4b049938115f1817ee885ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2764f613cfe24ad4b610ffe80a0c02ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.444548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.444893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.449018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.450594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorizing `identity:get_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.452301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.457670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role 0a9b217d56094d328a5f2a1894f37bea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:53.458004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.460591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2393/4781] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:37:53 2022] GET /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 365 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:53.463848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-533fdf39-4fdc-457b-9809-ede3cf80b513 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.466860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2389/4782] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:53 2022] DELETE /identity/v3/roles/0a9b217d56094d328a5f2a1894f37bea => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:53.467413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.469231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.499400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9588e-2ef4-47d8-aa18-313a5bc029fd tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.540039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.540326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.540602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.542125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2390/4783] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:37:53.548612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 14:37:53.550669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.556362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.607929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.632302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.635203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.635493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.635866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/39f7ff618a7c45e986c87b9af617433f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.636982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=39f7ff618a7c45e986c87b9af617433f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.639011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.681367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.685749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.697561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.781780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:53.788491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f7ff618a7c45e986c87b9af617433f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.788491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f7ff618a7c45e986c87b9af617433f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.806108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ceb9-9ae1-47b0-ac54-a528d23c3bc6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.813537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7f0164cc4b049938115f1817ee885ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2764f613cfe24ad4b610ffe80a0c02ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.813537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.813537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.814274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.815790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorizing `identity:get_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.818151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.821237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2391/4784] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 14:37:53 2022] GET /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 365 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:37:53.823318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.826189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.855872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481785f-31c0-4973-81ae-5ba74d2aea5e tempest-QuotasTestJSON-1468059144 tempest-QuotasTestJSON-1468059144-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:53.861587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f7ff618a7c45e986c87b9af617433f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.871004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:53.872140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:53.872588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:53.873324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:53.875929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.882009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f7ff618a7c45e986c87b9af617433f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.884302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f7ff618a7c45e986c87b9af617433f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:53.900977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:53.902726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:53.916807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2394/4785] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:53 2022] DELETE /identity/v3/users/39f7ff618a7c45e986c87b9af617433f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:53.917686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.919160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.923466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2392/4786] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:53.926061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:53.931666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:53.968553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62ca61-2d8a-4da2-aee3-822acd2b375d service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:54.092704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:54.138668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:54.139743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:54.141868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:54.142275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:54.143847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd9788-3bc2-4140-96fa-5810e8b91a74 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:54.145384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91d7e6a5d1e143849fc25fd2b57e57ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:54.151539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:54.156382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:54.158708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:54.162182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:54.162821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] PATH_INFO: `/v3/users/a7f0164cc4b049938115f1817ee885ea` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:54.164984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f0164cc4b049938115f1817ee885ea)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:54.168116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:54.227908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:54.404390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f0164cc4b049938115f1817ee885ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.405113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f0164cc4b049938115f1817ee885ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.471555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d7e6a5d1e143849fc25fd2b57e57ff', 'request_id': 'req-881a3abe-3391-4c3a-ba13-67ddf826988c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.496116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f0164cc4b049938115f1817ee885ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.513325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f0164cc4b049938115f1817ee885ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.515160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f0164cc4b049938115f1817ee885ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.550328 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2395/4787] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:53 2022] DELETE /identity/v3/users/a7f0164cc4b049938115f1817ee885ea => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:54.553405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:54.561585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:54.600792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d7e6a5d1e143849fc25fd2b57e57ff', 'request_id': 'req-881a3abe-3391-4c3a-ba13-67ddf826988c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.623097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d7e6a5d1e143849fc25fd2b57e57ff', 'request_id': 'req-881a3abe-3391-4c3a-ba13-67ddf826988c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.656991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:54.657805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project 91d7e6a5d1e143849fc25fd2b57e57ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:54.658347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.659553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881a3abe-3391-4c3a-ba13-67ddf826988c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:54.663038 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2393/4788] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:53 2022] DELETE /identity/v3/projects/91d7e6a5d1e143849fc25fd2b57e57ff => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:54.669403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:54.669790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:54.670231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:54.702399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:54.714595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:54.736881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2394/4789] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:54.737882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:54.747055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:54.753808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266c8c2-85a8-491e-a608-2bbca04cada0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:54.766464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:54.767820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:54.769086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:54.773649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] PATH_INFO: `/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:54.776746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05dae9d3b6534fa5a7a8f6abe7ac10e5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:54.783058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:54.858711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:54.895129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3614f0-5929-4f43-bc9a-05cd0c4c8193 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:54.904129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:54.904786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:54.905067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:54.905360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:54.907240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:54.909179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:54.944104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'request_id': 'req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:55.035202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'request_id': 'req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:55.041734 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2395/4790] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:37:54 2022] POST /identity/v3/projects => generated 329 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:55.042978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.048060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:55.049518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05dae9d3b6534fa5a7a8f6abe7ac10e5', 'request_id': 'req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:55.068202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] The token cache is being invalidate because project 05dae9d3b6534fa5a7a8f6abe7ac10e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:55.069092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:55.071584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:55.074865 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2396/4791] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:54 2022] DELETE /identity/v3/projects/05dae9d3b6534fa5a7a8f6abe7ac10e5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:55.081806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.084047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:55.169157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804fbd5-11c9-40c4-a962-407e30f5bcbf tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.173402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.175362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.175362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.175362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.181237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:55.193823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:55.222804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:55.275722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.277329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814bf0f-e787-45fa-8b36-9c98bdd891ee service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.289928 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2396/4792] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:55.291384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a239-3c4b-4a2e-9f94-99eb769d00d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.291667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a239-3c4b-4a2e-9f94-99eb769d00d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.291941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a239-3c4b-4a2e-9f94-99eb769d00d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.310378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6d1fb-7e4c-41fa-95d3-ce8124abe348 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.322529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c644a239-3c4b-4a2e-9f94-99eb769d00d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:55.323787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c644a239-3c4b-4a2e-9f94-99eb769d00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:55.343475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2397/4793] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:55.352846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.353391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.353838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.401851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:55.404066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:55.415071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.415444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2398/4794] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:55.420479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.420479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.420479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.420479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.421166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.421270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.431937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e69f4-f2d9-43db-b7fe-37bda3705f00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.437187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.437918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.438142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.438425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.439127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:55.439448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.441034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.454607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2399/4795] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:55.459265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.483483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18947646-269a-434d-8167-346afe0e18ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.491097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.491465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.491809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.492117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.492829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.495217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.510827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2397/4796] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/users => generated 416 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:55.515724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.531817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7131a3-883a-443e-b0c8-9a41ab7ca025 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.537244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.538019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.538381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.539336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.540731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.542682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.606598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:55.676324 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2400/4797] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:55.681202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.695684 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2398/4798] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/roles => generated 244 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:55.703420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:55.737805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac418203-e828-4aac-a721-f5535a84758f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.755553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:55.856598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.856937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b147f-40da-4846-b51e-ad2140223c67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:55.857379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.857526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.857773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.858574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.861076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.870205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:55.870855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:55.872215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:55.872215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:55.872215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:55.874054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:55.897019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:55.992125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2399/4799] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/roles => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:55.996083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.011372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a47d-9ace-41e9-ba1e-68c953e33403 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.017584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.018521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.018898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.019182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/61bf7eafd3a94563a94f1447dbc58776/users/5302a40c028a4bfcb3c5b5d8167e3253/roles/9dba3f195e5944fb88021d733de52594` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.020782 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2401/4800] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:55 2022] POST /identity/v3/users => generated 285 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:56.022178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.025375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.044036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b96c-d65c-4531-8173-fd6017fc3701 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.050347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.051509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.051754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=61bf7eafd3a94563a94f1447dbc58776, user_id=5302a40c028a4bfcb3c5b5d8167e3253, role_id=9dba3f195e5944fb88021d733de52594)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.052241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.052584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] PATH_INFO: `/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.053808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2764f613cfe24ad4b610ffe80a0c02ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.055565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.056178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.206742 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2400/4801] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:55 2022] PUT /identity/v3/projects/61bf7eafd3a94563a94f1447dbc58776/users/5302a40c028a4bfcb3c5b5d8167e3253/roles/9dba3f195e5944fb88021d733de52594 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:37:56.209212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.227285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2764f613cfe24ad4b610ffe80a0c02ce', 'request_id': 'req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.292215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76ebfa-8114-42d9-99ce-81f5634d0123 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.341925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2764f613cfe24ad4b610ffe80a0c02ce', 'request_id': 'req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.348394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2764f613cfe24ad4b610ffe80a0c02ce', 'request_id': 'req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.368955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] The token cache is being invalidate because project 2764f613cfe24ad4b610ffe80a0c02ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:56.369243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.371133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.379552 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2402/4802] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:56 2022] DELETE /identity/v3/projects/2764f613cfe24ad4b610ffe80a0c02ce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:56.379552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.379552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.380860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.381635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.381783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.382009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.383272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.384906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b792-3240-497c-901f-42548eb0373b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.396559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2401/4803] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:56 2022] GET /identity/v3/roles => generated 1892 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:56.397956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.398211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.398492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.419472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:56.421507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.441473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2402/4804] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:56.442451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.443894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.457231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594630-3856-4878-8e23-b3abefa8d02f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.462872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.463485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.463764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.464034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.464899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.467582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbf962-5cbf-47f8-aa98-15198361eccb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.471370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ca18-90ae-4490-9ac1-694fd7ddbdf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.489039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2403/4805] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:56 2022] GET /identity/v3/roles => generated 1892 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:56.490689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.490987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.492480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.498533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.499917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.499917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.500189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/61bf7eafd3a94563a94f1447dbc58776/users/5302a40c028a4bfcb3c5b5d8167e3253/roles/e3a6224e91b84b65a6f8e7aa69dfeb5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.507641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=61bf7eafd3a94563a94f1447dbc58776, user_id=5302a40c028a4bfcb3c5b5d8167e3253, role_id=e3a6224e91b84b65a6f8e7aa69dfeb5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.510327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.518218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:56.519672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.530791 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2404/4806] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:56.532012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.533707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.552458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54074ef7-c2be-46bf-a507-87e893f87260 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.559005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.559718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.560659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.561041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] PATH_INFO: `/v3/users/c1f6dc86d8094a53ac0e58c3a59e7e5c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.562294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f6dc86d8094a53ac0e58c3a59e7e5c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.564421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.583892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2403/4807] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:56 2022] PUT /identity/v3/projects/61bf7eafd3a94563a94f1447dbc58776/users/5302a40c028a4bfcb3c5b5d8167e3253/roles/e3a6224e91b84b65a6f8e7aa69dfeb5e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:56.583892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.665905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe64f-6201-444d-a4c7-638119a69ad2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:56.667562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:56.668228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:56.668557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:56.668983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] PATH_INFO: `/v3/projects/0e9c7e2826044b248b78712d6a76ba3f/users/21f7b6caf0b44432a3d56feec4182163/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:56.689865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9c7e2826044b248b78712d6a76ba3f, user_id=21f7b6caf0b44432a3d56feec4182163, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:56.700591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:56.804188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f6dc86d8094a53ac0e58c3a59e7e5c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.805396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f6dc86d8094a53ac0e58c3a59e7e5c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.855569 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2404/4808] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:56 2022] PUT /identity/v3/projects/0e9c7e2826044b248b78712d6a76ba3f/users/21f7b6caf0b44432a3d56feec4182163/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:56.863843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.865581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.880565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f6dc86d8094a53ac0e58c3a59e7e5c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.900384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f6dc86d8094a53ac0e58c3a59e7e5c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.901259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f6dc86d8094a53ac0e58c3a59e7e5c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:56.914478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:56.924080 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2405/4809] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:56 2022] DELETE /identity/v3/users/c1f6dc86d8094a53ac0e58c3a59e7e5c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:56.924080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:56.926886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:56.953224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018c9a6-2e2b-4f71-83ef-5fe87a6215e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.025812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98dcc0-3034-4fda-abd1-bb9a5b285454 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.026058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.026706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.027125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.027811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.028554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:57.028864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.030898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1566c-7ccc-4065-8da9-26feefb5adeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.033447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.034444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.035414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.036023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.037717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.040615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab224fc-291b-49b7-ad89-beed0c69a0f5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.052338 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2405/4810] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:57.054019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.055190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.055781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.086219 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2406/4811] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:56 2022] GET /identity/v3/users => generated 8046 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:57.088242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf06e4-d9f2-464f-bff8-16a3ff6bfe0d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.088534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf06e4-d9f2-464f-bff8-16a3ff6bfe0d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.088808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf06e4-d9f2-464f-bff8-16a3ff6bfe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.092923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] MFA Rules not processed for user `21f7b6caf0b44432a3d56feec4182163`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:57.094806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.098121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.156530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a0cf06e4-d9f2-464f-bff8-16a3ff6bfe0d None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:57.159182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0cf06e4-d9f2-464f-bff8-16a3ff6bfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.182786 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2406/4812] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:57.191647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.204028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419560-bdda-4a92-a6fa-a1dd97c9095d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.209453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.210064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.211261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.211803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.212453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.214400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.232114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2407/4813] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:57.233721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.234006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.234771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.240134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.296376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] MFA Rules not processed for user `5302a40c028a4bfcb3c5b5d8167e3253`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:57.297588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.310959 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2407/4814] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:57.312075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.316218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.388816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2408/4815] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:57.388816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.388816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.389820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.399276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837223-cea3-4e5e-bf15-59d0aef38c6e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.403529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.404166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.404446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.404717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.405382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:create_application_credential(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.406525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.409204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183664d3-43d5-46ca-95e9-7621fa237741 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.440164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.494584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.496146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.496879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.497370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] PATH_INFO: `/v3/projects/24a512ed75fe47988b588b5fe104c853` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.499091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a512ed75fe47988b588b5fe104c853)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.501444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.577656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.617964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2408/4816] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials => generated 921 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:57.618649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.633464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a512ed75fe47988b588b5fe104c853', 'request_id': 'req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:57.641282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6fa6-2eed-45d3-bd15-413a92feeb0f tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.708708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a512ed75fe47988b588b5fe104c853', 'request_id': 'req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:57.715231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.716349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a512ed75fe47988b588b5fe104c853', 'request_id': 'req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:57.717671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.717955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.718234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.718911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.729428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23a8a1-d10e-4b1f-9dc5-dc187ad28942 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.741608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] The token cache is being invalidate because project 24a512ed75fe47988b588b5fe104c853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:57.741906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:57.744255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:57.751256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2409/4817] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:37:57 2022] DELETE /identity/v3/projects/24a512ed75fe47988b588b5fe104c853 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:57.751256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.753518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.846046 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2409/4818] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:57.847625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.847918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.848248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.853399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.868430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9433f7-1bf7-40a9-bbe8-4a0fdda4eb6b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:57.870788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] MFA Rules not processed for user `5302a40c028a4bfcb3c5b5d8167e3253`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:57.871958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.874195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:57.878808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.878808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.878808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:57.878808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.947075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:57.947257 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2410/4819] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:57.948335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:57.948878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c8a8-32fd-4578-b656-31183ef102a0 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:57.950578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:57.955171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:57.959518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2410/4820] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:37:57.971711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:57.971996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:57.973867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.012371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:58.013996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.043051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2411/4821] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:58.044278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.047228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.063132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3b2de-390b-4cba-a42a-cd893f81497e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.073242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528c071-f1df-4f25-88ca-31da510bd9a5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.075070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.076881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.077586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.077837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/e5068b3fcc45425da5bb469811080083` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.083506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.084456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.084456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.084632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:delete_access_rule(user_id=21f7b6caf0b44432a3d56feec4182163, access_rule_id=e5068b3fcc45425da5bb469811080083)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.084717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.085325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.088971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.089272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.113824 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2412/4822] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:58 2022] GET /identity/v3/roles => generated 1892 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:58.114790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-68dfa863-71bb-4767-b802-e81cd29cb542 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.delete(ref) Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:37:58.130493 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:37:58.131845 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._synchronize( Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise AssertionError( Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 31 14:37:58.133641 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:37:58.134835 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 31 14:37:58.136046 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:37:58.144382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2411/4823] 10.222.0.13 () {58 vars in 1362 bytes} [Mon Oct 31 14:37:57 2022] DELETE /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/e5068b3fcc45425da5bb469811080083 => generated 89 bytes in 196 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:37:58.146315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186613e-e40e-4cd2-9ccf-d782a94606f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.147145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.148508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.148943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.154956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5302a40c028a4bfcb3c5b5d8167e3253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61bf7eafd3a94563a94f1447dbc58776', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753911501', 'tempest-NotDelegatedRole-172799883'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.156243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.157311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.157443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.158297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] RBAC: Authorizing `identity:create_trust()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.160120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.185198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:58.187633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.198233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2412/4824] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:58.200854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.212426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa00137-2a77-481e-abc4-65afe1244a58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.217309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.223053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.223894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.224330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.224755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.225556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.228080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.242891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2413/4825] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:58 2022] GET /identity/v3/roles => generated 1892 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:58.244487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.248357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.262081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b10e7-eebb-4907-bc6a-7c26a42a92eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.268033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.268905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.271465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.271465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials/a60b128a63b64f1284a44fcab4c7c760` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.287274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:delete_application_credential(user_id=21f7b6caf0b44432a3d56feec4182163, application_credential_id=a60b128a63b64f1284a44fcab4c7c760)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.289411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 31 14:37:58.344263 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 31 14:37:58.345330 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 31 14:37:58.346519 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:37:58.350680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2413/4826] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:37:58 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 236 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:37:58.352361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.367592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2b8cf-9f8f-468b-8671-916075da563c tempest-TrustsV3TestJSON-1138899066 tempest-user-1091038847] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.375678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.376356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.376637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.376933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.377621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:37:58.377934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.379584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.394649 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2414/4827] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:58.399384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.409349 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2414/4828] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:37:58 2022] DELETE /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials/a60b128a63b64f1284a44fcab4c7c760 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:58.412920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8f3a5-7dcb-47cc-9ebe-48ad1e057ed5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.413159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.417121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.423028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.424455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.425629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.426370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] PATH_INFO: `/v3/projects/91c9cc66dc6a40179b3a306cd3f9304a/users/2dac64cc9d10438c802bcd594e6bda86/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.458270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c9cc66dc6a40179b3a306cd3f9304a, user_id=2dac64cc9d10438c802bcd594e6bda86, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.462399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.519122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7b68-b2cc-4b71-838b-b02d6795c4eb tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.525314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.529094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.529912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.530234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.530528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/e3a6224e91b84b65a6f8e7aa69dfeb5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.532845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e3a6224e91b84b65a6f8e7aa69dfeb5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.535063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.562042 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2415/4829] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:58 2022] PUT /identity/v3/projects/91c9cc66dc6a40179b3a306cd3f9304a/users/2dac64cc9d10438c802bcd594e6bda86/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:58.563131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.660656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2986-2986-4bdb-b1f3-78da11491f8d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.669759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.670569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.671525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.671878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.672853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.675650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fb13-7fe1-431c-ab00-6033f2cdf371 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:58.701277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.727666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role e3a6224e91b84b65a6f8e7aa69dfeb5e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:58.728210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:58.729332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:58.734927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2415/4830] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:58 2022] DELETE /identity/v3/roles/e3a6224e91b84b65a6f8e7aa69dfeb5e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:58.736884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:58.740255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.815008 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2416/4831] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:37:58 2022] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:58.816546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.817226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.817665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.853160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.871774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:37:58.875013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:58.880290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.882402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a278-b086-4e32-b693-edae86a2e437 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:58.902888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:58.985291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:58.986868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:58.987474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:58.988005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:58.990610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:list_access_rules(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:58.994803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.009056 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2416/4832] 10.222.0.13 () {58 vars in 1260 bytes} [Mon Oct 31 14:37:58 2022] GET /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules => generated 369 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:59.011028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.017568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2417/4833] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:37:59.017568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.017568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.018839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.034279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.050782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09765868-52de-4917-8e25-c5aee6ec9128 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.057517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.059959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.060927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.061402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.062586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.062940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.068888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.136203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1b3bb-f914-46e3-8cee-deb34253a505 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.136766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2418/4834] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:37:59 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:59.138729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.142698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.143421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.143703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.144008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/9dba3f195e5944fb88021d733de52594` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.146120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9dba3f195e5944fb88021d733de52594)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.147940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.161612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b960-cfca-4c1f-af23-3a8e7efaf687 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.167743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.168414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.168698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.168977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/e5068b3fcc45425da5bb469811080083` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.170286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:delete_access_rule(user_id=21f7b6caf0b44432a3d56feec4182163, access_rule_id=e5068b3fcc45425da5bb469811080083)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.171746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.230124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.274394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2419/4835] 10.222.0.13 () {58 vars in 1362 bytes} [Mon Oct 31 14:37:59 2022] DELETE /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/e5068b3fcc45425da5bb469811080083 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:59.276611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.280530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.367662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dadf87-3cf6-48bd-b9bf-d2d3cdc19e18 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.373368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.373596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.374283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.374490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.374801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.380012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role 9dba3f195e5944fb88021d733de52594 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:37:59.380563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:59.383873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:37:59.386276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.386505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2417/4836] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:59 2022] DELETE /identity/v3/roles/9dba3f195e5944fb88021d733de52594 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:37:59.387593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.388208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.389453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.401205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2420/4837] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:37:59.402186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.414564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033cc1-06eb-458b-b958-d03bea60b2b5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.498533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e3561-1414-4014-8cf4-dd837c085342 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.503268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.503927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.504207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.504481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.505140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.507085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.525589 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2418/4838] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:59.525589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.527393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.531436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.532171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.532457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.532730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.534104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:list_access_rules(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.536139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.543079 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2421/4839] 10.222.0.13 () {58 vars in 1260 bytes} [Mon Oct 31 14:37:59 2022] GET /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules => generated 158 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:37:59.546467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.559627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0020e9d-af5c-4c3f-b593-4368d738bd76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.564812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.565429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.565704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.565975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.566639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.569333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.589125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2422/4840] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:37:59.589125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.604259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:37:59.630085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8681b3-4522-47a3-bfa5-05e36f9b9041 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.637761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.638178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535126c2-2966-4b94-9c6e-fa8ac271bc3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:37:59.639126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.639585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.643606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:37:59.644403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:37:59.644784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:37:59.645135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/5302a40c028a4bfcb3c5b5d8167e3253` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.646575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5302a40c028a4bfcb3c5b5d8167e3253)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.647135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:37:59.648498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:create_application_credential(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:37:59.649547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.650608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:37:59.685344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.749293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:37:59.971057 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2423/4841] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:37:59 2022] POST /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials => generated 921 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:37:59.972374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:37:59.991281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa8df-2b00-4733-b3f9-b3b8a8947d75 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.010558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:00.013232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.015059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.016497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] PATH_INFO: `/v3/projects/30ca5028542442e381f150df0bb94afa/users/02b67c9f5d604a028199c5f133f891ec/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.058385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ca5028542442e381f150df0bb94afa, user_id=02b67c9f5d604a028199c5f133f891ec, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:00.060203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5302a40c028a4bfcb3c5b5d8167e3253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.061507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:00.065443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5302a40c028a4bfcb3c5b5d8167e3253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.173879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2424/4842] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:37:59 2022] PUT /identity/v3/projects/30ca5028542442e381f150df0bb94afa/users/02b67c9f5d604a028199c5f133f891ec/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:00.173879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.177284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:00.182794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5302a40c028a4bfcb3c5b5d8167e3253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.201860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5302a40c028a4bfcb3c5b5d8167e3253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.202797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ae86ce2-d510-4d2e-b7d3-a1507386e431 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5302a40c028a4bfcb3c5b5d8167e3253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.233852 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2419/4843] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:37:59 2022] DELETE /identity/v3/users/5302a40c028a4bfcb3c5b5d8167e3253 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:00.237511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.238111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.238601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.275327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:00.285971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:00.289801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:00.330538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885642-7de1-4276-a0c9-857d6089bb49 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.388800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:00.407856 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2420/4844] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:00.409008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.417378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:00.470555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:00.473548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.473548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.473548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.475135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:list_access_rules(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:00.478887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:00.492857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2425/4845] 10.222.0.13 () {58 vars in 1260 bytes} [Mon Oct 31 14:38:00 2022] GET /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules => generated 369 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:00.493814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.497269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:00.584827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83552f-643d-4f40-9c7f-5c6a9c7fed19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.597951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:00.603438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.603438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.603438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/61bf7eafd3a94563a94f1447dbc58776` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.603438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=61bf7eafd3a94563a94f1447dbc58776)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:00.603920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a6744-d5d7-4ad4-985d-b6edbe98d8fd tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.604619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:00.608327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:00.609447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.609791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.610119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.632635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:00.632966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:00.649721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2426/4846] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:00.651347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.655210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:00.672658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2c81-1729-4963-8099-84098e5941a5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.686971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:00.689558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:00.689558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:00.689558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:00.692630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:create_application_credential(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:00.694606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:00.810559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bf7eafd3a94563a94f1447dbc58776', 'request_id': 'req-821c5611-53c5-462c-863c-b5054c7111c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.878039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2427/4847] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:38:00 2022] POST /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/application_credentials => generated 921 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:00.884045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.899208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:00.900500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bf7eafd3a94563a94f1447dbc58776', 'request_id': 'req-821c5611-53c5-462c-863c-b5054c7111c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.908863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bf7eafd3a94563a94f1447dbc58776', 'request_id': 'req-821c5611-53c5-462c-863c-b5054c7111c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.914686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475ca3-0050-46a6-9f7a-7ef386898c76 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:00.942770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project 61bf7eafd3a94563a94f1447dbc58776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:00.943258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.945449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:00.951624 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2421/4848] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:00 2022] DELETE /identity/v3/projects/61bf7eafd3a94563a94f1447dbc58776 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:00.957226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:00.958897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:01.084625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21f7b6caf0b44432a3d56feec4182163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e9c7e2826044b248b78712d6a76ba3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.086324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.086646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.086921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/1c394dee5256412c9e35c0baa8d66134` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.090840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorizing `identity:get_access_rule(user_id=21f7b6caf0b44432a3d56feec4182163, access_rule_id=1c394dee5256412c9e35c0baa8d66134)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.095295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.112373 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2428/4849] 10.222.0.13 () {58 vars in 1359 bytes} [Mon Oct 31 14:38:00 2022] GET /identity/v3/users/21f7b6caf0b44432a3d56feec4182163/access_rules/1c394dee5256412c9e35c0baa8d66134 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:01.113307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:01.121791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:01.123597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:01.165706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c5611-53c5-462c-863c-b5054c7111c4 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.190509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.193180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.195237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.195237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.198730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.207098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.275813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04191-6cfc-4733-874c-a06315fc3577 tempest-AccessRulesV3Test-864648088 tempest-AccessRulesV3Test-864648088-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.287007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.287007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.287007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.287007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] PATH_INFO: `/v3/users/21f7b6caf0b44432a3d56feec4182163` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.287439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f7b6caf0b44432a3d56feec4182163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.287529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.369598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2422/4850] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:38:00 2022] POST /identity/v3/projects => generated 328 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:01.371102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:01.504157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89240c48-031a-4e78-bbc6-33b19b69ab4f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.515581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.518529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.518529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.518529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.518529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.520178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.563746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:01.599487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f7b6caf0b44432a3d56feec4182163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:01.600192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f7b6caf0b44432a3d56feec4182163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:01.697880 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2423/4851] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:01 2022] POST /identity/v3/users => generated 416 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:01.703693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:01.709518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:01.728232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b90f5-fc27-4a62-98e1-ce00bf017e89 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.731176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f7b6caf0b44432a3d56feec4182163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:01.735058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.735867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.736246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.736672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.737443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.739214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.818339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2424/4852] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:38:01 2022] POST /identity/v3/roles => generated 243 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:01.822209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:01.837923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6324f6-c05f-4fdc-a93a-7a06373c623f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.844837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:01.857307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.857307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.857307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.857307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:01.857307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:01.959498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f7b6caf0b44432a3d56feec4182163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:01.961445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0ea28dcd-931f-4b3d-8c85-38d062b7393c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f7b6caf0b44432a3d56feec4182163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:01.964972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2425/4853] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:38:01 2022] POST /identity/v3/roles => generated 246 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:01.966077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:01.986195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a39d6-b121-4b70-973b-d146e8e7f8c7 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:01.993462 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2429/4854] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:01 2022] DELETE /identity/v3/users/21f7b6caf0b44432a3d56feec4182163 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:01.995691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:01.995978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:01.996251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:01.999471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:02.000450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:02.001001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:02.001468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/4bf32ceb2d1047aea89368dba9605317/users/bbc74f23b79a4d5785e256cb483653ab/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:02.034510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:02.039534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:02.108201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4bf32ceb2d1047aea89368dba9605317, user_id=bbc74f23b79a4d5785e256cb483653ab, role_id=cf97c4ee8ffe4a1f95a66a8bf939fcf0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:02.108976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:02.111337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:02.192224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2430/4855] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:02.193364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:02.195014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:02.222756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2426/4856] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:01 2022] PUT /identity/v3/projects/4bf32ceb2d1047aea89368dba9605317/users/bbc74f23b79a4d5785e256cb483653ab/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:02.223688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:02.383306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede52b6f-ec3d-4941-8b6e-12868ee7229d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:02.410350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1599d35-9cbd-476a-9e0c-f84b302e7e30 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:02.418235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:02.418989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:02.419270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:02.419549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/4bf32ceb2d1047aea89368dba9605317/users/bbc74f23b79a4d5785e256cb483653ab/roles/ebe9e09da4c14964ba0d8e4542f6532b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:02.441036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4bf32ceb2d1047aea89368dba9605317, user_id=bbc74f23b79a4d5785e256cb483653ab, role_id=ebe9e09da4c14964ba0d8e4542f6532b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:02.445907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:02.461037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:02.604190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:02.605980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:02.607527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:02.608652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:02.624805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2427/4857] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:02 2022] PUT /identity/v3/projects/4bf32ceb2d1047aea89368dba9605317/users/bbc74f23b79a4d5785e256cb483653ab/roles/ebe9e09da4c14964ba0d8e4542f6532b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:02.629023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:02.643201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:02.801490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:02.804101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026107ff-d352-4fea-9581-8b8bdb5e92c7 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:02.846107 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2431/4858] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:02.881495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff43985-a340-403c-87fb-b669fc40fe08 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:02.891461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:02.892200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:02.892479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:02.892777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:02.893749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:02.894888 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:38:02.894888 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:38:02.894888 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:38:02.896413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02391c-b568-40f6-a4cf-f3b43e196dc8 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:02.960866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2428/4859] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:02 2022] GET /identity/v3/users => generated 8332 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:02.962284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:02.963330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:02.963330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.018602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] MFA Rules not processed for user `bbc74f23b79a4d5785e256cb483653ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:03.019968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:03.098196 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2432/4860] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:03.109310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.109607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.110024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.132857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] MFA Rules not processed for user `bbc74f23b79a4d5785e256cb483653ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:03.134325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:03.141762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2429/4861] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:03.146247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.156101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb106b5-3955-48bc-bfd5-56d960fddf7d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.160249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.160863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.161145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.161475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.162146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:create_trust()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.164185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.255721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:03.355407 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2433/4862] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:38:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:03.356703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.387491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b8b8-310b-403f-a29b-f2273f18da99 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.408915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.411211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.411211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.411673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.440099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:get_trust(trust_id=af250dd348344674976ccc84fad6da32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.449449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.469277 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2430/4863] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:38:03 2022] GET /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32 => generated 833 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:03.470219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.492306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bebc-1663-4781-aa8a-0fc6961bb49f tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.507986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.508806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.509183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.509555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.530947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=af250dd348344674976ccc84fad6da32)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.537725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.561083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.578041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94944e5b-a0a3-4827-a219-bb6c9252c6e1 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.579673 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2434/4864] 10.222.0.13 () {58 vars in 1269 bytes} [Mon Oct 31 14:38:03 2022] GET /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles => generated 370 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:03.596432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.600842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.601447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.603475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.627555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:get_role_for_trust(trust_id=af250dd348344674976ccc84fad6da32, role_id=cf97c4ee8ffe4a1f95a66a8bf939fcf0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.631899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.658572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.659341 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2431/4865] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:38:03 2022] GET /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0 => generated 243 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:38:03.676036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690775fc-cf56-4e12-9c96-4b8545c62801 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.686657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.687611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.688104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.688480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.697842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:get_role_for_trust(trust_id=af250dd348344674976ccc84fad6da32, role_id=cf97c4ee8ffe4a1f95a66a8bf939fcf0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.702254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.726128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2435/4866] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:38:03 2022] HEAD /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:03.733037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.754411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3b13-46a1-4040-ab1d-1be0f994a3d9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.771282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.772160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.772574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.773500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/ebe9e09da4c14964ba0d8e4542f6532b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.802779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:get_role_for_trust(trust_id=af250dd348344674976ccc84fad6da32, role_id=ebe9e09da4c14964ba0d8e4542f6532b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.811585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Could not find role: ebe9e09da4c14964ba0d8e4542f6532b.: keystone.exception.RoleNotFound: Could not find role: ebe9e09da4c14964ba0d8e4542f6532b. Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:38:03.849491 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ebe9e09da4c14964ba0d8e4542f6532b. Oct 31 14:38:03.852779 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:03.857687 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2432/4867] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:38:03 2022] GET /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/ebe9e09da4c14964ba0d8e4542f6532b => generated 110 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:38:03.859973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.876290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb0e7f-94fe-4385-bdf8-632ab46373b8 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:03.893921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:03.897453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:03.902205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:03.910246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/ebe9e09da4c14964ba0d8e4542f6532b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:03.935948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:get_role_for_trust(trust_id=af250dd348344674976ccc84fad6da32, role_id=ebe9e09da4c14964ba0d8e4542f6532b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:03.942676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:03.946103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Could not find role: ebe9e09da4c14964ba0d8e4542f6532b.: keystone.exception.RoleNotFound: Could not find role: ebe9e09da4c14964ba0d8e4542f6532b. Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:38:03.982952 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ebe9e09da4c14964ba0d8e4542f6532b. Oct 31 14:38:03.984081 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:38:03.997307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:03.997748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2436/4868] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:38:03 2022] HEAD /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32/roles/ebe9e09da4c14964ba0d8e4542f6532b => generated 0 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 31 14:38:04.026176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b027b-e826-4fd5-8b15-68e7103ed8e9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:04.035067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:04.035725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:04.036005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:04.036280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:04.064523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorizing `identity:delete_trust(trust_id=af250dd348344674976ccc84fad6da32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:04.066042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:04.099535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:04.222751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'af250dd348344674976ccc84fad6da32', 'request_id': 'req-7d0be527-cbdb-41b5-9405-667851b752ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.223706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'af250dd348344674976ccc84fad6da32', 'request_id': 'req-7d0be527-cbdb-41b5-9405-667851b752ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.224578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'af250dd348344674976ccc84fad6da32', 'request_id': 'req-7d0be527-cbdb-41b5-9405-667851b752ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.234430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:04.332117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2433/4869] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 14:38:03 2022] DELETE /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:04.336110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:04.338054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:04.365695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd785a-ff39-4bfa-905f-23ddb3239df9 tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:04.379967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbc74f23b79a4d5785e256cb483653ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf32ceb2d1047aea89368dba9605317', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-872675121', 'tempest-DelegatedRole-364681417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:04.388815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:04.388815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:04.388815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] PATH_INFO: `/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Could not find trust: af250dd348344674976ccc84fad6da32.: keystone.exception.TrustNotFound: Could not find trust: af250dd348344674976ccc84fad6da32. Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 14:38:04.411018 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: af250dd348344674976ccc84fad6da32. Oct 31 14:38:04.419356 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:38:04.420868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:04.420971 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2437/4870] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:38:04 2022] GET /identity/v3/OS-TRUST/trusts/af250dd348344674976ccc84fad6da32 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:38:04.424284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:04.466368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be527-cbdb-41b5-9405-667851b752ad tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:04.485030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:04.487833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:04.489784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:04.490361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/ebe9e09da4c14964ba0d8e4542f6532b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:04.495695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ebe9e09da4c14964ba0d8e4542f6532b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:04.501806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:04.504012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:04.506036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:04.661847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105ace5-ce23-4fdf-8630-d6d0a9b6fb4d tempest-TrustsV3TestJSON-703150873 tempest-user-1229503877] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:04.680761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:04.684254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:04.684254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:04.684254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] PATH_INFO: `/v3/projects/0e9c7e2826044b248b78712d6a76ba3f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:04.688378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9c7e2826044b248b78712d6a76ba3f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:04.694382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:04.723259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role ebe9e09da4c14964ba0d8e4542f6532b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:04.724247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.725313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.730561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2434/4871] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:04 2022] DELETE /identity/v3/roles/ebe9e09da4c14964ba0d8e4542f6532b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:04.734467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:04.738822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:04.890990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9c7e2826044b248b78712d6a76ba3f', 'request_id': 'req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.950386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217164b-3171-4a5c-984f-aad50eddf21a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:04.977881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9c7e2826044b248b78712d6a76ba3f', 'request_id': 'req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:04.978350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:04.992363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9c7e2826044b248b78712d6a76ba3f', 'request_id': 'req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.030772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:05.031567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.032016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.032393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.033336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] The token cache is being invalidate because project 0e9c7e2826044b248b78712d6a76ba3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:05.033644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.034283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cf97c4ee8ffe4a1f95a66a8bf939fcf0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:05.036875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:05.039288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfd38c0b-6901-4bb7-b4c2-0c518faaffcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.046729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2438/4872] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:04 2022] DELETE /identity/v3/projects/0e9c7e2826044b248b78712d6a76ba3f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:05.053663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982977-6be5-4658-912a-84d8927a74bc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.055368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982977-6be5-4658-912a-84d8927a74bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.055818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982977-6be5-4658-912a-84d8927a74bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.115570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-01982977-6be5-4658-912a-84d8927a74bc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:05.121167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01982977-6be5-4658-912a-84d8927a74bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:05.319445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role cf97c4ee8ffe4a1f95a66a8bf939fcf0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:05.319915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.321128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.325033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2435/4873] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:04 2022] DELETE /identity/v3/roles/cf97c4ee8ffe4a1f95a66a8bf939fcf0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:05.330401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:05.332728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:05.342784 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2439/4874] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:05.345526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.347084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.348660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.407822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:05.412778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:05.578327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2b76-8105-49cf-adee-0ae5f69920d5 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:05.592785 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2440/4875] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:05.598507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:05.617796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:05.617796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.617796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.618170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/bbc74f23b79a4d5785e256cb483653ab` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.619625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88713-fe55-4096-a5c4-81ef1fe56a8d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:05.626534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbc74f23b79a4d5785e256cb483653ab)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:05.631869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:05.635884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:05.636916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.638597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.639138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.640267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:05.640686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:05.642454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:05.679887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:05.682720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2441/4876] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:05.687404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:05.758374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7bf1-62a8-446c-a9ce-2b02b549c862 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:05.781950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:05.788162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:05.792877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:05.793235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:05.796897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:05.805604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc74f23b79a4d5785e256cb483653ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.807726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc74f23b79a4d5785e256cb483653ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.809490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:05.931398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc74f23b79a4d5785e256cb483653ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.948138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc74f23b79a4d5785e256cb483653ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.951452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc74f23b79a4d5785e256cb483653ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:05.955230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:05.976426 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2436/4877] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:05 2022] DELETE /identity/v3/users/bbc74f23b79a4d5785e256cb483653ab => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:05.980774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:05.983002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:05.987239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2442/4878] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:05 2022] POST /identity/v3/projects => generated 393 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:05.991207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:05.995514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:06.122432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e5ae-3e46-48b2-a530-0ca2f4c5105f tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:06.205085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac7fda-0032-411e-a101-8901b0acaedf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:06.222260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:06.222922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.223201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.223475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:06.224113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:06.231222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:06.253413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:06.254179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.255376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.255904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/4bf32ceb2d1047aea89368dba9605317` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:06.258535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bf32ceb2d1047aea89368dba9605317)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:06.263328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:06.339522 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2443/4879] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:05 2022] POST /identity/v3/users => generated 297 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:06.343710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:06.365569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:06.371319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751a52-c8b2-4030-bb9c-3bc2e4330944 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:06.388971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:06.390381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.391166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.402050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:06.410900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:06.413053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:06.441509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2444/4880] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:06.447098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:06.478475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad229bac-c049-49e0-9228-c5dc3092ee61 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:06.542191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf32ceb2d1047aea89368dba9605317', 'request_id': 'req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:06.634438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf32ceb2d1047aea89368dba9605317', 'request_id': 'req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:06.643445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf32ceb2d1047aea89368dba9605317', 'request_id': 'req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:06.681990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:06.682646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.683987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.684271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:06.684943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:06.690867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:06.697275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project 4bf32ceb2d1047aea89368dba9605317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:06.698259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:06.702732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:06.703263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2437/4881] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:05 2022] DELETE /identity/v3/projects/4bf32ceb2d1047aea89368dba9605317 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:06.710910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:06.723576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:06.735675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2445/4882] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:06.736807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:06.743279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:06.777937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d347723-662a-4ba1-a07b-9ead10f24ba3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:06.792157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:06.795629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.795629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.795629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] PATH_INFO: `/v3/projects/b02246fcee114c439bf5f66a27b06875/users/0f338321146748f290897a050e12e8f7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:06.847035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02246fcee114c439bf5f66a27b06875, user_id=0f338321146748f290897a050e12e8f7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:06.858933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05a781-a148-4d54-8262-9917d4cea303 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:06.969484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2446/4883] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:06 2022] PUT /identity/v3/projects/b02246fcee114c439bf5f66a27b06875/users/0f338321146748f290897a050e12e8f7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:06.982744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:06.983215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:06.983669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.007688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8baa43-9806-46b8-8fa6-5bdf726ccd58 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.035356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:07.058910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] MFA Rules not processed for user `0f338321146748f290897a050e12e8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:07.071487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:07.190873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.191499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.191942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.192125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.192778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.195715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.252253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2447/4884] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:07.256638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:07.270826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04e1e-deff-4f91-993d-9b75bd0a3736 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.275043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:07.278914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.279607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.282992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.282992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.282992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.282992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.336384 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2438/4885] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:38:06 2022] POST /identity/v3/projects => generated 326 bytes in 626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:07.337633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:07.514464 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2448/4886] 10.222.0.13 () {60 vars in 1314 bytes} [Mon Oct 31 14:38:07 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 789 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:07.517458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f4db7-c6be-4e6c-bb47-1553f4156a0a tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.518373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:07.541937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.545425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.547024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.547617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.552691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122bb8-70e5-4234-bde2-f290c1e2baf8 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.553074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.557155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.651225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:07.683456 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2439/4887] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:07 2022] POST /identity/v3/users => generated 416 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:07.687630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:07.708554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:07.717670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da385-d187-468a-a549-5202dfda59f9 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.721344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.722416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.722881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.723894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/772d941bbc8e42af9b9b92f0a58f4138` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.738010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.739552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.739911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.740257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.741152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.747719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.755266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:get_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=772d941bbc8e42af9b9b92f0a58f4138)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.761841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c737028-eda8-474c-af63-2ddb602c3b2f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.770059 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2449/4888] 10.222.0.13 () {58 vars in 1392 bytes} [Mon Oct 31 14:38:07 2022] GET /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/772d941bbc8e42af9b9b92f0a58f4138 => generated 689 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:07.774019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.774522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.774906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.795064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] MFA Rules not processed for user `0f338321146748f290897a050e12e8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:07.797767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:07.827981 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2440/4889] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:38:07 2022] POST /identity/v3/roles => generated 243 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:07.835631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:07.857769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605978c-e9e4-46b0-8ba7-2310168fa7c2 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:07.874871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:07.877751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:07.878114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:07.879982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:07.880817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:07.887693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:07.908457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:07.999912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2441/4890] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:38:07 2022] POST /identity/v3/roles => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:08.002798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:08.003588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:08.023018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23d70-fa43-4e25-ab5a-2ac1730be532 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:08.034150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:08.035601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.036054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.036597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/c97be16ef3214c048038063b760ff3e5/users/0f5a1de956a24a73b1f3bbb1cb448b67/roles/dbb64b5a4d4840bd9ca42e9e60a867e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.065605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c97be16ef3214c048038063b760ff3e5, user_id=0f5a1de956a24a73b1f3bbb1cb448b67, role_id=dbb64b5a4d4840bd9ca42e9e60a867e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:08.072775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:08.146753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2450/4891] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:07 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 14:38:08.154969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:08.159509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2442/4892] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:07 2022] PUT /identity/v3/projects/c97be16ef3214c048038063b760ff3e5/users/0f5a1de956a24a73b1f3bbb1cb448b67/roles/dbb64b5a4d4840bd9ca42e9e60a867e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:08.163766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:08.297593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:08.331468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:08.438843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296c61-df32-4e7f-b95f-3bbce6aeb81b tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:08.442258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6481-e2b1-442f-8ce7-b7d3281872dd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:08.444817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:08.459486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:08.462707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.463181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.463770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/c97be16ef3214c048038063b760ff3e5/users/0f5a1de956a24a73b1f3bbb1cb448b67/roles/dc279010b4f14547adfa1f697da66cd3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.465635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:08.467712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.468017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.468302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/772d941bbc8e42af9b9b92f0a58f4138` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.470937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c97be16ef3214c048038063b760ff3e5, user_id=0f5a1de956a24a73b1f3bbb1cb448b67, role_id=dc279010b4f14547adfa1f697da66cd3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:08.477097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=772d941bbc8e42af9b9b92f0a58f4138)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:08.478643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:08.479031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:08.651895 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2443/4893] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:08 2022] PUT /identity/v3/projects/c97be16ef3214c048038063b760ff3e5/users/0f5a1de956a24a73b1f3bbb1cb448b67/roles/dc279010b4f14547adfa1f697da66cd3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:08.653776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:08.699187 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2451/4894] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:08 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/772d941bbc8e42af9b9b92f0a58f4138 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:08.704322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:08.725806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35f85-4216-4819-8f38-d6e6df15164d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:08.844888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:08.845186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.845572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.845964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.847143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:08.848611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:08.852436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b803e-d6b5-462a-82d2-21faa3e4ef40 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:08.869124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:08.871319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.873078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.873552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.874476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:08.881041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d6b6-8035-4b94-92fa-76b133c264ed tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:08.969027 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2444/4895] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:08 2022] GET /identity/v3/users => generated 8620 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:08.976524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af675b8c-ec43-4489-b857-91bd1e970a8b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:08.976524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af675b8c-ec43-4489-b857-91bd1e970a8b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:08.976524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af675b8c-ec43-4489-b857-91bd1e970a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:08.978913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:09.038278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2452/4896] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:38:08 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 921 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:09.049736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.066469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af675b8c-ec43-4489-b857-91bd1e970a8b None None] MFA Rules not processed for user `0f5a1de956a24a73b1f3bbb1cb448b67`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:09.067754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af675b8c-ec43-4489-b857-91bd1e970a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:09.075892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889074a-29c8-4845-9c13-bf37cfd4dc3c tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.096131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.096131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.096131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.096548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/a6741d28dc204cd3bd40fbba859de45c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.131880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=a6741d28dc204cd3bd40fbba859de45c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.134199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.144328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:09.281557 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2445/4897] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:09.286003 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2453/4898] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:09 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/a6741d28dc204cd3bd40fbba859de45c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:09.292076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.292457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.294188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.297200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.313248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04a57-6736-48c7-b7c5-50cd3b881987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.324822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.325756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.327751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.342473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.343800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.353613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.369767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] MFA Rules not processed for user `0f5a1de956a24a73b1f3bbb1cb448b67`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:09.373806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:09.400382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2446/4899] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:09 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:09.404353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.427709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c070e-c087-4fc7-a141-a9b3aca620e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.444081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.445578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.446020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.446461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.447329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.450532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.644683 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2454/4900] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Oct 31 14:38:09 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 813 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:09.650233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.672331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aea832-f4d2-4921-ad43-5c3461d6a23f tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.679722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.679975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.680216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.681191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/59eaa5fcd04746fca116c749cb6b5ea1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.696043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=59eaa5fcd04746fca116c749cb6b5ea1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.701709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.767703 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2447/4901] 10.222.0.13 () {60 vars in 1174 bytes} [Mon Oct 31 14:38:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:09.769674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.813997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5051-84f3-4383-8cc5-c9841cedcac4 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.825253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.826009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.827786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.828194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.842042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:get_trust(trust_id=8bd0a9eee90c4974b77eff2332021991)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.848978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.852985 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2455/4902] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:09 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/59eaa5fcd04746fca116c749cb6b5ea1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:09.854569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:09.858293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.869648 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2448/4903] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:38:09 2022] GET /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991 => generated 834 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:09.873387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.891917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547da09-181d-4421-9e81-a6c814b50944 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.898491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.899350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.899855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.900278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.916507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8bd0a9eee90c4974b77eff2332021991)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.918236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.931305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:09.936617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf777-4b83-4d99-86ec-2c6767127c15 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.943979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2449/4904] 10.222.0.13 () {58 vars in 1269 bytes} [Mon Oct 31 14:38:09 2022] GET /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:09.947954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:09.950369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.955528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.955998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.957012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.958465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.960673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:09.968420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b82fc-4cda-4497-97d4-02c703238f72 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:09.977802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:09.978804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:09.979211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:09.979591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dbb64b5a4d4840bd9ca42e9e60a867e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:09.991171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8bd0a9eee90c4974b77eff2332021991, role_id=dbb64b5a4d4840bd9ca42e9e60a867e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:09.999120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.009933 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2450/4905] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:38:09 2022] GET /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dbb64b5a4d4840bd9ca42e9e60a867e8 => generated 243 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:10.013773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.030652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e0cc-12ef-43af-b693-2da88d3138e5 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.049712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.050270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.062654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.062654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dbb64b5a4d4840bd9ca42e9e60a867e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.077164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8bd0a9eee90c4974b77eff2332021991, role_id=dbb64b5a4d4840bd9ca42e9e60a867e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.084175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.099760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2451/4906] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:38:10 2022] HEAD /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dbb64b5a4d4840bd9ca42e9e60a867e8 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 31 14:38:10.105445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.119438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb901-0f51-41fc-b911-f705b5c78364 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.126436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.128025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.128424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.128800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dc279010b4f14547adfa1f697da66cd3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.138457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8bd0a9eee90c4974b77eff2332021991, role_id=dc279010b4f14547adfa1f697da66cd3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.140222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Could not find role: dc279010b4f14547adfa1f697da66cd3.: keystone.exception.RoleNotFound: Could not find role: dc279010b4f14547adfa1f697da66cd3. Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:38:10.157137 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: dc279010b4f14547adfa1f697da66cd3. Oct 31 14:38:10.163804 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:10.163804 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2452/4907] 10.222.0.13 () {58 vars in 1368 bytes} [Mon Oct 31 14:38:10 2022] GET /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dc279010b4f14547adfa1f697da66cd3 => generated 110 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:38:10.164603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.187257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f8898-32c5-4b36-bc24-117e83bc6094 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.198359 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2456/4908] 10.222.0.13 () {60 vars in 1314 bytes} [Mon Oct 31 14:38:09 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 789 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:10.198555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.198555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.200387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.200749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.201366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dc279010b4f14547adfa1f697da66cd3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.218352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8bd0a9eee90c4974b77eff2332021991, role_id=dc279010b4f14547adfa1f697da66cd3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.220502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.222451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce013e-2e96-40b5-a9de-071aec569464 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.228830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Could not find role: dc279010b4f14547adfa1f697da66cd3.: keystone.exception.RoleNotFound: Could not find role: dc279010b4f14547adfa1f697da66cd3. Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:38:10.252806 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: dc279010b4f14547adfa1f697da66cd3. Oct 31 14:38:10.254005 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:10.258306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.265442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2453/4909] 10.222.0.13 () {58 vars in 1369 bytes} [Mon Oct 31 14:38:10 2022] HEAD /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991/roles/dc279010b4f14547adfa1f697da66cd3 => generated 0 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 31 14:38:10.268168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.268168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.268168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.268508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.274217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.276787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.291093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd70a-e927-42c2-b440-7fa529005a97 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.305906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.307653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.309655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.310062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.323757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorizing `identity:delete_trust(trust_id=8bd0a9eee90c4974b77eff2332021991)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.327128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.427875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8bd0a9eee90c4974b77eff2332021991', 'request_id': 'req-af9d5820-ec8d-4117-8c28-3f500b0d0782'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:10.431949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:10.431949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8bd0a9eee90c4974b77eff2332021991', 'request_id': 'req-af9d5820-ec8d-4117-8c28-3f500b0d0782'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:10.431949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8bd0a9eee90c4974b77eff2332021991', 'request_id': 'req-af9d5820-ec8d-4117-8c28-3f500b0d0782'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:10.575360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2457/4910] 10.222.0.13 () {60 vars in 1314 bytes} [Mon Oct 31 14:38:10 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 789 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:10.575938 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2454/4911] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 14:38:10 2022] DELETE /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:10.577413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.579873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:10.588759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.592533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:10.618678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5820-ec8d-4117-8c28-3f500b0d0782 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.629568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f5a1de956a24a73b1f3bbb1cb448b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c97be16ef3214c048038063b760ff3e5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1419885446', 'tempest-DelegatedRole-995616405'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.632774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.633092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.633373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] PATH_INFO: `/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.638023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aaa9-fcbb-483c-8851-9a2d787c6bd4 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Could not find trust: 8bd0a9eee90c4974b77eff2332021991.: keystone.exception.TrustNotFound: Could not find trust: 8bd0a9eee90c4974b77eff2332021991. Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 31 14:38:10.657689 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8bd0a9eee90c4974b77eff2332021991. Oct 31 14:38:10.658813 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:10.661409 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2455/4912] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 14:38:10 2022] GET /identity/v3/OS-TRUST/trusts/8bd0a9eee90c4974b77eff2332021991 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:38:10.665889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.667649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.668311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.668809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.671485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.672608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:list_application_credentials(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.674416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:10.678223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.715758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d08a9-d46b-4fba-b9ee-7ce541d11b22 tempest-TrustsV3TestJSON-3254340 tempest-user-1277956702] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.720654 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2458/4913] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 14:38:10 2022] GET /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 1502 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:10.721961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:10.726472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.728701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.729079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.729504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/dc279010b4f14547adfa1f697da66cd3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.733950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dc279010b4f14547adfa1f697da66cd3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.736858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.775075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76197a-6e62-4b87-9e47-cb6a6efbb6f3 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:10.791203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:10.793102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:10.796567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:10.797196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/be8a86c4639749d4a1d35bd12d502dd4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:10.825531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=be8a86c4639749d4a1d35bd12d502dd4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:10.828724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:10.990984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:11.000468 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2459/4914] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:10 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/be8a86c4639749d4a1d35bd12d502dd4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:11.005505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:11.041442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596ccf1-25ea-4e6f-9564-29894380a987 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:11.050974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role dc279010b4f14547adfa1f697da66cd3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:11.051928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:11.053244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:11.060999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2456/4915] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:10 2022] DELETE /identity/v3/roles/dc279010b4f14547adfa1f697da66cd3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:11.065015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:11.066638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:11.071152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:11.072973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:11.073610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:11.076262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/0599ad544a08401eabdd8680bd42019e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:11.107267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=0599ad544a08401eabdd8680bd42019e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:11.108795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:11.166875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:11.233833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0718b-aa91-4388-93a0-63cce3792e3c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:11.247331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2460/4916] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:11 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/0599ad544a08401eabdd8680bd42019e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:11.249628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:11.250504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:11.252108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:11.253486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:11.254412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:11.256121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/roles/dbb64b5a4d4840bd9ca42e9e60a867e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:11.260268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dbb64b5a4d4840bd9ca42e9e60a867e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:11.264345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:11.276095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536387a0-ae20-46d4-aa88-22a9ce51828e tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:11.360289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:11.363007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:11.363007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:11.363007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:11.363007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:11.364848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:11.528905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invalidating the token cache because role dbb64b5a4d4840bd9ca42e9e60a867e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:11.529575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:11.530608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:11.534817 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2457/4917] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:11 2022] DELETE /identity/v3/roles/dbb64b5a4d4840bd9ca42e9e60a867e8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:11.539803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:11.546940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:11.614315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2461/4918] 10.222.0.13 () {60 vars in 1314 bytes} [Mon Oct 31 14:38:11 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 788 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:11.619659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:11.625905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:11.685868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee66c5a-5cf8-4907-b854-4612cae6e94a tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:11.807494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1e34d-c8c9-4549-976c-0b38da3a950c tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:11.818851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:11.819545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:11.819829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:11.820105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/users/0f5a1de956a24a73b1f3bbb1cb448b67` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:11.821377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f5a1de956a24a73b1f3bbb1cb448b67)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:11.826180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:11.827257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:11.828149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:11.828769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:11.829198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:11.830425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:11.831956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:12.069450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5a1de956a24a73b1f3bbb1cb448b67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.070435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5a1de956a24a73b1f3bbb1cb448b67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.132776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2462/4919] 10.222.0.13 () {60 vars in 1314 bytes} [Mon Oct 31 14:38:11 2022] POST /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials => generated 788 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:12.136813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.145038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:12.184921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5a1de956a24a73b1f3bbb1cb448b67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.220126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14851-01cd-4846-8998-a38f5e0479ab tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:12.225738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:12.227327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:12.227777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:12.228236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:12.228911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5a1de956a24a73b1f3bbb1cb448b67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.229251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Adding query filter params (name=tempest-application_credential-673615381) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:12.229835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:list_application_credentials(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:12.230269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5a1de956a24a73b1f3bbb1cb448b67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.232001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:12.245577 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2463/4920] 10.222.0.13 () {58 vars in 1384 bytes} [Mon Oct 31 14:38:12 2022] GET /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials?name=tempest-application_credential-673615381 => generated 885 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:38:12.249518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.260010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2458/4921] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:11 2022] DELETE /identity/v3/users/0f5a1de956a24a73b1f3bbb1cb448b67 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:12.264250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.266002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:12.284551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e338cd5-8699-43d2-9d81-341fdc911f9d tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:12.459049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:12.460990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:12.461894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:12.462580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/df861b879aae498fa2b7684f231262cb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:12.486321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585b9d4-f0bb-443d-9fc0-3ab839319341 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:12.510096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971439557b624194b69bc26d279b8ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801bd424c6514c6487addf38219a2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:12.510830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:12.511115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:12.511387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] PATH_INFO: `/v3/projects/c97be16ef3214c048038063b760ff3e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:12.513065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=df861b879aae498fa2b7684f231262cb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:12.515080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:12.516412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c97be16ef3214c048038063b760ff3e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:12.523109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:12.678798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2464/4922] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:12 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/df861b879aae498fa2b7684f231262cb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:12.683363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.709205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415d04-4a4a-4af8-b457-4f27fce3c8ce tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:12.777539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:12.821128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97be16ef3214c048038063b760ff3e5', 'request_id': 'req-9f505628-588a-41ff-977d-e6fc44cfc2a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.822874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f338321146748f290897a050e12e8f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b02246fcee114c439bf5f66a27b06875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:12.823785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:12.824243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:12.824707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/81f9e624e15b471ea2597ff90bd03d1a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:12.836687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f338321146748f290897a050e12e8f7, application_credential_id=81f9e624e15b471ea2597ff90bd03d1a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:12.839691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:12.896805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97be16ef3214c048038063b760ff3e5', 'request_id': 'req-9f505628-588a-41ff-977d-e6fc44cfc2a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.913023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97be16ef3214c048038063b760ff3e5', 'request_id': 'req-9f505628-588a-41ff-977d-e6fc44cfc2a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.939328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] The token cache is being invalidate because project c97be16ef3214c048038063b760ff3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:12.939608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.941649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:12.943876 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2459/4923] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:12 2022] DELETE /identity/v3/projects/c97be16ef3214c048038063b760ff3e5 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:12.953110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.954545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:12.955218 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2465/4924] 10.222.0.13 () {58 vars in 1395 bytes} [Mon Oct 31 14:38:12 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7/application_credentials/81f9e624e15b471ea2597ff90bd03d1a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:12.964611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:12.966431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:13.134471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24162-3a2e-44e7-81b1-9a6cfc469e83 tempest-ApplicationCredentialsV3Test-2011656654 tempest-ApplicationCredentialsV3Test-2011656654-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:13.153792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:13.154786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:13.155243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:13.155689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] PATH_INFO: `/v3/users/0f338321146748f290897a050e12e8f7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:13.157195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f338321146748f290897a050e12e8f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:13.159525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:13.162677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505628-588a-41ff-977d-e6fc44cfc2a6 tempest-TrustsV3TestJSON-1329636211 tempest-TrustsV3TestJSON-1329636211-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:13.175782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:13.176470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:13.176746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:13.177434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] PATH_INFO: `/v3/users/f5aa4537f95249a08362c571194bf067` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:13.181123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aa4537f95249a08362c571194bf067)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:13.183210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:13.609357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f338321146748f290897a050e12e8f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.610379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f338321146748f290897a050e12e8f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.692420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aa4537f95249a08362c571194bf067'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.695258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aa4537f95249a08362c571194bf067'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.737447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f338321146748f290897a050e12e8f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.806438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aa4537f95249a08362c571194bf067'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.829195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aa4537f95249a08362c571194bf067'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.829956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5e02c17-5292-4790-8854-6f23bea6d2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aa4537f95249a08362c571194bf067'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.835478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:13.839592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f338321146748f290897a050e12e8f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.840489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-938e987b-e611-45f7-86c7-b74944f42ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f338321146748f290897a050e12e8f7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:13.867001 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2466/4925] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:12 2022] DELETE /identity/v3/users/0f338321146748f290897a050e12e8f7 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:13.868466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:13.869563 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2460/4926] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:12 2022] DELETE /identity/v3/users/f5aa4537f95249a08362c571194bf067 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:13.870091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:13.870539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:13.872466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a1b3-9705-4c5a-9c77-b57a40aa3707 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:13.873831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a1b3-9705-4c5a-9c77-b57a40aa3707 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:13.873965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a1b3-9705-4c5a-9c77-b57a40aa3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:13.915159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6112a1b3-9705-4c5a-9c77-b57a40aa3707 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:13.916683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6112a1b3-9705-4c5a-9c77-b57a40aa3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:13.925546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] MFA Rules not processed for user `02b67c9f5d604a028199c5f133f891ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:13.927055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:14.074470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2461/4927] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:14.076079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f38f-4b4c-4a3f-bfd4-f9023a93fa93 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:14.085404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f38f-4b4c-4a3f-bfd4-f9023a93fa93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:14.087341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f38f-4b4c-4a3f-bfd4-f9023a93fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:14.099283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2467/4928] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:14.101672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:14.111041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:14.140047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2d6f38f-4b4c-4a3f-bfd4-f9023a93fa93 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:14.142158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2d6f38f-4b4c-4a3f-bfd4-f9023a93fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:14.176395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2462/4929] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:14.178605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:14.179165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:14.179625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:14.224721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] MFA Rules not processed for user `02b67c9f5d604a028199c5f133f891ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:14.231005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:14.250985 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2463/4930] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:14.251121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:14.261552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7e0b4-36a2-4ce3-af2c-7beaf55c88f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:14.270296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:14.271254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:14.271687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:14.272113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:14.274673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:14.278018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123e74-ded6-4f8c-b246-b4689837ecfb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:14.289893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:14.293466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:14.293466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:14.293466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:14.293772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:14.295274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:14.312474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:14.313932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:14.323531 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2468/4931] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:14.335643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:14.343252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2464/4932] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:14.355990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:14.468153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=10,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:14.480896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a974-6f87-4c5f-b518-ff66b4cac438 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:14.489912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:14.490999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:14.499948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:14.499948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:14.536201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:14.538213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:14.571154 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2469/4933] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:15.070441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:15.245790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:15.675714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:15.681072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:15.695774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:15.697545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:15.753629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652533e-ff5d-43a8-8c14-c423434d6eca service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:15.772477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc51e12-0db0-409c-b589-1cd35f439e8f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:15.777705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:15.782230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:15.782649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:15.784327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:15.784619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] PATH_INFO: `/v3/projects/b02246fcee114c439bf5f66a27b06875` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:15.785175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:15.786904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:15.790099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02246fcee114c439bf5f66a27b06875)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:15.790903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] PATH_INFO: `/v3/projects/5b1c8f7229e649548aafacdf6bc1b9d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:15.795045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1c8f7229e649548aafacdf6bc1b9d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:15.798707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:15.806920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:15.988188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:16.006236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1c8f7229e649548aafacdf6bc1b9d6', 'request_id': 'req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.035768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02246fcee114c439bf5f66a27b06875', 'request_id': 'req-be545abd-e194-452b-8db5-1fb60756cfc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.136608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1c8f7229e649548aafacdf6bc1b9d6', 'request_id': 'req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.143571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1c8f7229e649548aafacdf6bc1b9d6', 'request_id': 'req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.170454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] The token cache is being invalidate because project 5b1c8f7229e649548aafacdf6bc1b9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:16.173090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.173090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6eec3a6c-d12d-48e1-aabd-ede76b8f7e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.175454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2465/4934] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:15 2022] DELETE /identity/v3/projects/5b1c8f7229e649548aafacdf6bc1b9d6 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:16.176868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8b17-cfaf-4211-97af-c54bcb72cacd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:16.177154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8b17-cfaf-4211-97af-c54bcb72cacd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:16.177432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8b17-cfaf-4211-97af-c54bcb72cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:16.232411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02246fcee114c439bf5f66a27b06875', 'request_id': 'req-be545abd-e194-452b-8db5-1fb60756cfc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.238644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:16.241300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02246fcee114c439bf5f66a27b06875', 'request_id': 'req-be545abd-e194-452b-8db5-1fb60756cfc2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.252683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-601b8b17-cfaf-4211-97af-c54bcb72cacd None None] MFA Rules not processed for user `2dac64cc9d10438c802bcd594e6bda86`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:16.255786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-601b8b17-cfaf-4211-97af-c54bcb72cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:16.267338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] The token cache is being invalidate because project b02246fcee114c439bf5f66a27b06875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:16.268995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.271089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.285777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2470/4935] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:15 2022] DELETE /identity/v3/projects/b02246fcee114c439bf5f66a27b06875 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:16.292591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:16.296301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:16.445710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545abd-e194-452b-8db5-1fb60756cfc2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:16.453414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:16.454341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:16.454893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:16.455675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] PATH_INFO: `/v3/users/971439557b624194b69bc26d279b8ba6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:16.457058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=971439557b624194b69bc26d279b8ba6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:16.460006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:16.524473 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2466/4936] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:16.538154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:16.539788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:16.541435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:16.637310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:16.638869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:16.666969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2467/4937] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:16.667944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:16.674265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:16.694013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971439557b624194b69bc26d279b8ba6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.697874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971439557b624194b69bc26d279b8ba6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.788364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971439557b624194b69bc26d279b8ba6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.818956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971439557b624194b69bc26d279b8ba6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.822346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2353aa1a-9e1a-47db-bc27-b5ea55cfa5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971439557b624194b69bc26d279b8ba6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:16.855046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2471/4938] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:16 2022] DELETE /identity/v3/users/971439557b624194b69bc26d279b8ba6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:16.856421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:16.856707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:16.856983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:16.872357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0968d3-3361-4052-bd57-89f55506c33d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:16.907730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:16.909020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:17.006071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:17.057201 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2472/4939] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:17.067601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.082804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c5167-d740-417f-a0c4-381f0933af66 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.083211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.084106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.084388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.084672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.092488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:17.092683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.096588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.096588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.096588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.096588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:17.096588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.097440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.108876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:17.132735 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2473/4940] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:17.134863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.160838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086c995-67e3-4a50-806b-26bde8cfc650 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.169786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.171752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.172039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.176402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.176402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.180930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.279132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.283303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.311596 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2474/4941] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:17 2022] POST /identity/v3/projects => generated 399 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:17.313969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2468/4942] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:17.316365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.493365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2ac5-ec88-4b98-8c67-fbdf92d5c354 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.503928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.504616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.504901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.505177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.505826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.511712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.697195 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2475/4943] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:17 2022] POST /identity/v3/users => generated 306 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:17.702504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.720539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327c7a-71d5-4661-80ee-9dd18b6a534b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.735419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.737531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.737825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.738100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.738787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.747811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.811003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.814353 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2469/4944] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:17.826943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403ac9d-821e-4c17-9346-b4d36f3a1e97 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.837886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:17.838648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:17.838937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:17.839215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] PATH_INFO: `/v3/projects/d948fe2ef8844b838147996601f56ae5/users/4283fb325dec412f86b9d1ffb6a52882/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:17.881151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d948fe2ef8844b838147996601f56ae5, user_id=4283fb325dec412f86b9d1ffb6a52882, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:17.898008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:17.972727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2476/4945] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:17 2022] PUT /identity/v3/projects/d948fe2ef8844b838147996601f56ae5/users/4283fb325dec412f86b9d1ffb6a52882/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:17.976677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.994232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:17.994452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461d1f-5981-453c-9825-0daf6ff25eb9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:17.999536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:18.233464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4f8e-ad71-416a-af9f-3eea1d9717c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:18.250150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:18.250947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.251225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.251496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.252432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:18.254147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:18.268460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:18.269594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.270235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.271219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] PATH_INFO: `/v3/projects/801bd424c6514c6487addf38219a2ec8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.284731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801bd424c6514c6487addf38219a2ec8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:18.284731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:18.285267 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2470/4946] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:18.289727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:18.307563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7a67-d7ab-4ce1-952d-8af4f2e2c366 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:18.348781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:18.349776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.350213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.351418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] PATH_INFO: `/v3/projects/d948fe2ef8844b838147996601f56ae5/users/4283fb325dec412f86b9d1ffb6a52882/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.357627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d948fe2ef8844b838147996601f56ae5, user_id=4283fb325dec412f86b9d1ffb6a52882, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:18.385662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e93b5c-5714-40be-aeef-170f3df5f351 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:18.423156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2471/4947] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:18 2022] PUT /identity/v3/projects/d948fe2ef8844b838147996601f56ae5/users/4283fb325dec412f86b9d1ffb6a52882/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:18.537064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.537676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.538728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.542706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:18.561016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801bd424c6514c6487addf38219a2ec8', 'request_id': 'req-b4214cc2-c6c3-47b2-a393-7797a39eb536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:18.612314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] MFA Rules not processed for user `4283fb325dec412f86b9d1ffb6a52882`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:18.614428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:18.659197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801bd424c6514c6487addf38219a2ec8', 'request_id': 'req-b4214cc2-c6c3-47b2-a393-7797a39eb536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:18.667499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801bd424c6514c6487addf38219a2ec8', 'request_id': 'req-b4214cc2-c6c3-47b2-a393-7797a39eb536'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:18.709167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] The token cache is being invalidate because project 801bd424c6514c6487addf38219a2ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:18.710955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:18.715248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b4214cc2-c6c3-47b2-a393-7797a39eb536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:18.718152 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2477/4948] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:17 2022] DELETE /identity/v3/projects/801bd424c6514c6487addf38219a2ec8 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:18.727495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0047-82e6-4e36-9475-e05321f2dda4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.727495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0047-82e6-4e36-9475-e05321f2dda4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.727495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0047-82e6-4e36-9475-e05321f2dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.777122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c68d0047-82e6-4e36-9475-e05321f2dda4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:18.780871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c68d0047-82e6-4e36-9475-e05321f2dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:18.817221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:18.899127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2478/4949] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:18.910013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2472/4950] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:18.910592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.911043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:18.911547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.912033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.912651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:18.939392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05a485-f9e7-4f71-8ca0-0be96e4b1587 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:18.956293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:18.957039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:18.957329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:18.957606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:18.958253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:18.961665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:18.966094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:18.969473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:18.993871 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2479/4951] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:18.998261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.016729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2faeb-f155-45ab-9ad0-d47c4283632f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:19.032414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:19.033246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:19.034769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:19.037632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:19.039286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:19.039707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:19.043646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:19.129027 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2473/4952] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:18 2022] POST /identity/v3/projects => generated 399 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:19.129941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.130643 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2480/4953] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:19.133233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.172295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc04cce-995d-47ce-8f12-20d0e87f22e7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:19.404639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a6fb-1a53-4781-895a-463de82f925f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:19.411615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:19.412766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:19.413317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:19.414185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:19.415088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:19.417332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:19.439027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:19.439909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:19.440259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:19.440598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:19.446153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:19.448907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:19.571979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2474/4954] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:19.572985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.599146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2481/4955] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:19 2022] POST /identity/v3/users => generated 300 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:19.604614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.664423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a7a6-67fd-4a96-b6b3-fa0778d410c7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:19.815568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6bfaa-5e08-47f0-8c32-733110dd4b28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:19.833713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:19.833713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:19.833713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:19.833713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:19.834064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:19.834064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:19.877347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:19.968239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:19.969353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:19.976125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2475/4956] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:19 2022] POST /identity/v3/users => generated 291 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:19.980302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:19.981903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:19.982192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:19.987934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:19.994983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.003849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75988d53-7b24-4aa9-9127-fd6fa8ce8d3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.038054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.038824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.039966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.040254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.040929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:20.046549 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2482/4957] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:20.064166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.064597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.073103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de385d-223d-4900-b1d3-4706131e05f3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.084478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2476/4958] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:20.086906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.092266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.092266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.092266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.092266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:20.095646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.098335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.124556 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2483/4959] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:20.128314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bbd22-a8ec-4bce-85a8-c8eb7e40ed50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.128711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.149711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.151755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0428c0-27db-4fd7-a3dd-4a86fd13585f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.153438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.153727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.154006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.168022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.171023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.175866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.176442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] PATH_INFO: `/v3/projects/1fe9799e1fe842fd8434ac7e26d0e134/users/093a9f2927b74c998ef3aa0d2a59d7dc/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.185393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:20.188201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.227547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2477/4960] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:20.229036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.240060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe9799e1fe842fd8434ac7e26d0e134, user_id=093a9f2927b74c998ef3aa0d2a59d7dc, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:20.243231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ec6d5-21f2-405c-a227-5c0d065f23cf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.251780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9138-acce-4753-9fb7-c60def0e0a34 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.269772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.270459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.270768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.272936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] PATH_INFO: `/v3/projects/dfca04cecbd646daac40fc0d84e4ac9d/users/a10363e0e360479fa474a76b205396c4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.312988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:20.324748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfca04cecbd646daac40fc0d84e4ac9d, user_id=a10363e0e360479fa474a76b205396c4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:20.330874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9faff-c6e6-4346-932b-2a1c41cdfefa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:20.331408 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2484/4961] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:20 2022] PUT /identity/v3/projects/1fe9799e1fe842fd8434ac7e26d0e134/users/093a9f2927b74c998ef3aa0d2a59d7dc/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:20.342080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.342519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.343068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.450337 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2478/4962] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:20 2022] PUT /identity/v3/projects/dfca04cecbd646daac40fc0d84e4ac9d/users/a10363e0e360479fa474a76b205396c4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:20.460519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.461120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.461662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:20.488074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] MFA Rules not processed for user `093a9f2927b74c998ef3aa0d2a59d7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:20.493234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:20.617598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] MFA Rules not processed for user `a10363e0e360479fa474a76b205396c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:20.621749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:20.747189 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2485/4963] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:20.748268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.757460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:20.830263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2479/4964] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:20.833389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:20.961409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66697e1-3380-4595-98e0-3b8350060554 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:20.974289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:20.979429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:20.981001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:20.981677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.001732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887df5-5bb0-43d9-bee4-b68d84cfcb41 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:21.014214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:21.015025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.015339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.015620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.016273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.018385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.128390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:21.185191 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2480/4965] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:20 2022] POST /identity/v3/projects => generated 379 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:21.189356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:21.209479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.209479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.241952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2486/4966] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:21.294474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161418-1568-45be-9560-5cda0092c1ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:21.306361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:21.307307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.307588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.307863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.308510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.310460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.339318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:21.433317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2481/4967] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:21 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:21.437776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:21.455555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfbf42-6a42-42ec-8813-bbe11b5bab97 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:21.468523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:21.469028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.469309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.469576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.470218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.476379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.504157 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2487/4968] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:21.506060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:21.532944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7a81-5ca8-43e0-a597-c3cf82c8515a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:21.570758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:21.571388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.571670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.571942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.573116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.574397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ee6e-10e1-43c9-a2a4-df113ab3c361 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.622167 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2482/4969] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:21.623148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:21.639086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde6a2b-af98-4c44-bdf7-9d71be5beeed admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:21.664034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:21.665016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.665624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.666050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] PATH_INFO: `/v3/projects/c76167b50fe0478f932cae74d617b143/users/b8589292b6db4d8b8a19bbc946463250/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.705617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76167b50fe0478f932cae74d617b143, user_id=b8589292b6db4d8b8a19bbc946463250, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:21.712874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:21.813596 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2488/4970] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:21 2022] PUT /identity/v3/projects/c76167b50fe0478f932cae74d617b143/users/b8589292b6db4d8b8a19bbc946463250/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:21.831484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6a420-488f-4ce3-9f2c-27d965fd0945 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:21.831484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6a420-488f-4ce3-9f2c-27d965fd0945 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:21.831484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6a420-488f-4ce3-9f2c-27d965fd0945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:21.884256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89e6a420-488f-4ce3-9f2c-27d965fd0945 None None] MFA Rules not processed for user `b8589292b6db4d8b8a19bbc946463250`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:21.885832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89e6a420-488f-4ce3-9f2c-27d965fd0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:22.047713 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2483/4971] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:22.052938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:22.228085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5b85f-88cf-4018-921c-8557a22de365 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:22.244385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a10363e0e360479fa474a76b205396c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfca04cecbd646daac40fc0d84e4ac9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:22.245836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:22.246123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:22.248843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] PATH_INFO: `/v3/users/a10363e0e360479fa474a76b205396c4/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:22.250943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] RBAC: Authorizing `identity:list_user_projects(user_id=a10363e0e360479fa474a76b205396c4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:22.257421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e8b4-9063-409c-860c-d3f4a700cb6d tempest-IdentityV3ProjectsTest-1664625075 tempest-IdentityV3ProjectsTest-1664625075-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:22.357349 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2489/4972] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 14:38:22 2022] GET /identity/v3/users/a10363e0e360479fa474a76b205396c4/projects => generated 517 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:22.361584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:22.362112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:22.362456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:22.424480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] MFA Rules not processed for user `a10363e0e360479fa474a76b205396c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:22.426147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:22.442014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2484/4973] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:22.446108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:22.446597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:22.446902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:22.476012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] MFA Rules not processed for user `a10363e0e360479fa474a76b205396c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:22.477529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:22.565256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.models.token_model [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] User a10363e0e360479fa474a76b205396c4 has no access to project c76167b50fe0478f932cae74d617b143 {{(pid=82163) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 31 14:38:22.570160 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.server.flask.application [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:38:22.575798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2490/4974] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 129 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 14:38:22.580493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:22.817016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922ad34-9da4-442a-a5d9-93d2f1418537 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:22.824697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:22.824929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:22.825685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:22.825966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] PATH_INFO: `/v3/users/a10363e0e360479fa474a76b205396c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:22.828409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10363e0e360479fa474a76b205396c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:22.834661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:22.891158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:22.958442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f89f-54cd-4319-acef-b360c9be250f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:22.973726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:22.974514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:22.974899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:22.975248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] PATH_INFO: `/v3/users/4283fb325dec412f86b9d1ffb6a52882` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:22.979193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4283fb325dec412f86b9d1ffb6a52882)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:22.981148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:23.088360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:23.581791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4283fb325dec412f86b9d1ffb6a52882'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.583251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4283fb325dec412f86b9d1ffb6a52882'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.586555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10363e0e360479fa474a76b205396c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.588548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10363e0e360479fa474a76b205396c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.669580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4283fb325dec412f86b9d1ffb6a52882'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.705578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4283fb325dec412f86b9d1ffb6a52882'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.710578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42ff527e-f53c-46fa-a8b9-c94ea28a4b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4283fb325dec412f86b9d1ffb6a52882'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.760671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10363e0e360479fa474a76b205396c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.771679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:23.777922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2491/4975] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:22 2022] DELETE /identity/v3/users/4283fb325dec412f86b9d1ffb6a52882 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:23.790155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:23.790575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:23.791001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:23.811003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10363e0e360479fa474a76b205396c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.816058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-752b415e-ae88-4073-beac-d518cd341850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10363e0e360479fa474a76b205396c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:23.857158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:23.858524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:23.911317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2485/4976] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:22 2022] DELETE /identity/v3/users/a10363e0e360479fa474a76b205396c4 => generated 0 bytes in 1331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:23.919551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:23.923221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:23.923535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:24.002165 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2492/4977] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:24.009994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:24.013155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:24.017336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:24.021715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:24.208985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc558-27c0-4018-9020-7d6fe81dc25f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:24.215012 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2486/4978] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:24.229079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:24.336387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302b4eb-67f4-44ae-8f8d-9399f17157ab None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:24.343295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:24.349612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:24.349612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:24.349612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:24.350364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:24.356507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:24.357501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:24.358056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:24.358575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:24.373439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:24.376255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93545663-c091-4257-ae7b-37c8ddeac05a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:24.381218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:24.388839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:24.404357 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2493/4979] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:24.423560 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2487/4980] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:24.763779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:24.766798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:24.766798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:24.811168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] MFA Rules not processed for user `2dac64cc9d10438c802bcd594e6bda86`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:24.812560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:24.936045 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2494/4981] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:25.748798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:25.762111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f4e41-b1d6-4dad-b3e5-0f691c49f2d2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:25.767134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:25.768029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:25.768311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:25.768583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:25.770728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:25.785470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:25.787302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:25.790772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:25.794487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:25.812619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288e7a-d57a-49a3-9fb9-0d19b099c8b7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:25.813866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2488/4982] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:25.828941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:25.829617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:25.829896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:25.833157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] PATH_INFO: `/v3/projects/d948fe2ef8844b838147996601f56ae5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:25.834476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d948fe2ef8844b838147996601f56ae5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:25.838939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:25.903841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:25.903841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:25.957628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678d292-f612-4b6d-b00b-45b378d4633b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:25.970225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:25.971114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:25.971420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:25.971675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] PATH_INFO: `/v3/projects/dfca04cecbd646daac40fc0d84e4ac9d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:25.974286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfca04cecbd646daac40fc0d84e4ac9d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:25.980317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:25.989999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd948fe2ef8844b838147996601f56ae5', 'request_id': 'req-06c5711d-4403-4ce1-b515-5229394455aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.199557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd948fe2ef8844b838147996601f56ae5', 'request_id': 'req-06c5711d-4403-4ce1-b515-5229394455aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.203616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfca04cecbd646daac40fc0d84e4ac9d', 'request_id': 'req-3a845f28-98f3-4447-be68-358ffa93e83d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.209640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd948fe2ef8844b838147996601f56ae5', 'request_id': 'req-06c5711d-4403-4ce1-b515-5229394455aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.236351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] The token cache is being invalidate because project d948fe2ef8844b838147996601f56ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:26.236626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.237326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.242695 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2495/4983] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:25 2022] DELETE /identity/v3/projects/d948fe2ef8844b838147996601f56ae5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:26.243746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:26.245318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:26.280113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfca04cecbd646daac40fc0d84e4ac9d', 'request_id': 'req-3a845f28-98f3-4447-be68-358ffa93e83d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.286192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:26.289317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfca04cecbd646daac40fc0d84e4ac9d', 'request_id': 'req-3a845f28-98f3-4447-be68-358ffa93e83d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.336753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] The token cache is being invalidate because project dfca04cecbd646daac40fc0d84e4ac9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:26.337338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.341161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.347669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2489/4984] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:25 2022] DELETE /identity/v3/projects/dfca04cecbd646daac40fc0d84e4ac9d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:26.348943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:26.351500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5711d-4403-4ce1-b515-5229394455aa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:26.353411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:26.386583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:26.437470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:26.438173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:26.438458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:26.438782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] PATH_INFO: `/v3/users/093a9f2927b74c998ef3aa0d2a59d7dc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:26.446884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=093a9f2927b74c998ef3aa0d2a59d7dc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:26.455268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:26.512243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a845f28-98f3-4447-be68-358ffa93e83d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:26.520016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:26.520677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:26.520956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:26.521231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] PATH_INFO: `/v3/users/b8589292b6db4d8b8a19bbc946463250` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:26.538518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8589292b6db4d8b8a19bbc946463250)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:26.543467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:26.792373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093a9f2927b74c998ef3aa0d2a59d7dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.793126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093a9f2927b74c998ef3aa0d2a59d7dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.831101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8589292b6db4d8b8a19bbc946463250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.832301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8589292b6db4d8b8a19bbc946463250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.908453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093a9f2927b74c998ef3aa0d2a59d7dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.923125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093a9f2927b74c998ef3aa0d2a59d7dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.923909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c0ba65a4-a0f6-442e-bc1c-c78e3975e6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093a9f2927b74c998ef3aa0d2a59d7dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:26.939450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2496/4985] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:26 2022] DELETE /identity/v3/users/093a9f2927b74c998ef3aa0d2a59d7dc => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:26.940688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:26.940976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:26.941248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:26.962321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:26.963597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:26.989503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8589292b6db4d8b8a19bbc946463250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:27.009588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8589292b6db4d8b8a19bbc946463250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:27.010411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8589292b6db4d8b8a19bbc946463250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:27.026677 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2497/4986] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:27.030652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2490/4987] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:26 2022] DELETE /identity/v3/users/b8589292b6db4d8b8a19bbc946463250 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:27.051598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:27.056636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:27.142449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:27.174186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649bf2b-d877-406a-8567-f5b25d936b40 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:27.267416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:27.268707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:27.268997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:27.269329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:27.373902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:27.375589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:27.396955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2498/4988] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:38:27.581425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:27.583049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:27.689117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35db7d1-c455-4d13-8b88-5c331281d0ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:27.694951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:27.696013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:27.696491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:27.696737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] PATH_INFO: `/v3/projects/1fe9799e1fe842fd8434ac7e26d0e134` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:27.697930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe9799e1fe842fd8434ac7e26d0e134)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:27.699911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:27.720533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:27.772129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:27.774149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:27.789342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c871f-e777-4534-a817-cbe8e0f25f68 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:27.795221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:27.797170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:27.797672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:27.798218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] PATH_INFO: `/v3/projects/c76167b50fe0478f932cae74d617b143` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:27.799621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76167b50fe0478f932cae74d617b143)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:27.802769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:27.924568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe9799e1fe842fd8434ac7e26d0e134', 'request_id': 'req-efc780e8-1e85-472e-8751-321c385cb3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:27.995752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76167b50fe0478f932cae74d617b143', 'request_id': 'req-306674d0-55cf-4bd3-bae4-a91e33fd27a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.010886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe9799e1fe842fd8434ac7e26d0e134', 'request_id': 'req-efc780e8-1e85-472e-8751-321c385cb3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.017347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe9799e1fe842fd8434ac7e26d0e134', 'request_id': 'req-efc780e8-1e85-472e-8751-321c385cb3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.032833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] The token cache is being invalidate because project 1fe9799e1fe842fd8434ac7e26d0e134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:28.033128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.033833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efc780e8-1e85-472e-8751-321c385cb3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.035445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2491/4989] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:27 2022] DELETE /identity/v3/projects/1fe9799e1fe842fd8434ac7e26d0e134 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:28.040604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27d31-4e31-4f3c-becb-10b17039cddc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.040892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27d31-4e31-4f3c-becb-10b17039cddc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.051597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27d31-4e31-4f3c-becb-10b17039cddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.062729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-04b27d31-4e31-4f3c-becb-10b17039cddc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:28.064005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04b27d31-4e31-4f3c-becb-10b17039cddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:28.130039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2492/4990] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:28.139519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.139805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.140078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.147041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76167b50fe0478f932cae74d617b143', 'request_id': 'req-306674d0-55cf-4bd3-bae4-a91e33fd27a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.153741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76167b50fe0478f932cae74d617b143', 'request_id': 'req-306674d0-55cf-4bd3-bae4-a91e33fd27a0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.160022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:28.161227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:28.165946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] The token cache is being invalidate because project c76167b50fe0478f932cae74d617b143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:28.166250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.166929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-306674d0-55cf-4bd3-bae4-a91e33fd27a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:28.168446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2499/4991] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:27 2022] DELETE /identity/v3/projects/c76167b50fe0478f932cae74d617b143 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:28.171966 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2493/4992] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:28.189113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23fc9-afd6-40ef-847f-b0483e341c2a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.189273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.189376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23fc9-afd6-40ef-847f-b0483e341c2a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.189376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23fc9-afd6-40ef-847f-b0483e341c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.189552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aff6d-6f03-489e-8625-2cd874d9ddc6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.189552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.189552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.189552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.189873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.189873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:28.189873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.191377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.193935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4df23fc9-afd6-40ef-847f-b0483e341c2a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:28.195750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4df23fc9-afd6-40ef-847f-b0483e341c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:28.203631 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2494/4993] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:38:28.203877 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2500/4994] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:28.208055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.209970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:28.210987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.211276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.211551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.223317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d7a3-0677-409c-8483-2c5bf12eac7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.228612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.229206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.229485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.229759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.230387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.232315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.232432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:28.233487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:28.241970 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2501/4995] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:28.246129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.251554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:28.255253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6177-803e-4bb6-8452-0e6eba118adf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.259923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.260627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.260888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.261162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.261805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:28.262109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.263768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.275582 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2502/4996] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:38:28.279906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.290099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ae1f-2a98-41a5-bddb-c17cc3898759 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.294587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.295388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.295663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.295920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.296528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.298559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.401643 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2495/4997] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:28.405731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.442792 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2503/4998] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:28.442792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.481400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6fb39-6918-4b9a-aad6-a516017b3133 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.507805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0292-15a9-4f0b-a5af-57e1661f20ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.512641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.513237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.513514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.513781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.514407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.516353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.538928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.539532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.539805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.540073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.540700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.542849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.658658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2504/4999] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:28.661360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.672343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eff13-0576-44a3-b7ec-4c1ae6c2a9f1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.677606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.678242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.678603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.679042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.679765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.681337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.705919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2496/5000] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:28.706100 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2505/5001] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:28.706189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.707168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.729005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96134b-dd1f-4b29-b169-faf9227c2363 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.739581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847052d-97f9-407c-a4b6-7bbfbfbc3ef3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.745723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.746346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.746487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.746609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.746911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.747560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.747957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.748533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.748968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.749279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.749946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.757826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.778573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2506/5002] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:28.782256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.784674 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2497/5003] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:28.788997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.800032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc033c-ad17-4bda-8d77-7971fa13bf4d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.807215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.808244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.808677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87bcf-45c5-49df-8450-6a5ee653d066 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.817503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.817503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] PATH_INFO: `/v3/projects/c1950498bde246afa3f48c3494479adc/users/83ba7cb08aa241f783f367d8b2f442cb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.817715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.817715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.817715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.817715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.818017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.818017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.834071 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2498/5004] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:28.836786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:28.848926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1950498bde246afa3f48c3494479adc, user_id=83ba7cb08aa241f783f367d8b2f442cb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.852611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb0bb-a2ab-4679-8d3a-6412d0e97a09 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.853121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d609-dcc6-4c7a-9329-6b4801a88a94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:28.859623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:28.860598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.860951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.861295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] PATH_INFO: `/v3/projects/8afeb771eda048b18d5ea4091ad4b67e/users/2fdcb031891541298bf306d2ce1b3ec9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:28.882898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afeb771eda048b18d5ea4091ad4b67e, user_id=2fdcb031891541298bf306d2ce1b3ec9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:28.886523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92c93-ae6e-4db9-b309-098d6bf76893 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:28.944817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2507/5005] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:28 2022] PUT /identity/v3/projects/c1950498bde246afa3f48c3494479adc/users/83ba7cb08aa241f783f367d8b2f442cb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:28.959360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:28.959571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:28.960462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.008066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2499/5006] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:28 2022] PUT /identity/v3/projects/8afeb771eda048b18d5ea4091ad4b67e/users/2fdcb031891541298bf306d2ce1b3ec9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:29.010081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:29.011703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:29.025930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.033407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.033407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.114408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] MFA Rules not processed for user `2fdcb031891541298bf306d2ce1b3ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:29.115650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:29.128074 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2508/5007] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:29.130641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.160974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5cda3-5b70-440f-b1dc-d287eb15f75a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.165762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.166411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.166722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.166998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.245485 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2500/5008] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:29.250026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.302299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:29.346967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabe384-1597-4d83-8691-204a8bb4571f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.346967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.346967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.346967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.347385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.347698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:29.349674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:29.421271 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2509/5009] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:29 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:29.524813 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2501/5010] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:29 2022] POST /identity/v3/projects => generated 375 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:29.526546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.544203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531203-3cad-4ae7-8d67-beebe465f916 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.636328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.637304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.637754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.639516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.644506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:29.644506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:29.722952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.724723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2510/5011] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:29 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:29.744977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c106d-ad7b-4152-895e-a1ea1fa5222d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.750888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.751742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.752332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.752763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.753568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:29.757053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:29.772492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2502/5012] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:29.776860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.790057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3824-bc86-4cd8-b086-4cee601b155e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.795572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.796401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.797001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.797001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.797734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:29.799906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252917-5b98-4abc-9be9-8de31d08bf0b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:29.820019 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2511/5013] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:29.824375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:29.846212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b97c30-3a6b-4dd7-8969-c454772d614f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:29.874971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:29.876176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:29.877084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:29.877396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] PATH_INFO: `/v3/projects/254ea650587e4515914623ae183e5570/users/e476d862ccc943b5a1ba2c37de0b6e18/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:29.916290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] RBAC: Authorizing `identity:create_grant(project_id=254ea650587e4515914623ae183e5570, user_id=e476d862ccc943b5a1ba2c37de0b6e18, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:29.919588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:30.029932 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2503/5014] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:29 2022] PUT /identity/v3/projects/254ea650587e4515914623ae183e5570/users/e476d862ccc943b5a1ba2c37de0b6e18/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:30.036097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329a4b-0c74-4c8f-9a04-0fb80d717944 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.036276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329a4b-0c74-4c8f-9a04-0fb80d717944 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.036549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329a4b-0c74-4c8f-9a04-0fb80d717944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.051511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:30.081269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d8329a4b-0c74-4c8f-9a04-0fb80d717944 None None] MFA Rules not processed for user `e476d862ccc943b5a1ba2c37de0b6e18`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:30.082496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8329a4b-0c74-4c8f-9a04-0fb80d717944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:30.241982 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2512/5015] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:30.266880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:30.268732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:30.346610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6028b-f40e-45b6-8c9b-88443d55753d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:30.352480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:30.353100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.353379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.353653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.405712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:30.425267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268386-52c2-4e60-a371-89d877760844 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.425885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268386-52c2-4e60-a371-89d877760844 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.426244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268386-52c2-4e60-a371-89d877760844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.434662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:30.437386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974b61c-1eaf-476d-a1b0-36510cb09687 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:30.461583 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2504/5016] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:30.463142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4f268386-52c2-4e60-a371-89d877760844 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:30.464549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4f268386-52c2-4e60-a371-89d877760844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:30.469356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2513/5017] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:38:30.475051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.480471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.480471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.523227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:30.525203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:30.619348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2505/5018] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:30.623110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268386-52c2-4e60-a371-89d877760844 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:30.638416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268386-52c2-4e60-a371-89d877760844 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:30.644127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:30.645184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.645673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.646153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:30.708815 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 14:38:30.710504 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:38:30.711771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2514/5019] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 188 bytes in 88 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:38:30.715282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:30.724693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a73-003a-444d-9f7d-b4989eeb655c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:30.729172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d5822-fa35-4707-85d7-0159398901ea tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:30.729810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5822-fa35-4707-85d7-0159398901ea tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.730099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5822-fa35-4707-85d7-0159398901ea tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.730375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5822-fa35-4707-85d7-0159398901ea tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b49d5822-fa35-4707-85d7-0159398901ea tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:30.770173 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 31 14:38:30.771349 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:30.777926 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2506/5020] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 188 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:38:30.778812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:30.788290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f778020-9cae-4d2b-bc8b-cc37a0a54bfb tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:30.792864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:30.793596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.793876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.794172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.876034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:30.876424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:30.876806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:30.897207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:30.899898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:30.925513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:30.974683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2507/5021] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:30.993030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:31.004521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:31.052519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2515/5022] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:30 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:31.086811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1fb28-570a-492c-b32a-50e9cd0d92ad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:31.096072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:31.097489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:31.097935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:31.098371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:31.108905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:31.111946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:31.114982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3296cf-4ebf-4c90-b261-7dc4c873e557 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:31.127741 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2508/5023] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:38:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:38:31.364539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:31.798823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:31.801023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:31.816474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a3d06-1932-4ce9-ba1a-523b267bb44a tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:31.820621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:31.821646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:31.822148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:31.822594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:31.832746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:31.834587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:31.844846 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2516/5024] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:31.945489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcc5e-12de-47ce-a265-f9a1e203a652 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:31.945776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcc5e-12de-47ce-a265-f9a1e203a652 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:31.946046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcc5e-12de-47ce-a265-f9a1e203a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:31.968265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78dfcc5e-12de-47ce-a265-f9a1e203a652 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:31.969536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78dfcc5e-12de-47ce-a265-f9a1e203a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:31.984653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2509/5025] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:31.993931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:32.010222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a70d1-acf4-4799-bf65-735a348f6826 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:32.016419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:32.020550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:32.020700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.020700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.020700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.028331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:32.029941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8949ea2-6bf8-41c5-8fb4-50bb09bdf687 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:32.045513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2517/5026] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:38:32.059148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.059345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.059468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.095910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:32.100985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:32.105358 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2510/5027] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:32 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:32.107107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.107393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.107668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.179783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:32.181459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:32.197777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2518/5028] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:32.206576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:32.237558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc73229-5e71-48df-ba43-f0eae8fcbc11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:32.242731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:32.243479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.243762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.244035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.437383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.560370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:32.630491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5c8f7-2bf5-4c7b-be43-551cf8c73164 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:32.636913 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2511/5029] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:32 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:32.636913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:32.639064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:32.639064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.639314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.639648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] PATH_INFO: `/v3/users/2fdcb031891541298bf306d2ce1b3ec9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.639821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:32.640913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdcb031891541298bf306d2ce1b3ec9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:32.643132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:32.736020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ecbc-79a1-4738-8f32-7c9a447ba6f5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:32.742957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:32.743580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.743860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.744131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:32.745910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:32.756190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:32.762487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:32.764222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198474b0-a669-4d98-838d-f33e90981d75 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:32.780005 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2512/5030] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:32.843169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdcb031891541298bf306d2ce1b3ec9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.843998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdcb031891541298bf306d2ce1b3ec9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.924531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdcb031891541298bf306d2ce1b3ec9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.943237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdcb031891541298bf306d2ce1b3ec9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.945284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdcb031891541298bf306d2ce1b3ec9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:32.967680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2519/5031] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:32 2022] DELETE /identity/v3/users/2fdcb031891541298bf306d2ce1b3ec9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:32.973921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9ad2-1a8d-4a51-ac7d-b0abbe2e7359 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:32.974179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9ad2-1a8d-4a51-ac7d-b0abbe2e7359 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:32.974401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9ad2-1a8d-4a51-ac7d-b0abbe2e7359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.003823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cc2f9ad2-1a8d-4a51-ac7d-b0abbe2e7359 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:33.008757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc2f9ad2-1a8d-4a51-ac7d-b0abbe2e7359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:33.078302 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2513/5032] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:33.088995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:33.090642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:33.118347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:33.182730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4481a1-103b-4617-a655-36e2bec73d00 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:33.198929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:33.198929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:33.198929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:33.198929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.243858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:33.243858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3000a53-be1d-4ad0-b842-9c723f245c6b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:33.275404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2520/5033] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:33.642297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:33.642297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:33.642297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.663955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:33.665136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:33.668641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2514/5034] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:33.674089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:33.674645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:33.674913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.696265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:33.697447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:33.763027 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2521/5035] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:33.767216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:33.782574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b0861-aad2-4c9c-806d-861ddd9b7d91 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:33.787460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:33.788491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:33.788847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:33.789236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:33.789729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.790772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:33.809381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547278b3-f384-4859-b39e-c4c3b4759a48 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:33.819755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:33.819755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:33.819755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:33.819755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] PATH_INFO: `/v3/projects/8afeb771eda048b18d5ea4091ad4b67e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:33.820073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8afeb771eda048b18d5ea4091ad4b67e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:33.821534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:33.953872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afeb771eda048b18d5ea4091ad4b67e', 'request_id': 'req-08329045-41a1-404d-8b2a-e8b892da1553'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:33.964642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.074206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afeb771eda048b18d5ea4091ad4b67e', 'request_id': 'req-08329045-41a1-404d-8b2a-e8b892da1553'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.085734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afeb771eda048b18d5ea4091ad4b67e', 'request_id': 'req-08329045-41a1-404d-8b2a-e8b892da1553'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.097652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] The token cache is being invalidate because project 8afeb771eda048b18d5ea4091ad4b67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:34.098311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.098800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.100423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2522/5036] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:33 2022] DELETE /identity/v3/projects/8afeb771eda048b18d5ea4091ad4b67e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:34.104424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:34.111087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:34.179055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2515/5037] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:33 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:34.184401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329045-41a1-404d-8b2a-e8b892da1553 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:34.190909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:34.190909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:34.190909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:34.190909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] PATH_INFO: `/v3/users/e476d862ccc943b5a1ba2c37de0b6e18` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:34.192503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e476d862ccc943b5a1ba2c37de0b6e18)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:34.195974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:34.479198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e476d862ccc943b5a1ba2c37de0b6e18'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.479951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e476d862ccc943b5a1ba2c37de0b6e18'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.611295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e476d862ccc943b5a1ba2c37de0b6e18'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.623728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:34.630666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e476d862ccc943b5a1ba2c37de0b6e18'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.636011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d9e99b54-d304-4741-998a-c5a27a7de42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e476d862ccc943b5a1ba2c37de0b6e18'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:34.647748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2523/5038] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:34 2022] DELETE /identity/v3/users/e476d862ccc943b5a1ba2c37de0b6e18 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:35.141657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:35.144218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:35.180035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca542ce-28a2-4632-8d85-63575947b71c tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:35.187924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911e472-8812-4346-8289-f58712dc21ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.188359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911e472-8812-4346-8289-f58712dc21ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.188474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911e472-8812-4346-8289-f58712dc21ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.232236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c911e472-8812-4346-8289-f58712dc21ad None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:35.233450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c911e472-8812-4346-8289-f58712dc21ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:35.249193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2524/5039] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:35.250542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.251049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.251522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.276190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:35.282013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:35.283671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:35.287392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:35.288778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.289240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.289691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] PATH_INFO: `/v3/projects/254ea650587e4515914623ae183e5570` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.291073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254ea650587e4515914623ae183e5570)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:35.293501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:35.383883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2525/5040] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:35.389713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:35.401627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fda20-8f90-4732-a871-9ecff9be1fe1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:35.406672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fe84b-de48-4cd9-a6e3-0080547b6243 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:35.407372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe84b-de48-4cd9-a6e3-0080547b6243 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.407657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe84b-de48-4cd9-a6e3-0080547b6243 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.408068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe84b-de48-4cd9-a6e3-0080547b6243 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.473664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254ea650587e4515914623ae183e5570', 'request_id': 'req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.622785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254ea650587e4515914623ae183e5570', 'request_id': 'req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.628500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7a8fe84b-de48-4cd9-a6e3-0080547b6243 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.630453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254ea650587e4515914623ae183e5570', 'request_id': 'req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.646378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] The token cache is being invalidate because project 254ea650587e4515914623ae183e5570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:35.647466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.648452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7da9bfbc-4ae1-48ec-9cd0-86479e332d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:35.652185 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2516/5041] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:35 2022] DELETE /identity/v3/projects/254ea650587e4515914623ae183e5570 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:35.660599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.661150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.661637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.691704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:35.692919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:35.709092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2526/5042] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:35.777314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2517/5043] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:35.792330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.792330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.792330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.817648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:35.820111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:35.831524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2527/5044] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:35.836703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:35.851884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e085f-e657-4cb5-9f5c-2c5cd48e5934 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:35.857035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:35.857647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.857933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.858210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.858911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:35.859246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:35.860946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:35.880792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2518/5045] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:35.880943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:35.889969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a57a9-f315-45ab-8632-4646534c1e05 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:35.895670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:35.896287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:35.896746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:35.897036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:35.898409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:35.901117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.012603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2528/5046] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:35 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:36.020832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.031580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db89a23-96f4-401b-ba2e-6e0ce8080196 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:36.094146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:36.094816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.095155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.095496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.096287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:36.098495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.223500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.228886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2519/5047] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:36 2022] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:36.238069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb465-b856-41d1-894f-8894be103ba2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:36.246134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:36.247064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.247575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.248050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.248926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:36.250902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.253640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:36.270979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2529/5048] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:36.277735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.285718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:36.291444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df0edb-eec3-4ea3-afc7-242d8f434ff1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:36.300308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:36.301328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.301684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.302074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.302841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:36.304880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c3351-2ad4-48fe-8994-4b1040c641b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.322922 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2520/5049] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:36.326967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.345046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c1f3-1058-4d9c-9a4f-edd24c389339 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:36.352187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:36.352954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.353290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.353572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] PATH_INFO: `/v3/projects/02996bd966df45c8ad62fec8d8afe604/users/59315ba5f8fd4543a4ce3a8272d1e439/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.375979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02996bd966df45c8ad62fec8d8afe604, user_id=59315ba5f8fd4543a4ce3a8272d1e439, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:36.379196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.488506 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2530/5050] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:36 2022] PUT /identity/v3/projects/02996bd966df45c8ad62fec8d8afe604/users/59315ba5f8fd4543a4ce3a8272d1e439/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:36.500803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53212-b364-4ce5-8799-5339342da316 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.501090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53212-b364-4ce5-8799-5339342da316 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.501392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53212-b364-4ce5-8799-5339342da316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.543581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dfc53212-b364-4ce5-8799-5339342da316 None None] MFA Rules not processed for user `59315ba5f8fd4543a4ce3a8272d1e439`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:36.544776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfc53212-b364-4ce5-8799-5339342da316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:36.689123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2521/5051] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:36.693699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.719069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.719069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.719069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.764779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:36.769698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:36.770253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2522/5052] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:38:36.783380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55f46-46b8-43ac-bede-9235328dd39a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:36.793347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:36.794040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:36.794428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:36.795230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:36.795873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:36.801147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:36.934246 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2531/5053] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:36 2022] POST /identity/v3/projects => generated 363 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:36.938293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:36.998856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb358f7a-d849-427f-9376-3433876ed95c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.004138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.004748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.009286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.009286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.009286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.009286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.091869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2523/5054] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:36 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:37.096266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.107676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a4dd-0c95-4317-a996-f6787ccfb59a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.112549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.113177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.113449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.113719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.114357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.116581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.128642 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2532/5055] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:37.132407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.142564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f4d1-dd2a-4da5-8f89-6c303d46f7ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.147393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.148038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.148315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.148582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] PATH_INFO: `/v3/projects/ba4afde727754263b49fb2539401e0e6/users/cd9981fd8541455c936ef6bc7d2b15dc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.164894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4afde727754263b49fb2539401e0e6, user_id=cd9981fd8541455c936ef6bc7d2b15dc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.167618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.259775 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2524/5056] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:37 2022] PUT /identity/v3/projects/ba4afde727754263b49fb2539401e0e6/users/cd9981fd8541455c936ef6bc7d2b15dc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:37.267041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.278884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec7580-0fd0-4c54-97fe-c00fa2e22465 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.343216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.343750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.344039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.344315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.344960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.346689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b4330-3b2e-44f0-9ad5-d9f8e25196c2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.357629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2533/5057] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:37.361857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.373067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22f3f-e5f2-4b7a-b218-42c5c7a9e52b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.378025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.378707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.378987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.379255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] PATH_INFO: `/v3/projects/ba4afde727754263b49fb2539401e0e6/users/cd9981fd8541455c936ef6bc7d2b15dc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.381180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4afde727754263b49fb2539401e0e6, user_id=cd9981fd8541455c936ef6bc7d2b15dc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.383858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.421020 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2525/5058] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:37 2022] PUT /identity/v3/projects/ba4afde727754263b49fb2539401e0e6/users/cd9981fd8541455c936ef6bc7d2b15dc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:37.432575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c403-2929-4b13-974d-5f175f03fb61 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.433251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c403-2929-4b13-974d-5f175f03fb61 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.433765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c403-2929-4b13-974d-5f175f03fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.462350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6978c403-2929-4b13-974d-5f175f03fb61 None None] MFA Rules not processed for user `cd9981fd8541455c936ef6bc7d2b15dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:37.463573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6978c403-2929-4b13-974d-5f175f03fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:37.498044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:37.544879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2534/5059] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:37.554590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.556386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:37.591598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:37.634148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a5b5-9ce1-4094-af98-f90937ca6df1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.654476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.654476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.654476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.654476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.666379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:37.667994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dbfe-6f17-4696-b0cf-4b47d4921918 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:37.681653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2526/5060] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:37.776865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.777403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.777945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.808467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:37.810401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:37.892988 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2535/5061] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:37.901176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b91a-26f7-4d05-9459-efd83a59aadb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.901461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b91a-26f7-4d05-9459-efd83a59aadb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.901792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b91a-26f7-4d05-9459-efd83a59aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.924082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:37.935071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4d39b91a-26f7-4d05-9459-efd83a59aadb None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:37.936292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d39b91a-26f7-4d05-9459-efd83a59aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:37.939846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee06c-cc57-4a88-b467-126bc4c2a6fd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:37.942047 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2527/5062] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:37.946116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:37.946904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8b2d-3463-422b-a6d7-bbd0a3c4d9f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.947267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8b2d-3463-422b-a6d7-bbd0a3c4d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.947487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:37.947664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8b2d-3463-422b-a6d7-bbd0a3c4d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.948066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:37.948501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:37.950759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:38.073655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:38.076436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734e81-8fcd-4ee8-b021-2d7ada978845 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:38.096653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2536/5063] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:38.109986 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-e85e8b2d-3463-422b-a6d7-bbd0a3c4d9f9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:38:38.111870 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2528/5064] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:37 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 166 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 31 14:38:38.116235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:38.116537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:38.116918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:38.279341 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.server.flask.application [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:38:38.283646 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2537/5065] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 169 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 31 14:38:38.287931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:38.288414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:38.288414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:38.318386 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:38:38.320657 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2529/5066] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 34 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 14:38:40.802016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:40.803844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:40.838354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fa2a-b704-41e7-83e4-a2416a7bc63f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:40.845730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:40.846349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:40.846644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:40.846909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:40.931746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:40.959710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:40.966705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df645-6d1a-4b34-8448-85d1edca47d8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:40.982771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2538/5067] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:42.500136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:42.521713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3697e4-30b4-4ac8-b684-5cd3fbbb676d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:42.527077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:42.527942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:42.528420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:42.528875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] PATH_INFO: `/v3/users/59315ba5f8fd4543a4ce3a8272d1e439` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:42.530926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59315ba5f8fd4543a4ce3a8272d1e439)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:42.532859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:42.756446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59315ba5f8fd4543a4ce3a8272d1e439'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:42.757099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59315ba5f8fd4543a4ce3a8272d1e439'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:42.828506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59315ba5f8fd4543a4ce3a8272d1e439'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:42.834872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:42.837726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:42.837726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:42.859505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59315ba5f8fd4543a4ce3a8272d1e439'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:42.863083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b420d6f0-700a-4342-8808-a63deb007ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59315ba5f8fd4543a4ce3a8272d1e439'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:42.878966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:42.880775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:42.896483 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2530/5068] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:42 2022] DELETE /identity/v3/users/59315ba5f8fd4543a4ce3a8272d1e439 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:42.908263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:42.908804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:42.917957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:42.947159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:42.948647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:42.995391 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2539/5069] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:38:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:42.997093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:42.998728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:43.060957 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2531/5070] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:43.072510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:43.075332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:43.097244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:43.102504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcbf8e-7201-45c5-8582-2d0fff46ac83 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:43.191261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877481-8bb1-4fe5-af10-0fa635e2b948 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:43.191667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:43.192943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:43.192943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:43.193162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:43.198544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:43.199387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:43.200377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:43.200809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:43.216012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:43.217944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:43.232093 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2532/5071] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:43.245287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:43.280934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:43.284574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:43.315868 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2540/5072] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:38:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:38:44.672624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:44.677435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:44.741045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2828341-5a08-4cde-be18-5e7e1621d689 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:44.766786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:44.768099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:44.768708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:44.769177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] PATH_INFO: `/v3/projects/02996bd966df45c8ad62fec8d8afe604` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:44.771186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02996bd966df45c8ad62fec8d8afe604)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:44.773954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:44.966149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02996bd966df45c8ad62fec8d8afe604', 'request_id': 'req-efe592bc-2b20-4cba-ae64-c2a5b14917b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.120524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02996bd966df45c8ad62fec8d8afe604', 'request_id': 'req-efe592bc-2b20-4cba-ae64-c2a5b14917b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.129626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02996bd966df45c8ad62fec8d8afe604', 'request_id': 'req-efe592bc-2b20-4cba-ae64-c2a5b14917b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.166830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] The token cache is being invalidate because project 02996bd966df45c8ad62fec8d8afe604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:45.168026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.168964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.172733 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2533/5073] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:44 2022] DELETE /identity/v3/projects/02996bd966df45c8ad62fec8d8afe604 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:45.177604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:45.193793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81ca6-3267-4a5b-97f5-269024dc50b9 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:45.350793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:45.352525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:45.353164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:45.354143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] PATH_INFO: `/v3/users/cd9981fd8541455c936ef6bc7d2b15dc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:45.356310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9981fd8541455c936ef6bc7d2b15dc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:45.358907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:45.628979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9981fd8541455c936ef6bc7d2b15dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.629480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9981fd8541455c936ef6bc7d2b15dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.714120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9981fd8541455c936ef6bc7d2b15dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.743973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9981fd8541455c936ef6bc7d2b15dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.744304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-10505d60-2fe8-4c03-ba24-aed42f837df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9981fd8541455c936ef6bc7d2b15dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:45.776966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2541/5074] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:45 2022] DELETE /identity/v3/users/cd9981fd8541455c936ef6bc7d2b15dc => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:47.036407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:47.036407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:47.068691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe592bc-2b20-4cba-ae64-c2a5b14917b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:47.194570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:47.196264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:47.196264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:47.196459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] PATH_INFO: `/v3/projects/ba4afde727754263b49fb2539401e0e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:47.198209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4afde727754263b49fb2539401e0e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:47.200947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:47.356413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:47.378665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4afde727754263b49fb2539401e0e6', 'request_id': 'req-b2402bff-c6e2-4574-af55-07e4ff692111'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:47.451492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4afde727754263b49fb2539401e0e6', 'request_id': 'req-b2402bff-c6e2-4574-af55-07e4ff692111'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:47.459977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4afde727754263b49fb2539401e0e6', 'request_id': 'req-b2402bff-c6e2-4574-af55-07e4ff692111'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:47.493157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] The token cache is being invalidate because project ba4afde727754263b49fb2539401e0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:47.493461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:47.495281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2402bff-c6e2-4574-af55-07e4ff692111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:47.497998 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2534/5075] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:47 2022] DELETE /identity/v3/projects/ba4afde727754263b49fb2539401e0e6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:47.505093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:47.509369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:47.509369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:47.578706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:47.580016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:47.679714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:47.730838 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2542/5076] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:47.739155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:47.739450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:47.739725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:47.794924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:47.796165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:47.837608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:47.854561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2535/5077] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:47.857214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df477-34bb-49e0-94c0-58e39533b5a4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:47.874180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:47.878824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:47.878824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:47.878824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:47.878824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:47.879257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:47.883872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:47.917311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:47.922493 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2543/5078] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:47.930874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a91f7-14eb-461c-8daa-5109572597bb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:47.942599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:47.943439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:47.943808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:47.944258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:47.945913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:47.948735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:48.076522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:48.077009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2536/5079] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:47 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:48.089656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852434c5-662c-4a96-b08e-33a90cc6ec3f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:48.256065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:48.259012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:48.259638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:48.260183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:48.261224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:48.265293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:48.397162 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2544/5080] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:48 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:48.398457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:48.413560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f2eff-a2a3-4cee-9dd0-d172736b4751 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:48.443099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:48.444153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:48.444681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:48.445865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:48.450126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:48.454950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:48.486553 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2537/5081] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:48.487243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:48.508498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5932af-9ecd-4e1a-aed0-668745304f32 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:48.519451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:48.520232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:48.520624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:48.520996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:48.521991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:48.523984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72d62f-c994-4d7e-ad0d-6bea873ed233 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:48.574308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2545/5082] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:48.576743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:48.629044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff917ad-2053-4b5f-8a89-75bad78ffb28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:48.649082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:48.658793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:48.664836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:48.665195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] PATH_INFO: `/v3/projects/0fc12a69264f4c62a02483d38e407560/users/6eb672bbf76d41ffb65b209e3a73dca1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:48.725950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc12a69264f4c62a02483d38e407560, user_id=6eb672bbf76d41ffb65b209e3a73dca1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:48.730067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:48.859665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69454aa-f130-4d40-ad9d-e093bfb7d2bc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:48.860104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69454aa-f130-4d40-ad9d-e093bfb7d2bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:48.860477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69454aa-f130-4d40-ad9d-e093bfb7d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:48.868179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2538/5083] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:48 2022] PUT /identity/v3/projects/0fc12a69264f4c62a02483d38e407560/users/6eb672bbf76d41ffb65b209e3a73dca1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:48.991526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c69454aa-f130-4d40-ad9d-e093bfb7d2bc None None] MFA Rules not processed for user `6eb672bbf76d41ffb65b209e3a73dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:49.006511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c69454aa-f130-4d40-ad9d-e093bfb7d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:49.142519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2546/5084] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:49.143265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:49.279663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd84b5-9081-42fc-a884-c69b479dc832 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:49.303973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:49.305585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:49.306077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:49.306569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:49.315016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:49.318799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:49.336390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:49.337415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:49.338389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:49.673539 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2539/5085] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:49 2022] POST /identity/v3/projects => generated 393 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:49.681356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:49.721977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:49.734899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:49.744551 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2547/5086] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:49 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:49.750598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:49.752123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:49.837419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:49.844799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:49.886154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e31-29d7-4cb0-9c51-45739edff2b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:49.896656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:49.898322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:49.899679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:49.902882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:49.902882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:49.902882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:49.912659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4e26-4352-45ac-9c0a-e1d0835dcac3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:49.946862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:49.946862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:49.946862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:49.948048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.046862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2540/5087] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:49 2022] POST /identity/v3/users => generated 303 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:50.048750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.068089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfbdc9-7129-4b04-9cb7-1e68d52438ca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.082902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.085320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.085875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.086354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.087007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.098117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.101127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.128165 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2541/5088] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:50.132096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.159685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99979672-03e8-4a33-9d8a-723828e3ca9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.170600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.171415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.173477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.174111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] PATH_INFO: `/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3/users/85cd722d43bb4315ad0c2efcf6dc461c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.191825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2548/5089] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:49 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:50.206113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bb6eb08bb54d8294c89738bfb252c3, user_id=85cd722d43bb4315ad0c2efcf6dc461c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.209125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.291455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.295320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:50.313658 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2542/5090] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:50 2022] PUT /identity/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3/users/85cd722d43bb4315ad0c2efcf6dc461c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:50.319502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.323235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3222ef-9815-4858-a117-0985e545e9b5 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.430127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.430913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.431252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.431589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] PATH_INFO: `/v3/users/02b67c9f5d604a028199c5f133f891ec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.431998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd97caa-50ae-4a85-97b9-47e6a02e87dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.433483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b67c9f5d604a028199c5f133f891ec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.437767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.438633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.440432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.441171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.441605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.442685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.444636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.465282 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2543/5091] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:50.466983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.483727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697c91-f278-4a05-88cb-9698ada3eec4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.489763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.490383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.490687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.504694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] PATH_INFO: `/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3/users/85cd722d43bb4315ad0c2efcf6dc461c/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.504694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bb6eb08bb54d8294c89738bfb252c3, user_id=85cd722d43bb4315ad0c2efcf6dc461c, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.504694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde0e0c-00ca-495f-bbb5-57604fb141b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.516023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2544/5092] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:50 2022] PUT /identity/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3/users/85cd722d43bb4315ad0c2efcf6dc461c/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:50.528327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.532138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.532138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.568335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] MFA Rules not processed for user `85cd722d43bb4315ad0c2efcf6dc461c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:50.569494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:50.682720 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2545/5093] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:50.689176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b67c9f5d604a028199c5f133f891ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.690175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b67c9f5d604a028199c5f133f891ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.691005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:50.692711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:50.724251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:50.770100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b67c9f5d604a028199c5f133f891ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.800430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b67c9f5d604a028199c5f133f891ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.802107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-448a03f0-bea9-4c11-b23a-d44c2906653f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b67c9f5d604a028199c5f133f891ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:50.824023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492642-5a1b-4310-bbb2-7daab97d5467 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:50.831993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:50.832920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:50.833457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:50.833961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:50.834080 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2549/5094] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:50 2022] DELETE /identity/v3/users/02b67c9f5d604a028199c5f133f891ec => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:50.849032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:50.873688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:50.875563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fefac-35bc-4be0-ad1e-4eb993ccdade service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:50.889211 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2546/5095] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:51.194841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.195184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.195453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.223097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:51.224408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.230803 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2550/5096] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:51.232534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d93cd-5c39-49b8-8725-da0155490680 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.232997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d93cd-5c39-49b8-8725-da0155490680 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.233507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d93cd-5c39-49b8-8725-da0155490680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.238333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-332d93cd-5c39-49b8-8725-da0155490680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.268453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:51.269884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.302550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-332d93cd-5c39-49b8-8725-da0155490680 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 31 14:38:51.387435 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:51.388636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:38:51.389617 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:38:51.392883 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2547/5097] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:38:51.402163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1f9c0-a37f-46ff-a1dd-04ed5586ec42 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:51.408324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:51.410351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.410351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.410351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] PATH_INFO: `/v3/projects/30ca5028542442e381f150df0bb94afa` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.413200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ca5028542442e381f150df0bb94afa)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:51.416791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:51.435475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d03bf-fee8-4afd-ae0b-1eeff1433c43 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.436344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d03bf-fee8-4afd-ae0b-1eeff1433c43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.439254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d03bf-fee8-4afd-ae0b-1eeff1433c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.627447 n-d-863055-2 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-7f0d03bf-fee8-4afd-ae0b-1eeff1433c43 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:38:51.632125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2548/5098] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 224 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 14:38:51.636143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.638487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.644077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.659398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ca5028542442e381f150df0bb94afa', 'request_id': 'req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:51.731717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ca5028542442e381f150df0bb94afa', 'request_id': 'req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:51.741660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ca5028542442e381f150df0bb94afa', 'request_id': 'req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:51.758538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] The token cache is being invalidate because project 30ca5028542442e381f150df0bb94afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:51.758786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:51.759460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d5d68ecc-ceca-4413-85bc-dc3fcb3f8fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:51.761495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2551/5099] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:51 2022] DELETE /identity/v3/projects/30ca5028542442e381f150df0bb94afa => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:51.766424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fef27-3300-4f63-861e-822133ef9464 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.766932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fef27-3300-4f63-861e-822133ef9464 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.767434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fef27-3300-4f63-861e-822133ef9464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.772099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:51.774179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.794716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-471fef27-3300-4f63-861e-822133ef9464 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:51.796794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-471fef27-3300-4f63-861e-822133ef9464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.877801 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2552/5100] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:51.889586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.894187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.895630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.930135 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2549/5101] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:51.934510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:51.934684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:51.936469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:51.953488 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2553/5102] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:51.959457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:51.959657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83aa9f-f992-44e0-9421-5a16f0625d85 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:51.971874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:51.972526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.972806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.973710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.981400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34580fc-8b45-46c2-9d72-4a85df3ee997 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:51.989524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:51.991306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:51.991306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:51.991306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:51.992072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:51.992531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:51.994264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.009001 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2554/5103] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:52.016135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.029876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6d6b-3830-4c65-9bc3-886dda0fa52e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.041492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.043661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.044021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.045783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.046533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.049819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.165722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.173005 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2555/5104] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:52 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:52.177343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.186946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:52.201647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:52.293143 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2550/5105] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:51 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:52.305377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ba7fe-7eca-4771-9318-b77bebf33a2e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.313292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.313887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.314169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.314441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.315174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.317339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.438494 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2556/5106] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:52 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:38:52.442332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.462181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b897980-6541-4c67-97ad-fc64e5265fb3 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.470217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.471126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.471572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.471812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.472619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.474287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.494259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2551/5107] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:52.498998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.513532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10db9-d2ca-4c95-a683-814cf34ffac2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.531049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.534226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.534226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.534603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.535039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.536997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.553767 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2557/5108] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:52.557901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.571529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d22f-881b-41ad-9415-ecd8c7da2988 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.579650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.580307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.580582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.580926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] PATH_INFO: `/v3/projects/74c6b33d769343f3bc01d5149a0dd516/users/6dd5dddaa798423f9906c4832991c404/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.599947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c6b33d769343f3bc01d5149a0dd516, user_id=6dd5dddaa798423f9906c4832991c404, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.603735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f6094-7d17-4997-8d26-fe6e6cf847cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.619824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.621645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:52.638117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d975d0-3d96-42ea-a6fd-14b5883162e3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.643956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.644719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.645108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.645488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] PATH_INFO: `/v3/users/f3b7ea18f94a4dfcaf5e7d3f8b934163` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.646755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b7ea18f94a4dfcaf5e7d3f8b934163)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.648888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.714765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2552/5109] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:52 2022] PUT /identity/v3/projects/74c6b33d769343f3bc01d5149a0dd516/users/6dd5dddaa798423f9906c4832991c404/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:52.716151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.716438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.716716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.737682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:52.738962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:52.799760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2553/5110] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:52.812982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:52.814440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:52.859948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b7ea18f94a4dfcaf5e7d3f8b934163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.862077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b7ea18f94a4dfcaf5e7d3f8b934163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.892601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acf26e-bfbd-45b6-9405-8aee79887013 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:52.896445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:52.897076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:52.897380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:52.897653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:52.899447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:52.911559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:52.913000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911d5c-0f8d-45de-a654-30939ffbbb39 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:52.924459 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2554/5111] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:52.931349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b7ea18f94a4dfcaf5e7d3f8b934163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.955432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b7ea18f94a4dfcaf5e7d3f8b934163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.956696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b7ea18f94a4dfcaf5e7d3f8b934163'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:52.986196 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2558/5112] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:52 2022] DELETE /identity/v3/users/f3b7ea18f94a4dfcaf5e7d3f8b934163 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:53.298203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262e8c-2096-4da3-ba49-07f906901625 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:53.298748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262e8c-2096-4da3-ba49-07f906901625 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:53.298850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262e8c-2096-4da3-ba49-07f906901625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:53.313835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:53.315164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:53.379080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d7262e8c-2096-4da3-ba49-07f906901625 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:53.383474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7262e8c-2096-4da3-ba49-07f906901625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:53.397631 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2555/5113] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:53.405022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:53.405399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:53.405681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:53.454470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:53.457202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:53.486640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:53.517128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0c80-453f-47de-b6d6-2df4ffde1ce1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:53.533736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:53.534605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:53.535089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:53.535371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] PATH_INFO: `/v3/projects/444a218f033c48e8836100b76f49bf1b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:53.536811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=444a218f033c48e8836100b76f49bf1b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:53.539747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:53.579537 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2556/5114] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:53.582099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:53.587839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:53.591916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6169-7ba3-4e4c-b4a1-53d989b6f9a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:53.603423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263551d-84ec-45ee-812e-740519eaa061 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:53.604099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263551d-84ec-45ee-812e-740519eaa061 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:53.604496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263551d-84ec-45ee-812e-740519eaa061 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:53.605463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263551d-84ec-45ee-812e-740519eaa061 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:53.692793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444a218f033c48e8836100b76f49bf1b', 'request_id': 'req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.858328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444a218f033c48e8836100b76f49bf1b', 'request_id': 'req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.864685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3263551d-84ec-45ee-812e-740519eaa061 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.877901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444a218f033c48e8836100b76f49bf1b', 'request_id': 'req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.892611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] The token cache is being invalidate because project 444a218f033c48e8836100b76f49bf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:53.895381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.895381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:53.897749 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2559/5115] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:53 2022] DELETE /identity/v3/projects/444a218f033c48e8836100b76f49bf1b => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:53.902074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:53.903721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:53.949403 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2557/5116] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:53 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:54.012704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb78b7-1588-4f0d-9036-8ea3f79bd3fd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:54.053879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:54.054668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:54.054944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:54.055797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] PATH_INFO: `/v3/users/2fba039929954f14a57e507e55d9a19f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:54.057074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fba039929954f14a57e507e55d9a19f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:54.060112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:54.109094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8e63-aa6a-479a-92f6-488bd05d8a7a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:54.109307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8e63-aa6a-479a-92f6-488bd05d8a7a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:54.109589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8e63-aa6a-479a-92f6-488bd05d8a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:54.169469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c55b8e63-aa6a-479a-92f6-488bd05d8a7a None None] MFA Rules not processed for user `6dd5dddaa798423f9906c4832991c404`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:54.171127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c55b8e63-aa6a-479a-92f6-488bd05d8a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:54.240836 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2558/5117] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:54.251033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:54.251393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:54.252282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:54.275445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] MFA Rules not processed for user `6dd5dddaa798423f9906c4832991c404`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:54.276690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:54.287751 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2559/5118] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:54.300211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:54.303217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:54.309063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fba039929954f14a57e507e55d9a19f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:54.309874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fba039929954f14a57e507e55d9a19f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:54.397431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887c3c-8155-4da2-afb5-47526525b9f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:54.405851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:54.406426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fba039929954f14a57e507e55d9a19f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:54.406875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:54.407317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:54.407685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:54.420965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:54.437119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fba039929954f14a57e507e55d9a19f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:54.439033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c05b68d1-a7d0-4f1d-aad0-749ff15e588f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fba039929954f14a57e507e55d9a19f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:54.449089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:54.453621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05168df2-980d-4480-8b64-7d8328f41678 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:54.461939 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2560/5119] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:53 2022] DELETE /identity/v3/users/2fba039929954f14a57e507e55d9a19f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:54.464215 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2560/5120] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:54.954347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:54.954931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:54.954931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:54.976288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:55.008254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:55.010167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:55.021114 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2561/5121] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:55.022901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:55.024183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:55.024183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:55.050053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:55.051942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:55.097998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:55.143111 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2561/5122] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:55.148558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:55.161155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74de3f-1f12-48d9-9c2c-9c619abced80 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:55.170411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83ba7cb08aa241f783f367d8b2f442cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1950498bde246afa3f48c3494479adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:55.171337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:55.171835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:55.172301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:55.387181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:55.388719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:55.497893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.513636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e46cf-1656-469c-8805-5357516b0ff3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:55.532971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:55.533895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:55.534413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:55.534826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] PATH_INFO: `/v3/projects/f801301aaf054a1eaa7066d7dc1309f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:55.537360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f801301aaf054a1eaa7066d7dc1309f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:55.541591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:55.630868 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2562/5123] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:38:55 2022] POST /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb/password => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:55.630868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:55.632958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:55.668603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9ae5b-217e-4dca-badd-86561b142b19 tempest-IdentityV3UsersTest-585383381 tempest-IdentityV3UsersTest-585383381-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:55.690488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:55.691978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:55.691978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:55.691978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] PATH_INFO: `/v3/users/6dd5dddaa798423f9906c4832991c404` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:55.693875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd5dddaa798423f9906c4832991c404)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:55.696307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:55.756820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f801301aaf054a1eaa7066d7dc1309f5', 'request_id': 'req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.862890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f801301aaf054a1eaa7066d7dc1309f5', 'request_id': 'req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.875381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f801301aaf054a1eaa7066d7dc1309f5', 'request_id': 'req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.889961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] The token cache is being invalidate because project f801301aaf054a1eaa7066d7dc1309f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:55.895517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.895517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:55.895517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2562/5124] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:55 2022] DELETE /identity/v3/projects/f801301aaf054a1eaa7066d7dc1309f5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:55.895517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:55.897158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:55.988630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1a6a-baf9-46ac-8f7d-82211e94adc8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:55.997370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:55.998084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:55.998686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:55.998955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] PATH_INFO: `/v3/users/6eb672bbf76d41ffb65b209e3a73dca1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.001582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb672bbf76d41ffb65b209e3a73dca1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:56.003178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:56.025549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd5dddaa798423f9906c4832991c404'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.030035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd5dddaa798423f9906c4832991c404'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.126077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd5dddaa798423f9906c4832991c404'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.146819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd5dddaa798423f9906c4832991c404'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.148530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-58e1a1f5-249c-40b7-8469-136433948010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd5dddaa798423f9906c4832991c404'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.181433 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2563/5125] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:55 2022] DELETE /identity/v3/users/6dd5dddaa798423f9906c4832991c404 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:56.183207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5eaa6-6c52-4869-90bf-783ba5eb5969 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.183496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5eaa6-6c52-4869-90bf-783ba5eb5969 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.183768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5eaa6-6c52-4869-90bf-783ba5eb5969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.204243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-42c5eaa6-6c52-4869-90bf-783ba5eb5969 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:56.205734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42c5eaa6-6c52-4869-90bf-783ba5eb5969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.275596 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2564/5126] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:56.283128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.283468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.284457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.309498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:56.310745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.324883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2565/5127] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:56.326566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:56.339911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb672bbf76d41ffb65b209e3a73dca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.341098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb672bbf76d41ffb65b209e3a73dca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.343553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c269-4bf6-4b78-a83d-b1e88331937b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:56.349191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:56.349671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.349950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.350219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.350899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:56.351815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:56.353475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:56.370673 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2566/5128] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:56.373762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:56.377825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.393145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d5d5-60af-40e6-8b50-486cea8a9297 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:56.398876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:56.404011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.404011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.404011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.404011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:56.404011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:56.423282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb672bbf76d41ffb65b209e3a73dca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.437088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb672bbf76d41ffb65b209e3a73dca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.437839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-348cb441-9635-48e9-826f-b89f88f4dadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb672bbf76d41ffb65b209e3a73dca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.452550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2563/5129] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:55 2022] DELETE /identity/v3/users/6eb672bbf76d41ffb65b209e3a73dca1 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:56.456762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.457064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.457392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.477876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:56.479323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.534479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2567/5130] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:56.535778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:56.539685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.550592 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2564/5131] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:38:56.552326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:56.572489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7090-efeb-4969-8336-4a5e1189ea60 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:56.625129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073589e-f746-4ee2-9884-12c4963705bd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:56.630954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:56.635490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.635490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.635490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] PATH_INFO: `/v3/projects/74c6b33d769343f3bc01d5149a0dd516` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.635490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c6b33d769343f3bc01d5149a0dd516)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:56.637359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:56.659943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:56.660575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.660857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.661187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.661839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:56.663878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:56.771256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c6b33d769343f3bc01d5149a0dd516', 'request_id': 'req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.789119 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2565/5132] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:56.789119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:56.792227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.873487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:56.894349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7f27a-12cd-4f03-a941-1a1e03fc0f5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:56.919472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c6b33d769343f3bc01d5149a0dd516', 'request_id': 'req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.927250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c6b33d769343f3bc01d5149a0dd516', 'request_id': 'req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.949018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] The token cache is being invalidate because project 74c6b33d769343f3bc01d5149a0dd516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:56.949702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.951495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1e3c1ed2-29db-42fa-a184-6cb1abce6fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:56.966059 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2568/5133] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:56 2022] DELETE /identity/v3/projects/74c6b33d769343f3bc01d5149a0dd516 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:56.967391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.968266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.968559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.985671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:56.987156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:56.987444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:56.987723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:56.989812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:56.994220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:56.996531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.000563 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2569/5134] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:38:57.001934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.003892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.083601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.084015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d326804-6f3d-4be5-a0ed-679af4d5ac66 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.084994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.090143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.090920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.091294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.091644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.092369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.094160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f69b-cb61-4796-8e40-3c696d4b6b37 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.108848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2570/5136] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:57.108848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1181c-4920-47f0-8b0b-1fd687f1acec None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.109145 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2566/5136] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:57.109271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1181c-4920-47f0-8b0b-1fd687f1acec None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.109271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1181c-4920-47f0-8b0b-1fd687f1acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.110345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.131853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76497cd8-03ab-4bf9-94ab-cac98eee72dd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.135267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-30f1181c-4920-47f0-8b0b-1fd687f1acec None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:57.135386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30f1181c-4920-47f0-8b0b-1fd687f1acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.141963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.142811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.145352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.145721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.146449 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2571/5137] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:57.146587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.148310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.156376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.156376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.156715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.177228 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2567/5138] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:57.183389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:57.184757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.187659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.197999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0e19-4ca3-4124-befe-41bbfc2145d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.203714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.204681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.205155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.205700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] PATH_INFO: `/v3/projects/02c599acfaf7477aa05fb351e8e389ba/users/a29fb36f4f794981a0dcf92416022670/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.210484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2572/5139] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:57.211479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.223714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb300a-6367-4e27-9852-82c820b57094 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.230808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.231946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.231946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.232205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.232931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:57.233234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.234920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c599acfaf7477aa05fb351e8e389ba, user_id=a29fb36f4f794981a0dcf92416022670, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.235092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.239036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438bbb3-422c-4c28-9018-720e3c2f26b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.250827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2573/5140] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:57.259672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.272643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019244e3-b9a5-407d-a5de-8f73febbfe79 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.280831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.281518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.281790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.282071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.283012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.285425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.335229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2568/5141] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:57 2022] PUT /identity/v3/projects/02c599acfaf7477aa05fb351e8e389ba/users/a29fb36f4f794981a0dcf92416022670/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:57.356918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.357271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.357519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.394311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2574/5142] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:57.398141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:57.399255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.399503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.504695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7a157-a236-4a30-9d2a-807dd93b8828 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.510166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.510906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.511164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.511609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.512275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.514995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.526098 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2569/5143] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:57.536382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.538061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.630276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29df8a-8c30-4c41-b90e-f73775003b11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.634308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:57.638886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.644256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.644256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.644256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.645042 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2575/5144] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:38:57.645892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.655606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.657081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2656e-7f33-464b-947b-ef646af4644e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.657220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.665850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.666664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.667075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.667452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.668586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.669007 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2570/5145] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:38:57.670655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.687275 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2576/5146] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:38:57.692833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.706588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ce0-6a84-4c98-80bf-096fb92ccb12 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.711370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.713460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:57.728323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.729413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.729848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.730277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.731362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.734825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5170-7aac-4d4b-a020-dcac88c43e0c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.736378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.742490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.743657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.744584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.745119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] PATH_INFO: `/v3/projects/0fc12a69264f4c62a02483d38e407560` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.746340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc12a69264f4c62a02483d38e407560)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.748942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.767593 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2571/5147] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:38:57.771598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:57.784025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145abb-c593-4f02-a675-e7e2150c9bc9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:57.789989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:57.790831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.791166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.791879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] PATH_INFO: `/v3/projects/996836f46be04880be0a880fad2d493c/users/a55fa5e6656648faaf79309f68a9f9af/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.808055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996836f46be04880be0a880fad2d493c, user_id=a55fa5e6656648faaf79309f68a9f9af, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:57.811323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddbe75-fccd-4579-a20e-783db53df826 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:57.916431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2572/5148] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:38:57 2022] PUT /identity/v3/projects/996836f46be04880be0a880fad2d493c/users/a55fa5e6656648faaf79309f68a9f9af/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:57.922037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:57.922037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:57.922258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:57.933158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc12a69264f4c62a02483d38e407560', 'request_id': 'req-eaead62a-5732-4313-b6e0-541c2b2e936a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:57.957905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:57.959165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:58.009554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc12a69264f4c62a02483d38e407560', 'request_id': 'req-eaead62a-5732-4313-b6e0-541c2b2e936a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.016338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc12a69264f4c62a02483d38e407560', 'request_id': 'req-eaead62a-5732-4313-b6e0-541c2b2e936a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.033791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] The token cache is being invalidate because project 0fc12a69264f4c62a02483d38e407560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:58.034082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.035329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaead62a-5732-4313-b6e0-541c2b2e936a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.038167 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2577/5149] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:57 2022] DELETE /identity/v3/projects/0fc12a69264f4c62a02483d38e407560 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:58.040053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:58.040329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:58.040595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:58.054597 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2573/5150] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:58.054597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:58.064714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:58.067484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] MFA Rules not processed for user `83ba7cb08aa241f783f367d8b2f442cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:58.068850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:58.089361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0052d6-9fe8-4f2c-a00a-8c59dcb020a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:58.096374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:58.097211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:58.097646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:58.098074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] PATH_INFO: `/v3/users/85cd722d43bb4315ad0c2efcf6dc461c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:58.099514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cd722d43bb4315ad0c2efcf6dc461c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:58.102409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:58.154557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2578/5151] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:58.156070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:58.158674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:58.235465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929eb42-1ad9-4d4d-9ea6-492475fa8d54 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:58.240511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:58.241272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:58.241799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:58.242142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:58.270362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:58.271795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:58.304061 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2579/5152] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:58.306819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:58.308538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:58.327622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c75a-678b-4253-9f74-449044ce56d1 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:58.334681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:58.336447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:58.336447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:58.336808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] PATH_INFO: `/v3/users/83ba7cb08aa241f783f367d8b2f442cb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:58.338992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ba7cb08aa241f783f367d8b2f442cb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:58.341284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:58.374607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cd722d43bb4315ad0c2efcf6dc461c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.376314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cd722d43bb4315ad0c2efcf6dc461c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.519959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cd722d43bb4315ad0c2efcf6dc461c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.548090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cd722d43bb4315ad0c2efcf6dc461c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.548939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-542b53d0-e25f-4360-b498-89437d053504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cd722d43bb4315ad0c2efcf6dc461c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.579684 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2574/5153] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:58 2022] DELETE /identity/v3/users/85cd722d43bb4315ad0c2efcf6dc461c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:58.700462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:58.748176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.749402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.869063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.892631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.894462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ba7cb08aa241f783f367d8b2f442cb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:58.921122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:38:58.927216 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2580/5154] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:38:58 2022] DELETE /identity/v3/users/83ba7cb08aa241f783f367d8b2f442cb => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:38:58.929203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:58.930936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:58.931073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:58.977857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:58.979043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:59.091850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:59.093844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:59.187943 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2575/5155] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:59.200166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:59.204150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:59.287582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8613e7c-d096-4667-b677-54716ddddc06 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:59.302703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:59.303361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.303647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.303917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] PATH_INFO: `/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.306793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bb6eb08bb54d8294c89738bfb252c3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:59.313308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:59.375253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141137-5274-426b-9342-d83bd28ca1c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:59.381211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:59.381911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.382262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.383209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.393532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:59.396106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce892-e6d2-40f8-bc7b-3a6243e2140d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:59.409260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2576/5156] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:38:59.503679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bb6eb08bb54d8294c89738bfb252c3', 'request_id': 'req-a85653e3-a547-443a-855f-6ef191c89de1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:59.623824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bb6eb08bb54d8294c89738bfb252c3', 'request_id': 'req-a85653e3-a547-443a-855f-6ef191c89de1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:59.649283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bb6eb08bb54d8294c89738bfb252c3', 'request_id': 'req-a85653e3-a547-443a-855f-6ef191c89de1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:59.681682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] The token cache is being invalidate because project d0bb6eb08bb54d8294c89738bfb252c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:38:59.682529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:59.683963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a85653e3-a547-443a-855f-6ef191c89de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:38:59.687725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2581/5157] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:38:59 2022] DELETE /identity/v3/projects/d0bb6eb08bb54d8294c89738bfb252c3 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:38:59.692961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.695115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.695583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.724686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:59.731375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:59.831497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2577/5158] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:59.840532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.842688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.842688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.881438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:38:59.882807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:38:59.895908 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2582/5159] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:38:59.897183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:59.911485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2ba85-658e-4873-9e16-6655dd01f5d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:59.919477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:59.920829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.922894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.922894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.922894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:38:59.922894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:59.924219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:59.945934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2578/5160] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:38:59.950182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:38:59.967811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04460b89-0922-440c-9799-04d36dcb5a4e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:38:59.973853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:38:59.974567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:38:59.975036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:38:59.975316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:38:59.977706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:38:59.981275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:38:59.987231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:00.095018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2583/5161] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:00.098807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:00.124959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea29ae-4463-43ea-9d1c-9ea663f2ab29 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:00.145206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:00.251392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:00.252298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:00.252691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:00.253045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:00.253766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:00.255836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:00.463177 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2579/5162] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:00 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:00.483744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:00.512744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4f169-6314-4aa1-8135-fa54b6a41966 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:00.521803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:00.522696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:00.523813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:00.524314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:00.525165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:00.527023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:00.554726 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2584/5163] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:00.559647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:00.585424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69379102-fba0-4d48-916b-dfaf1c9e8080 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:00.591516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da98bb-dd58-4a0b-a46a-cc0bdb829fca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:00.679755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2580/5164] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:00.683235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:00.694215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072707ce-b3d1-4fb3-a31f-bc3103ebc9bd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:00.699982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:00.700936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:00.701083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:00.701270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] PATH_INFO: `/v3/projects/ca13d22c43e8479e97c3d306dee0dd81/users/1d125f85890b4cf087e729a1d0f44fbc/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:00.732047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca13d22c43e8479e97c3d306dee0dd81, user_id=1d125f85890b4cf087e729a1d0f44fbc, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:00.735115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:00.914912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:01.025517 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2585/5165] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:00 2022] PUT /identity/v3/projects/ca13d22c43e8479e97c3d306dee0dd81/users/1d125f85890b4cf087e729a1d0f44fbc/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:01.035845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:01.036301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:01.036646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:01.064635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:01.070072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:01.095120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:01.158535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] MFA Rules not processed for user `1d125f85890b4cf087e729a1d0f44fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:01.163827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:01.392955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2581/5166] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:01.397372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:01.406522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809b304-9dd8-48b4-9d73-34ad90853974 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:01.415880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14c778-2d88-4e78-b839-df7cba8922c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:01.418052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:01.420015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:01.420015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:01.420015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] PATH_INFO: `/v3/projects/c1950498bde246afa3f48c3494479adc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:01.422484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1950498bde246afa3f48c3494479adc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:01.425666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:01.431422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:01.431602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:01.431855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:01.432028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:01.432679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:01.440251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:01.661019 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2582/5167] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:01 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:01.665127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:01.703722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1950498bde246afa3f48c3494479adc', 'request_id': 'req-8369db0e-e084-4949-a5fc-8ec3376aa7d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:01.819599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03475d3-4f9d-48ae-89f2-c3f1e118eddc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:01.833220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:01.834051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1950498bde246afa3f48c3494479adc', 'request_id': 'req-8369db0e-e084-4949-a5fc-8ec3376aa7d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:01.834521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:01.836139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:01.836457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:01.837124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:01.843914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1950498bde246afa3f48c3494479adc', 'request_id': 'req-8369db0e-e084-4949-a5fc-8ec3376aa7d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:01.849780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:01.874906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] The token cache is being invalidate because project c1950498bde246afa3f48c3494479adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:01.875510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:01.876770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8369db0e-e084-4949-a5fc-8ec3376aa7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:01.889127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2586/5168] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:01 2022] DELETE /identity/v3/projects/c1950498bde246afa3f48c3494479adc => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:01.893167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745779-39bf-4b13-b2f5-9688937c4783 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:01.895584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745779-39bf-4b13-b2f5-9688937c4783 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:01.896068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745779-39bf-4b13-b2f5-9688937c4783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:01.952024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-30745779-39bf-4b13-b2f5-9688937c4783 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:01.953310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30745779-39bf-4b13-b2f5-9688937c4783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:01.994086 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2587/5169] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:02.007126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.007787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.008359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.030375 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2583/5170] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:01 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:02.031572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.033648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:02.052059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4478-3c21-4ea0-b80b-26de727268a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.064428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.065149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.065486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.065769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.066424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.077242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.092286 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2584/5171] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:39:02.095152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.109504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a009-7022-4dcd-a57c-6beca2185fe4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.110004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:02.113265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:02.115154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.115748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.116036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.116311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] PATH_INFO: `/v3/projects/fe5f51a023e24f43a478d77f12f5f62a/users/ec63f183b7004c4cae88bee041fb7040/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.138218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5f51a023e24f43a478d77f12f5f62a, user_id=ec63f183b7004c4cae88bee041fb7040, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.142089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.151960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2588/5172] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:02.159000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.197313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bd25f-07b7-4f31-ad13-a0808884a159 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.223201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.229163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.229714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.233481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.234516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:02.235245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.237220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.254200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2585/5173] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:02 2022] PUT /identity/v3/projects/fe5f51a023e24f43a478d77f12f5f62a/users/ec63f183b7004c4cae88bee041fb7040/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:02.258428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.277914 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2589/5174] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:02.283684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.305216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9523c-f173-4149-a01a-dd98fae443dc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.420825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5aa37-8fb4-494f-93f1-698bce10107a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.459491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.465246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.465795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.467405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.469050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.472147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.472779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.473059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.473331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.473988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.474768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.475617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.504692 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2586/5175] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:39:02.505719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.524962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585667-53c2-442f-927d-162c3d2df5e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.532285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.534225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.534752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.536801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] PATH_INFO: `/v3/projects/fe5f51a023e24f43a478d77f12f5f62a/users/ec63f183b7004c4cae88bee041fb7040/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.541388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5f51a023e24f43a478d77f12f5f62a, user_id=ec63f183b7004c4cae88bee041fb7040, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.544663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd74ab-1139-4b2b-8f35-4c4d127b68f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.571160 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2587/5176] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:02 2022] PUT /identity/v3/projects/fe5f51a023e24f43a478d77f12f5f62a/users/ec63f183b7004c4cae88bee041fb7040/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:39:02.575560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.578343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.578343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.616985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] MFA Rules not processed for user `ec63f183b7004c4cae88bee041fb7040`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:02.624325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2590/5177] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:02 2022] POST /identity/v3/projects => generated 387 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:02.624467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:02.624579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.763811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37579c1d-3120-4859-8950-6c4f6f7d5a2a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.775073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.776126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.776126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.776477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.777188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.780681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:02.780871 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2588/5178] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:02.794071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.796242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:02.952418 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2591/5179] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:02 2022] POST /identity/v3/users => generated 300 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:02.954476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:02.970775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae4c75-6556-4f0c-8e5d-125977e52c20 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.974425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03c96-b3b8-4cab-b15b-d725c825ab2a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:02.978882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.983965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.983965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.983965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.989727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:02.991186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:02.991470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:02.991787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:02.992514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:02.994161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:03.001019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:03.003198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:03.012151 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2592/5180] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:03.020154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:03.032615 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2589/5181] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:03.049937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b50c8-4589-4bb0-81f3-7c36b768789b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:03.060961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:03.061881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:03.062427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:03.062904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] PATH_INFO: `/v3/projects/c3b98be541f04788866be8ffbb9d42f9/users/3142069c9d3544608856cb430b4b8b74/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:03.083599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b98be541f04788866be8ffbb9d42f9, user_id=3142069c9d3544608856cb430b4b8b74, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:03.087017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:03.223069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:03.235810 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2593/5182] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:03 2022] PUT /identity/v3/projects/c3b98be541f04788866be8ffbb9d42f9/users/3142069c9d3544608856cb430b4b8b74/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:39:03.237892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:03.253470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55141-d0bd-4449-aa98-01d0d2a5f04e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:03.361135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:03.411571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:03.412354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:03.412710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:03.413309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:03.414646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:03.416476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c1c51-04f4-4e54-99f1-5a7bf184a53b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:03.447126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2590/5183] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:03.452265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:03.472891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f0d1-de98-41e9-91e5-806ceb6429ad admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:03.493113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:03.495104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:03.495104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:03.495104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] PATH_INFO: `/v3/projects/c3b98be541f04788866be8ffbb9d42f9/users/3142069c9d3544608856cb430b4b8b74/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:03.509532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b98be541f04788866be8ffbb9d42f9, user_id=3142069c9d3544608856cb430b4b8b74, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:03.513557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:03.544338 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2594/5184] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:03 2022] PUT /identity/v3/projects/c3b98be541f04788866be8ffbb9d42f9/users/3142069c9d3544608856cb430b4b8b74/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:03.558327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39308db-724c-470f-8353-4989feadd754 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:03.558603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39308db-724c-470f-8353-4989feadd754 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:03.558899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39308db-724c-470f-8353-4989feadd754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:03.633071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c39308db-724c-470f-8353-4989feadd754 None None] MFA Rules not processed for user `3142069c9d3544608856cb430b4b8b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:03.634374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c39308db-724c-470f-8353-4989feadd754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:03.860590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:03.864859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2591/5185] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:03.971590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2444884-d7bd-47e5-a2fc-2627c26782b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:03.993500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:04.000608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.001116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.001469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.003072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:04.007942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:04.230319 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2595/5186] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:03 2022] POST /identity/v3/projects => generated 387 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:04.239203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39308db-724c-470f-8353-4989feadd754 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:04.254766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39308db-724c-470f-8353-4989feadd754 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:04.355253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:04.358887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.358887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.358887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.358887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:04.360437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:04.525848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2592/5187] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:04 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:04.529882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:04.543783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cee750-da91-498b-bd1b-57eb88171105 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:04.549840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:04.550471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.550785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.551065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.551989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:04.553631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:04.568246 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2596/5188] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:04.573744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:04.590901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834301d3-925e-4e4b-afc0-b50a734a28fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:04.600816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:04.601220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.601502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.601855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.602944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:04.604568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4cc4f-bbaa-495d-aff2-68d5441ef6a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:04.621276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2593/5189] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:04.622308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:04.637175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bed72a-54fa-46f0-8966-126f1705838e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:04.651032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:04.651819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.656353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.656353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] PATH_INFO: `/v3/projects/42a2dd8c52be4aaf924bd36021cbeeb1/users/18bdd9e67e2b4ef08a02f4005ff6c591/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.681656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a2dd8c52be4aaf924bd36021cbeeb1, user_id=18bdd9e67e2b4ef08a02f4005ff6c591, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:04.692954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:04.829992 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2597/5190] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:04 2022] PUT /identity/v3/projects/42a2dd8c52be4aaf924bd36021cbeeb1/users/18bdd9e67e2b4ef08a02f4005ff6c591/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:04.841773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8309-0977-40ac-b467-0bebbd6eb515 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:04.842513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8309-0977-40ac-b467-0bebbd6eb515 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:04.843350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8309-0977-40ac-b467-0bebbd6eb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:04.898084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eebe8309-0977-40ac-b467-0bebbd6eb515 None None] MFA Rules not processed for user `18bdd9e67e2b4ef08a02f4005ff6c591`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:04.899762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eebe8309-0977-40ac-b467-0bebbd6eb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:05.006803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:05.034518 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2594/5191] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:05.048240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:05.050376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:05.140864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213ec7b-05cd-48d9-8b52-5c30ace8a7e8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:05.145390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:05.146223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:05.146989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:05.147457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:05.184348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:05.184617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:05.184897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:05.211208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:05.216168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:05.266233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:05.271015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:05.298387 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2598/5192] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:05.332909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2595/5193] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:39:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:05.360925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:05.362323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:05.518995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881ae2-b924-4ba9-9aea-f93f0eae28f8 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:05.537347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:05.537347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:05.537347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:05.537347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:05.552971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:05.558723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c493d-49ee-4a74-9a27-5ec41a744b5c service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:05.593449 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2599/5194] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:05.995168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:06.623109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:07.792614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:07.951718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c311bb-c7fa-407b-807f-ebb349d83abb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:07.965509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:07.966154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:07.966432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:07.966731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] PATH_INFO: `/v3/users/3142069c9d3544608856cb430b4b8b74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:07.968360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3142069c9d3544608856cb430b4b8b74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:07.970280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:08.263135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3142069c9d3544608856cb430b4b8b74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:08.266277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3142069c9d3544608856cb430b4b8b74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:08.348439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3142069c9d3544608856cb430b4b8b74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:08.370396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3142069c9d3544608856cb430b4b8b74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:08.372338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3142069c9d3544608856cb430b4b8b74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:08.400406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2596/5195] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:07 2022] DELETE /identity/v3/users/3142069c9d3544608856cb430b4b8b74 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:08.405200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:08.406907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:08.407362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:08.429894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:08.432220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:08.495739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:08.540448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2600/5196] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:08.550660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:08.553119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:08.674275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5687-80ed-4fb1-bd1e-3e3bd7665b50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:08.685478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:08.686100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:08.687622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:08.687918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:08.705261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:08.707030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104ef39-1aac-460f-b23b-c3436aae45d6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:08.718471 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2597/5197] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:08.931691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:09.122893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:09.127625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:09.148672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7186dc-24f9-4502-a6bf-c4344e096a1e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:09.171259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:09.171517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:09.182460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:09.183203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] PATH_INFO: `/v3/users/1d125f85890b4cf087e729a1d0f44fbc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:09.184793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d125f85890b4cf087e729a1d0f44fbc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:09.186992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:09.292573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:09.514902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d125f85890b4cf087e729a1d0f44fbc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:09.515803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d125f85890b4cf087e729a1d0f44fbc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:09.623113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d125f85890b4cf087e729a1d0f44fbc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:09.644554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d125f85890b4cf087e729a1d0f44fbc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:09.672428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a3df3bd3-4ce5-4c7d-bf75-08cba576827e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d125f85890b4cf087e729a1d0f44fbc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:09.695042 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2601/5198] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:09 2022] DELETE /identity/v3/users/1d125f85890b4cf087e729a1d0f44fbc => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:09.699886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:09.700076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:09.700358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:09.732227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:09.733832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:09.841927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:09.850518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:09.851575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:09.865685 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2598/5199] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:09.876153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:09.878182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:09.920105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] MFA Rules not processed for user `a55fa5e6656648faaf79309f68a9f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:09.921347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:10.027688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e54fbf-9f64-4da2-82a0-a2cdcb0d5c6f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:10.034845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:10.035029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:10.035498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:10.035868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:10.043043 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2602/5200] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:10.048137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:10.049868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:10.059672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:10.070654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:10.079170 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2599/5201] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:10.120285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:10.226119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f21a2-f5c1-4138-9d9f-e8fd07568af9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:10.234200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:10.235165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:10.235519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:10.236317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:10.250282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:10.252449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:10.279108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2603/5202] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:10.520130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:10.794427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:10.799139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:10.828284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9d52f-6749-4371-908d-9f7e1ff71d67 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:10.843737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:10.844739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:10.845023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:10.845484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] PATH_INFO: `/v3/projects/ca13d22c43e8479e97c3d306dee0dd81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:10.847675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca13d22c43e8479e97c3d306dee0dd81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:10.852974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:10.936648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:10.938859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:10.959191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309564a-8a0b-45fd-a1fe-d5d118094f4e service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:10.969939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:10.970587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:10.970891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:10.971168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] PATH_INFO: `/v3/projects/c3b98be541f04788866be8ffbb9d42f9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:10.975541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b98be541f04788866be8ffbb9d42f9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:10.980466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:10.995960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca13d22c43e8479e97c3d306dee0dd81', 'request_id': 'req-24535330-5df5-4683-a5c8-aa8d4c05e2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.112612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca13d22c43e8479e97c3d306dee0dd81', 'request_id': 'req-24535330-5df5-4683-a5c8-aa8d4c05e2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.120323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca13d22c43e8479e97c3d306dee0dd81', 'request_id': 'req-24535330-5df5-4683-a5c8-aa8d4c05e2bc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.132420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] The token cache is being invalidate because project ca13d22c43e8479e97c3d306dee0dd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:11.132762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.133573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.135121 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2600/5203] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:10 2022] DELETE /identity/v3/projects/ca13d22c43e8479e97c3d306dee0dd81 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:11.138964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:11.143839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:11.202534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b98be541f04788866be8ffbb9d42f9', 'request_id': 'req-702be5c0-4307-4cbd-abed-1081379e910f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.224037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535330-5df5-4683-a5c8-aa8d4c05e2bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:11.286085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:11.286979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:11.287267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:11.287529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] PATH_INFO: `/v3/users/ec63f183b7004c4cae88bee041fb7040` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:11.289336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec63f183b7004c4cae88bee041fb7040)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:11.291338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:11.319312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b98be541f04788866be8ffbb9d42f9', 'request_id': 'req-702be5c0-4307-4cbd-abed-1081379e910f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.327927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b98be541f04788866be8ffbb9d42f9', 'request_id': 'req-702be5c0-4307-4cbd-abed-1081379e910f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.343326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] The token cache is being invalidate because project c3b98be541f04788866be8ffbb9d42f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:11.343816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.344923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.349827 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2604/5204] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:10 2022] DELETE /identity/v3/projects/c3b98be541f04788866be8ffbb9d42f9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:11.351803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:11.353409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:11.367688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be5c0-4307-4cbd-abed-1081379e910f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:11.380009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:11.380853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:11.381320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:11.381821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] PATH_INFO: `/v3/users/18bdd9e67e2b4ef08a02f4005ff6c591` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:11.383287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bdd9e67e2b4ef08a02f4005ff6c591)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:11.402710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:11.611000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec63f183b7004c4cae88bee041fb7040'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.615775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec63f183b7004c4cae88bee041fb7040'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.705206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bdd9e67e2b4ef08a02f4005ff6c591'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.705887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bdd9e67e2b4ef08a02f4005ff6c591'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.719092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec63f183b7004c4cae88bee041fb7040'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.721534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:11.736842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec63f183b7004c4cae88bee041fb7040'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.737827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd1d0f54-e0a7-4bdf-8880-41180d6a95ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec63f183b7004c4cae88bee041fb7040'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.780579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2601/5205] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:11 2022] DELETE /identity/v3/users/ec63f183b7004c4cae88bee041fb7040 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:39:11.797305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:11.797736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:11.798091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:11.821758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bdd9e67e2b4ef08a02f4005ff6c591'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.834063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] MFA Rules not processed for user `a29fb36f4f794981a0dcf92416022670`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:11.840728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:11.843579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bdd9e67e2b4ef08a02f4005ff6c591'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.844879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bdd9e67e2b4ef08a02f4005ff6c591'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:11.879744 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2605/5206] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:11 2022] DELETE /identity/v3/users/18bdd9e67e2b4ef08a02f4005ff6c591 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:12.009078 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2602/5207] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:12.013630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:12.016933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:12.159322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ceec2-b883-4e43-b63a-24414bc20f49 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:12.165472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:12.166223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:12.166608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:12.167011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:12.167949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:12.183951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:12.233647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:12.235328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:12.393904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba439-65c3-43c1-bdee-0917b1530cf5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:12.400015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:12.401379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:12.401839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:12.402270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] PATH_INFO: `/v3/projects/fe5f51a023e24f43a478d77f12f5f62a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:12.403785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5f51a023e24f43a478d77f12f5f62a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:12.406822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:12.514486 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2606/5208] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:12 2022] POST /identity/v3/projects => generated 387 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:12.520533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:12.591617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5f51a023e24f43a478d77f12f5f62a', 'request_id': 'req-fe6e342f-8d18-45d2-a66e-91b072f00f8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:12.619608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7721544-04fd-448d-8b44-06cb14df604e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:12.710831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5f51a023e24f43a478d77f12f5f62a', 'request_id': 'req-fe6e342f-8d18-45d2-a66e-91b072f00f8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:12.737751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:12.738248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:12.738537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:12.738826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:12.740335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:12.743176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b4a5-7698-4d15-ba72-4064090a8c76 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:12.744995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5f51a023e24f43a478d77f12f5f62a', 'request_id': 'req-fe6e342f-8d18-45d2-a66e-91b072f00f8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:12.775368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] The token cache is being invalidate because project fe5f51a023e24f43a478d77f12f5f62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:12.776140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:12.777283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:12.795374 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2603/5209] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:12 2022] DELETE /identity/v3/projects/fe5f51a023e24f43a478d77f12f5f62a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:12.795374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:12.799845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:12.821951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e342f-8d18-45d2-a66e-91b072f00f8e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:12.830313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:12.833046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:12.833514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:12.833891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] PATH_INFO: `/v3/projects/42a2dd8c52be4aaf924bd36021cbeeb1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:12.837169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a2dd8c52be4aaf924bd36021cbeeb1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:12.839663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:12.909106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2607/5210] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:12 2022] POST /identity/v3/users => generated 300 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:12.910517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:12.910821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:12.911090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:12.944394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:12.945743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:12.957534 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2608/5211] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:12.966752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:12.971725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.009497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f829d75-832e-4885-830a-1e902f2a7897 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.020933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.021931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.022212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.022488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.023713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.031829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8819ce4-4892-4faa-b1b3-9e8b3c7d3a43 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.052091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a2dd8c52be4aaf924bd36021cbeeb1', 'request_id': 'req-88838d64-e31c-4727-a500-c97227ca989e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:13.059378 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2609/5212] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:13.060677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.060963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.061240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.093825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:13.095940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.171333 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2610/5213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:13.172413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.183695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e4037-39a1-4596-ae8b-aaecb0e2572a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.188818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.189775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.190197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.190532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] PATH_INFO: `/v3/projects/b6808be101764be681cc4122b167aeab/users/8efb712019674c1aaeb44e207bc53d99/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.190683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a2dd8c52be4aaf924bd36021cbeeb1', 'request_id': 'req-88838d64-e31c-4727-a500-c97227ca989e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:13.201251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a2dd8c52be4aaf924bd36021cbeeb1', 'request_id': 'req-88838d64-e31c-4727-a500-c97227ca989e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:13.211109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6808be101764be681cc4122b167aeab, user_id=8efb712019674c1aaeb44e207bc53d99, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.213964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.222406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] The token cache is being invalidate because project 42a2dd8c52be4aaf924bd36021cbeeb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:13.222747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:13.223435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:13.232110 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2604/5214] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:12 2022] DELETE /identity/v3/projects/42a2dd8c52be4aaf924bd36021cbeeb1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:13.232110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.232110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.246534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838d64-e31c-4727-a500-c97227ca989e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.251859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.252540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.253079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.253559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.254546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:13.255178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.257851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb562-379e-4659-a99f-9449931d7ac0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.272581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2605/5215] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:13.274919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.275513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.275971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.304131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:13.322822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.344379 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2611/5216] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:13 2022] PUT /identity/v3/projects/b6808be101764be681cc4122b167aeab/users/8efb712019674c1aaeb44e207bc53d99/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:13.347268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.364978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2606/5217] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:13.366305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.368174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.383913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae953b7-b73d-4e25-9377-855248fa692a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.474943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c0f-e9c8-495e-919b-7a36da0c5900 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.481473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.482761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.482761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.483446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.484311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.484833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.485972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.486323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.486738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.487260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.487525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.489246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ff9d-5feb-4818-b5ba-920e7354146b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.500987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2607/5218] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:13.502909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.509800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.509800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.529205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:13.530396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.539096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2608/5219] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:13.542432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.550679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0687-a6ef-491b-a33e-4b4878923b39 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.558656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.558656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.558656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.558656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] PATH_INFO: `/v3/projects/b6808be101764be681cc4122b167aeab/users/8efb712019674c1aaeb44e207bc53d99/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.560547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6808be101764be681cc4122b167aeab, user_id=8efb712019674c1aaeb44e207bc53d99, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.563403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.575770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2609/5220] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:13 2022] PUT /identity/v3/projects/b6808be101764be681cc4122b167aeab/users/8efb712019674c1aaeb44e207bc53d99/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:13.576702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.641248 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2612/5221] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:13.645668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.737736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b05f7-3e4e-4863-99c3-c4a1a1880143 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.763323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf3ba7-5a90-4421-af45-8ba5419605a2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.769657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.770372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.770802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.771189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.771925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.774349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.823430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.824162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.824451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.824896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.825616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:13.825922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.827885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.844978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2610/5222] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:13.850789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.861632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e255d-c900-432d-9e58-54a80cbcf0de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.867333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.868267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.868550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.868821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.869511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.871592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:13.958224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2613/5223] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:13.959172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:13.961879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:13.984056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3c61-7155-4808-88ab-2da214b2905b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:13.990986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:13.992643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:13.992995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:13.993324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] PATH_INFO: `/v3/users/30001b220dcf43a387b68674afa792e6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:13.994749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30001b220dcf43a387b68674afa792e6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:13.997808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.001329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2611/5224] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:13 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:14.002318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.156476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57c85-0d87-4961-976c-85e6ea39dc34 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:14.168007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:14.168912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.169201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.169486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.170131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:14.171811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.200298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:14.203252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2612/5225] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:14.203252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.218946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09539a-e585-4017-8523-ee38c9ae9610 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:14.235481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:14.237725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.237725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.237725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.238044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:14.242848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.280261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30001b220dcf43a387b68674afa792e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:14.281697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30001b220dcf43a387b68674afa792e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:14.389478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30001b220dcf43a387b68674afa792e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:14.407711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2613/5226] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:14 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:14.408448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30001b220dcf43a387b68674afa792e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:14.408648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.409701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30001b220dcf43a387b68674afa792e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:14.414346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:14.425641 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2614/5227] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:13 2022] DELETE /identity/v3/users/30001b220dcf43a387b68674afa792e6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:14.427847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.430062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:14.455621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d3a2e-df08-4fa7-a0fe-c65db8825868 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:14.557075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:14.558220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.558742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.559219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.560109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:14.562171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e2f37-4b8a-42c8-910f-2f6dcdfb0131 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.568137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddc9e5-031e-4282-ad34-34329755ed6e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:14.574911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:14.576865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.577159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.577433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.578084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:14.579766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.587996 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2614/5228] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:14.616625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d65f8-6dcb-493f-ad28-3fafae6d5a8b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.616625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d65f8-6dcb-493f-ad28-3fafae6d5a8b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.616625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d65f8-6dcb-493f-ad28-3fafae6d5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.616625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f27d65f8-6dcb-493f-ad28-3fafae6d5a8b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:14.616625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f27d65f8-6dcb-493f-ad28-3fafae6d5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:14.623749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2615/5229] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:14.625097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.625383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.625657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.653802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2615/5230] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:14.653802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.691699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8807a6-7378-4a27-af99-032b8e501192 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:14.698466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] MFA Rules not processed for user `a55fa5e6656648faaf79309f68a9f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:14.700288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:14.708062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:14.709052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:14.709341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:14.709631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] PATH_INFO: `/v3/projects/0f6d07638fc6417db8724efff32eb2e0/users/0687e590435a48c589f956b60e33c99c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:14.748159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6d07638fc6417db8724efff32eb2e0, user_id=0687e590435a48c589f956b60e33c99c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:14.751230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:14.799551 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2616/5231] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:14.799551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.799551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:14.926052 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2616/5232] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:14 2022] PUT /identity/v3/projects/0f6d07638fc6417db8724efff32eb2e0/users/0687e590435a48c589f956b60e33c99c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:14.926052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:14.935568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7e5c-feb0-420c-ba84-f822ae68a5cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.076755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497b8b-9a6b-4318-98af-6096e3420153 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.083897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.084890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.085548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.085999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.094278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.096143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.096501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ef369-fa90-4977-9582-5cac1827767b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:15.096822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.097101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.097371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.116192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.117612 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2617/5233] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:15.119663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6a5c-eb19-45a5-a31b-8a5d4680cb01 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.120407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6a5c-eb19-45a5-a31b-8a5d4680cb01 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.120932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf6a5c-eb19-45a5-a31b-8a5d4680cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.126673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:15.154257 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2617/5234] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:15.155236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:15.178128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44637-ca43-4e04-bcf5-bf8232702ef7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.187232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.188208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.190576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.191200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] PATH_INFO: `/v3/projects/8eda4951f5ab440d94689242d5442ae4/users/6f4e72f744504510b8ec5fa5c87b09db/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.192164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bbcf6a5c-eb19-45a5-a31b-8a5d4680cb01 None None] MFA Rules not processed for user `0687e590435a48c589f956b60e33c99c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:15.198670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bbcf6a5c-eb19-45a5-a31b-8a5d4680cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:15.238003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eda4951f5ab440d94689242d5442ae4, user_id=6f4e72f744504510b8ec5fa5c87b09db, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.245377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:15.339470 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2618/5236] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:15.345392 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2618/5236] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:15 2022] PUT /identity/v3/projects/8eda4951f5ab440d94689242d5442ae4/users/6f4e72f744504510b8ec5fa5c87b09db/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:15.345887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.346338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.346855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.359916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:15.383072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] MFA Rules not processed for user `6f4e72f744504510b8ec5fa5c87b09db`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:15.384398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:15.401133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:15.533758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395aedf-ba8f-4e3f-af9d-c2e98b296a8b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.540501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.541329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.541617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.542110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.574269 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2619/5237] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:15.599390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:15.602077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:15.639743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.643058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:15.655655 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2619/5238] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:15.657369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:15.659057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:15.772210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea277461-7b2e-494f-9922-fc5e7f8975bc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.782888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.784526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.785006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.785469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.809085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.819408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3305b-5b1a-46fe-8b3c-f0b817cc27ca service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:15.840672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2620/5239] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:15.844840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c8ed-0577-4c46-b77a-f50c2f6de3d6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:15.851701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:15.852900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:15.853331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:15.853733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] PATH_INFO: `/v3/projects/d5f02791d3c5413e91ae1da4b515341f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:15.855831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f02791d3c5413e91ae1da4b515341f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:15.868518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:16.090135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f02791d3c5413e91ae1da4b515341f', 'request_id': 'req-e8178d59-6a96-4d00-806a-43e41509ec82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:16.194122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f02791d3c5413e91ae1da4b515341f', 'request_id': 'req-e8178d59-6a96-4d00-806a-43e41509ec82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:16.201328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f02791d3c5413e91ae1da4b515341f', 'request_id': 'req-e8178d59-6a96-4d00-806a-43e41509ec82'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:16.223724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] The token cache is being invalidate because project d5f02791d3c5413e91ae1da4b515341f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:16.224016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:16.225543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8178d59-6a96-4d00-806a-43e41509ec82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:16.228992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2620/5240] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:15 2022] DELETE /identity/v3/projects/d5f02791d3c5413e91ae1da4b515341f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:16.234572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a70c8-a564-4fee-ae3f-a885c5d69892 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.234572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a70c8-a564-4fee-ae3f-a885c5d69892 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.234801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a70c8-a564-4fee-ae3f-a885c5d69892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.267942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.267942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.267942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.283717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d87a70c8-a564-4fee-ae3f-a885c5d69892 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:16.286152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d87a70c8-a564-4fee-ae3f-a885c5d69892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:16.310992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:16.342386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:16.344751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:16.423905 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2621/5241] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:16.426055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.426507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.427230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.449222 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2621/5242] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 31 14:39:16.449222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:16.449222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:16.463423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:16.465905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:16.494021 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2622/5243] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:16.499495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:16.538568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0989c-40e4-4878-9433-830cc1da31fb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:16.551512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:16.552568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.552803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.553270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.555802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:16.566428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:16.568391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:16.606406 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2623/5244] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:16.607657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:16.649730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffbf5d-5cb5-44fe-b90b-5f89f00028ad admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:16.653446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b03291-3104-49d0-bf46-df5eb8e7bc63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:16.656681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:16.657677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.658191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.658772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.659638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:16.662390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:16.690210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:16.691024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:16.691432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:16.691806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:16.714896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:16.724205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:16.752970 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2622/5245] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:16.881437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2624/5246] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:16 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:16.884297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:16.921915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e4a1-1622-4fb0-b5ca-948bbf598cdd service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:17.065778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:17.066316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:17.066599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:17.066898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:17.067538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:17.069520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:17.229189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:17.230931 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2623/5247] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:16 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:17.245594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787c6-ee33-41ae-8e3c-f2e315f03c0d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:17.258984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:17.259616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:17.263679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:17.263679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:17.263679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:17.263679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:17.294490 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2625/5248] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:39:17.298130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:17.318524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1bede-df7d-4d13-b2e3-928e4895920e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:17.345188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:17.353000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:17.353359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:17.353673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:17.354500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:17.357367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c8f74-50e1-421d-bbca-abeecb028e07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:17.399836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:17.403450 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2624/5249] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:17.417917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bef2b-eb79-4bbc-a0b1-a39480d33734 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:17.432459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:17.433777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:17.434223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:17.434871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] PATH_INFO: `/v3/projects/4b2e8cbc96a14f9ebf4525e011ee88fa/users/6408ad6468c84b9f8f7d6f98e26415c6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:17.461637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e8cbc96a14f9ebf4525e011ee88fa, user_id=6408ad6468c84b9f8f7d6f98e26415c6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:17.464693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:17.502938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:17.583990 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2626/5250] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:17 2022] PUT /identity/v3/projects/4b2e8cbc96a14f9ebf4525e011ee88fa/users/6408ad6468c84b9f8f7d6f98e26415c6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:17.585895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4989d5-2e74-4ff9-88f5-6bc2f92686fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:17.586404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4989d5-2e74-4ff9-88f5-6bc2f92686fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:17.586932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4989d5-2e74-4ff9-88f5-6bc2f92686fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:17.643728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef4989d5-2e74-4ff9-88f5-6bc2f92686fd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:17.648499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef4989d5-2e74-4ff9-88f5-6bc2f92686fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:17.830304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2625/5251] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:17.879265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:17.881341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:18.034559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a0d6-6a7f-4871-bdf4-2c23d639b200 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:18.035420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a0d6-6a7f-4871-bdf4-2c23d639b200 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:18.035867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a0d6-6a7f-4871-bdf4-2c23d639b200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:18.059299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ad5a0d6-6a7f-4871-bdf4-2c23d639b200 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:18.061015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ad5a0d6-6a7f-4871-bdf4-2c23d639b200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:18.093326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343d97a-ed9c-4f5c-9a1a-de09e5dc4aa8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:18.103045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:18.103816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:18.104135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:18.104358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:18.123926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:18.125406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:18.149579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2627/5252] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:39:18.183292 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2626/5253] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:39:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:18.184185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:18.363829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf6e33-f800-42e7-a66c-3f4d86f8c733 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:18.376802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:18.377716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:18.378179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:18.379017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:18.404208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:18.406777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:18.446039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2628/5254] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:19.566936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:19.857657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:19.966577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135254-5328-416d-92d0-348b22ddd0be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:19.967372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135254-5328-416d-92d0-348b22ddd0be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:19.967879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66135254-5328-416d-92d0-348b22ddd0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:20.086515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66135254-5328-416d-92d0-348b22ddd0be None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:20.092351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66135254-5328-416d-92d0-348b22ddd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:20.129304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2627/5255] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:20.130010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:20.162960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc23cbc-5631-415c-be6a-bf86fa381440 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:20.225135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:20.228634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:20.228924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:20.230897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:20.254976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:20.257388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:20.295984 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2629/5256] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:21.031651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf10-2ed7-4eb5-8466-75f31c8a3100 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:21.033205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf10-2ed7-4eb5-8466-75f31c8a3100 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:21.033653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddbf10-2ed7-4eb5-8466-75f31c8a3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:21.083376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-beddbf10-2ed7-4eb5-8466-75f31c8a3100 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:21.089996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-beddbf10-2ed7-4eb5-8466-75f31c8a3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:21.121079 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2628/5257] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:21.121721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:21.141437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aea3d-8004-42f7-84e0-64e51e317d6c service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:21.161854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:21.162922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:21.164727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:21.167324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:21.187528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:21.195369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:21.213816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2630/5258] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:39:22.423020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:22.493426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d4ed-ed2c-42c4-af32-6dffb6ac06c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:22.499398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d4ed-ed2c-42c4-af32-6dffb6ac06c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:22.499398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d4ed-ed2c-42c4-af32-6dffb6ac06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:22.530386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf23d4ed-ed2c-42c4-af32-6dffb6ac06c1 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:22.535343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf23d4ed-ed2c-42c4-af32-6dffb6ac06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:22.571777 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2629/5259] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:22.587943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:22.607444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b7ed-bfff-4b90-b232-846e04070627 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:22.622748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:22.623773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:22.624261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:22.624708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:22.649431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:22.654321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:22.688852 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2631/5260] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:22.709118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:23.585571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8267-8c98-452b-bb4a-f85f9983eb1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:23.586442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8267-8c98-452b-bb4a-f85f9983eb1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:23.586921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b8267-8c98-452b-bb4a-f85f9983eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:23.613109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f7b8267-8c98-452b-bb4a-f85f9983eb1a None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:23.615277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f7b8267-8c98-452b-bb4a-f85f9983eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:23.631220 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2630/5261] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:39:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:23.640797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:23.659078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7125e-fd41-48bb-bb05-2567ab944ad5 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:23.664961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:23.666329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:23.666807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:23.667233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:23.678466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:23.680541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:23.734239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2632/5262] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:39:24.456245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:24.456766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:24.457210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:24.530775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] MFA Rules not processed for user `8efb712019674c1aaeb44e207bc53d99`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:24.532249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:24.649562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:24.666014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:24.666748 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2631/5263] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:24.670324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e83b-72e7-4a77-a76e-73d75ebf1f2d service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:24.677272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:24.677562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:24.677905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:24.678632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:24.679770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] PATH_INFO: `/v3/users/6f4e72f744504510b8ec5fa5c87b09db` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:24.680087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:24.681419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4e72f744504510b8ec5fa5c87b09db)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:24.683682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:24.814367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83b72e-02ec-4dfb-97b3-d06dbc6b7553 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:24.818768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:24.819414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:24.819823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:24.820089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:24.822011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:24.903118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:24.905022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287e0f3-2880-4b81-8d3d-ff89e7dbefb6 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:24.924382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2632/5264] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:24.937591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:25.089726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4e72f744504510b8ec5fa5c87b09db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:25.091267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4e72f744504510b8ec5fa5c87b09db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:25.223332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4e72f744504510b8ec5fa5c87b09db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:25.255811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4e72f744504510b8ec5fa5c87b09db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:25.256582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4e72f744504510b8ec5fa5c87b09db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:25.287976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2633/5265] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:24 2022] DELETE /identity/v3/users/6f4e72f744504510b8ec5fa5c87b09db => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:25.293980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:25.294722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:25.295183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:25.364040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:25.370001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:25.559351 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2633/5266] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:25.567210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:25.568978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:25.692670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c372ed4-3698-4ca4-a968-f28cc02debc4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:25.715922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:25.717015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:25.726667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:25.728199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:25.759480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:25.761347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:25.776680 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2634/5267] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:26.149427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:26.651806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:26.955020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:26.992010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:26.993744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:27.216081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5eab-d4ce-4ecb-a586-c63e501bef83 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:27.248215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:27.248946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:27.249446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:27.249923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:27.254018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:27.295362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:27.296556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:27.323915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9d2f-478b-406c-84ce-7abcb909dcb9 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:27.345385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:27.346132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:27.347409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:27.349485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] PATH_INFO: `/v3/projects/8eda4951f5ab440d94689242d5442ae4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:27.360364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eda4951f5ab440d94689242d5442ae4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:27.360364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:27.486835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:27.486835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da19ef-2d53-49c1-9eda-b09026c302fe service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:27.528310 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2634/5268] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:27.615778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eda4951f5ab440d94689242d5442ae4', 'request_id': 'req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:27.737388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eda4951f5ab440d94689242d5442ae4', 'request_id': 'req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:27.744951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eda4951f5ab440d94689242d5442ae4', 'request_id': 'req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:27.784360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] The token cache is being invalidate because project 8eda4951f5ab440d94689242d5442ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:27.787387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:27.789448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e4cb3b38-b985-44c8-96b9-eb5e94e323aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:27.797543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:27.799687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:27.800224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:27.805474 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2635/5269] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:27 2022] DELETE /identity/v3/projects/8eda4951f5ab440d94689242d5442ae4 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:27.843073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:27.856772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:28.024431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2635/5270] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:28.032527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.033564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.033994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.100774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:28.105845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:28.136303 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2636/5271] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:28.140423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.159410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df65ce-841d-4118-aafd-ff99a7a89b11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.175538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.176839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.177659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.178085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.186730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:28.187660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.189810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:28.207879 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2636/5272] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:28.212258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.234476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38427999-a609-4cce-97b8-1d685a91fff1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.253347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.256503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.256503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.256503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.257305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.260395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:28.383531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:28.434423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2637/5273] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:28 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:28.437712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.454896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2285142-7a6a-401e-9520-62196daaa3d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.566368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:28.641186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.646574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.648363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.648754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.649647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.655798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:28.786216 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2637/5274] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:28 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:28.791661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.811199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2d67-39b2-429d-a81e-0313b8035ded admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.823966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.824614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.824898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.825179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.826068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.833642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:28.874912 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2638/5275] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:28.881018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.894018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5c60-9c6a-48e3-b206-d8e5578a5ead admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.902032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.902680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.902969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.903278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.904005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.906072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88acc7-a5ab-4868-9d76-6a23b30337ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:28.924377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:28.933234 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2638/5276] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:28.939095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028185b-06a4-477d-9e58-7d1444f6eda3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:28.947144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:28.948324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:28.948769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:28.949204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] PATH_INFO: `/v3/projects/9fea1c3db9d9414bbb8fd0a77fd35534/users/bd0f58c3a71f4d84aaa8a60772bb327b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:28.973857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fea1c3db9d9414bbb8fd0a77fd35534, user_id=bd0f58c3a71f4d84aaa8a60772bb327b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:28.977282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:29.094642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:29.096047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:29.096491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:29.100523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2639/5277] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:28 2022] PUT /identity/v3/projects/9fea1c3db9d9414bbb8fd0a77fd35534/users/bd0f58c3a71f4d84aaa8a60772bb327b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:29.148783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] MFA Rules not processed for user `bd0f58c3a71f4d84aaa8a60772bb327b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:29.150899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:29.298480 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2639/5278] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:29.299976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:29.441638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c1330-af0c-4999-87ae-5c074d7ed8a2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:29.460125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:29.461468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:29.462509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:29.463861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:29.464796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:29.468231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:29.649949 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2640/5279] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:29.655499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:29.680890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d419db5-b20a-4d2b-b41d-4248474ac7c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:29.857141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:29.858600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:29.859469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:29.859909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:29.864073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:29.871969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:30.014194 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2640/5280] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:29 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:30.017787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:30.038577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956cd1-03c3-4fbe-b59d-728edbd64643 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:30.044619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:30.045243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:30.045544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:30.045803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:30.046606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:30.048548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:30.076129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2641/5281] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:30.077226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:30.092729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7d0c-6038-47bf-8f69-d34fe7883482 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:30.111755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:30.112865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:30.113155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:30.113429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:30.114086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:30.119479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2f9e-bed6-456e-aa0a-967d11de0ed6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:30.150675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:30.153731 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2641/5282] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:30.173606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b946a-bb38-4ba6-b1b7-72195d928e46 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:30.188409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:30.188591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:30.194270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:30.194270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] PATH_INFO: `/v3/projects/4a0af6c8ca804a90957112ce1b3fb247/users/84d72553abdd4560a8a3b965ffeb5be9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:30.228383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0af6c8ca804a90957112ce1b3fb247, user_id=84d72553abdd4560a8a3b965ffeb5be9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:30.232337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:30.405564 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2642/5283] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:30 2022] PUT /identity/v3/projects/4a0af6c8ca804a90957112ce1b3fb247/users/84d72553abdd4560a8a3b965ffeb5be9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:39:30.416536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:30.417076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:30.417353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:30.464066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] MFA Rules not processed for user `84d72553abdd4560a8a3b965ffeb5be9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:30.472861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:30.693382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2642/5284] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:30.709578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:30.711859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:30.868154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340afd6f-8f93-44cd-8ba5-aba828723b59 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:30.873267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:30.874403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:30.875003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:30.875495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:31.005822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:31.011781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:31.056132 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2643/5285] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:31.497251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:31.517755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332305-ad8e-4e65-a46e-c21ba1416ac0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:31.538753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:31.539417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:31.539722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:31.539975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:31.574106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:31.575532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53aa9-e27f-4710-99b4-72031ac980ed service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:31.609385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2643/5286] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:31.858155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:32.126508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:33.058895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:33.332429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ce1-ac89-4ae3-b5f6-2baae23d77b1 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:33.388246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:33.388926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:33.389211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:33.389487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] PATH_INFO: `/v3/users/bd0f58c3a71f4d84aaa8a60772bb327b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:33.396811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0f58c3a71f4d84aaa8a60772bb327b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:33.407258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:33.731567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0f58c3a71f4d84aaa8a60772bb327b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:33.732810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0f58c3a71f4d84aaa8a60772bb327b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:33.844021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0f58c3a71f4d84aaa8a60772bb327b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:33.872691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0f58c3a71f4d84aaa8a60772bb327b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:33.875060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0f58c3a71f4d84aaa8a60772bb327b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:33.931866 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2644/5287] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:33 2022] DELETE /identity/v3/users/bd0f58c3a71f4d84aaa8a60772bb327b => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:33.934388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d534df-d603-4f03-86fc-d923df7a7bae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:33.939369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d534df-d603-4f03-86fc-d923df7a7bae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:33.939369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d534df-d603-4f03-86fc-d923df7a7bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:33.971893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38d534df-d603-4f03-86fc-d923df7a7bae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:33.978183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d534df-d603-4f03-86fc-d923df7a7bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:34.093502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2644/5288] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:34.104934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:34.106581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:34.219332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed588-448d-4216-a90e-6c0a84033a56 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:34.223462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:34.224145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:34.224455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:34.224768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:34.227714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:34.228297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:34.228670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:34.252666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:34.256714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:34.262299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] MFA Rules not processed for user `6408ad6468c84b9f8f7d6f98e26415c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:34.263934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:34.286684 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2645/5289] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:34.413924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:34.418488 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2645/5290] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:34.451580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:34.453754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:34.673776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0687b5-98e6-4d67-81c7-bb20503fcce5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:34.681055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:34.681715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:34.681990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:34.682260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:34.710213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:34.710213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:34.739538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2646/5291] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:35.165974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:35.259358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:35.261761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:35.290445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4d8da-22ea-4ac0-b2b9-978daf474252 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:35.297535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:35.298483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:35.299006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:35.299527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] PATH_INFO: `/v3/projects/9fea1c3db9d9414bbb8fd0a77fd35534` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:35.301360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fea1c3db9d9414bbb8fd0a77fd35534)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:35.304437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:35.546137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fea1c3db9d9414bbb8fd0a77fd35534', 'request_id': 'req-b648fe5b-2223-4fef-9aec-a572281d2bb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:35.751249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fea1c3db9d9414bbb8fd0a77fd35534', 'request_id': 'req-b648fe5b-2223-4fef-9aec-a572281d2bb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:35.764070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fea1c3db9d9414bbb8fd0a77fd35534', 'request_id': 'req-b648fe5b-2223-4fef-9aec-a572281d2bb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:35.800978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] The token cache is being invalidate because project 9fea1c3db9d9414bbb8fd0a77fd35534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:35.801282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:35.802910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:35.805691 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2646/5292] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:35 2022] DELETE /identity/v3/projects/9fea1c3db9d9414bbb8fd0a77fd35534 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:39:35.811105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:35.828722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2274dd-5f88-4d60-971d-e088a962c73a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:35.853240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:36.037109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:36.039284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:36.040777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:36.041292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] PATH_INFO: `/v3/users/84d72553abdd4560a8a3b965ffeb5be9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:36.045368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d72553abdd4560a8a3b965ffeb5be9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:36.051503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:36.217498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:36.312242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d72553abdd4560a8a3b965ffeb5be9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:36.315255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d72553abdd4560a8a3b965ffeb5be9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:36.398600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d72553abdd4560a8a3b965ffeb5be9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:36.441853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d72553abdd4560a8a3b965ffeb5be9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:36.443462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d72553abdd4560a8a3b965ffeb5be9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:36.476522 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2647/5293] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:35 2022] DELETE /identity/v3/users/84d72553abdd4560a8a3b965ffeb5be9 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:37.146047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:37.148381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:37.277568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5b-2223-4fef-9aec-a572281d2bb8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:37.357771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:37.362335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:37.362335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:37.362335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:37.363909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:37.432044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:37.437239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:37.476238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:37.477717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b442-1c4c-457d-a22e-db60a950f417 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:37.490947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2f63-c1c5-457a-adf8-4330e530e8f4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:37.507621 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2647/5294] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:37.510797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:37.511469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:37.511754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:37.512028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] PATH_INFO: `/v3/projects/4a0af6c8ca804a90957112ce1b3fb247` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:37.516844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0af6c8ca804a90957112ce1b3fb247)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:37.519635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:37.745990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0af6c8ca804a90957112ce1b3fb247', 'request_id': 'req-543d2809-57da-4c93-986d-e1a18d18613a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:37.851462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0af6c8ca804a90957112ce1b3fb247', 'request_id': 'req-543d2809-57da-4c93-986d-e1a18d18613a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:37.858766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0af6c8ca804a90957112ce1b3fb247', 'request_id': 'req-543d2809-57da-4c93-986d-e1a18d18613a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:37.896222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] The token cache is being invalidate because project 4a0af6c8ca804a90957112ce1b3fb247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:37.897771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:37.903098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-543d2809-57da-4c93-986d-e1a18d18613a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:37.921576 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2648/5295] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:37 2022] DELETE /identity/v3/projects/4a0af6c8ca804a90957112ce1b3fb247 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:37.927823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:37.928113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:37.928483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:37.985892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:37.987152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:38.130671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2648/5296] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:38.145028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.145028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.145028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.200133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:38.247159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:38.248814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:38.273596 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2649/5297] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:38.276708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.289337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb77af-489b-47a1-905d-b650b2152a33 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.296881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:38.297729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.298327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.298834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.299903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:38.300376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:38.308785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:38.350897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2649/5298] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:38.355324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.378342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684cd7-6200-45ed-9e31-5bf6fedfadee None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.400045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:38.401434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.405376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.409097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.410418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:38.415934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:38.547139 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2650/5299] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:38 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:38.551772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.581746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbac76-37ae-49a4-9444-1145121dbe28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.628871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:38.708591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:38.710217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.710935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.711468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.712320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:38.714994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:38.811862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2650/5300] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:38 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:38.814394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.832870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7a21-78e3-40f5-b0d1-ebff40368ebd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.846590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:38.847647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.848181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.848560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.849301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:38.860149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:38.891761 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2651/5301] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:38.894139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.907819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bf8d-0a50-41ab-bc04-25fb314630fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.922328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:38.923264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:38.923551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:38.925341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:38.925341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:38.926854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9cfc5-3329-4d95-874e-dacffd3db389 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:38.960454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2651/5302] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:38.964532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:38.989737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a063-f270-4e8c-a55c-8cd7c09cdd4e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:38.998884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:39.003952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:39.008178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:39.010824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] PATH_INFO: `/v3/projects/1f6ab65b2330441d99de1577d2e83d35/users/5a3a2b1754044a0e8bc2aeab66358d7e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:39.064313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6ab65b2330441d99de1577d2e83d35, user_id=5a3a2b1754044a0e8bc2aeab66358d7e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:39.073636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:39.162341 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2652/5303] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:38 2022] PUT /identity/v3/projects/1f6ab65b2330441d99de1577d2e83d35/users/5a3a2b1754044a0e8bc2aeab66358d7e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:39.265874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:39.266161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:39.266440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:39.311414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] MFA Rules not processed for user `5a3a2b1754044a0e8bc2aeab66358d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:39.314312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:39.343329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:39.434572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2652/5304] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:39.438896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:39.486049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:39.576951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4bd6-a117-4e77-a3e9-ccd40c85d216 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:39.594420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:39.594420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:39.594420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:39.598907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:39.598907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:39.598907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be745a-1de8-496f-99c8-b37b63121a93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:39.737009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2653/5305] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:39 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:39.741482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:39.761926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:39.766944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:39.766944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:39.767331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dc8ce-a730-48ab-8659-d5632d473e1d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:39.801382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] MFA Rules not processed for user `6408ad6468c84b9f8f7d6f98e26415c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:39.803578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:39.930035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:39.931224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:39.931759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:39.932281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:39.933184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:39.935285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:39.972467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2654/5306] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:40.371332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2653/5307] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:39 2022] POST /identity/v3/users => generated 291 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:40.374308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:40.393220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c294-4692-4d15-8e26-e08de299f400 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:40.432741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:40.432741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:40.432741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:40.432741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:40.433729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:40.433729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:40.469333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:40.471405 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2655/5308] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:40.496949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056325-b44d-4162-af4b-d218969cb62c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:40.512961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:40.516071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:40.516605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:40.517104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:40.517782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:40.523561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad04bf-95e1-4232-8a38-0777b43b7a77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:40.551626 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2654/5309] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:40.556237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:40.572680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7435c4-2583-4bc1-9f79-b1a53f15acd8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:40.579268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:40.580781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:40.581245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:40.581682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] PATH_INFO: `/v3/projects/5c07ff2e8ff44c799f9933b11d52bfe3/users/a0021c3b44e9428280c64717d16f02ba/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:40.633081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c07ff2e8ff44c799f9933b11d52bfe3, user_id=a0021c3b44e9428280c64717d16f02ba, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:40.636524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:41.332198 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2656/5310] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:40 2022] PUT /identity/v3/projects/5c07ff2e8ff44c799f9933b11d52bfe3/users/a0021c3b44e9428280c64717d16f02ba/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:41.355264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:41.355264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:41.355264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:41.435586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] MFA Rules not processed for user `a0021c3b44e9428280c64717d16f02ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:41.436975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:41.587999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2655/5311] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:41.593055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:41.735099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60935616-83f6-4359-9bd9-65c5ebfb6ad1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:41.753568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:41.753568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:41.753568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:41.753568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:41.754434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:41.756124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:41.871017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2657/5312] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:41 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:41.875749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:41.894367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f044c8-b508-4111-b020-8f03ad79b403 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:41.993245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:42.030601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:42.030601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.030950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.031241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.031939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:42.034261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:42.083211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:42.172557 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2656/5313] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:41 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:42.174212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:42.216997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d254a3-22ba-41c9-94ae-054eba12d1cd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:42.240036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:42.241145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.241636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.242153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.243107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:42.248979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:42.287611 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2658/5314] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:42.290035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:42.306182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dc993-b6a6-4171-941a-8e773dad9b73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:42.335569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:42.336026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.336595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.337101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] PATH_INFO: `/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9/users/6b6f62b7ed2045ebbfa1664d8a8f97fc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.374258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d90dcd9664ea199ec6643ab43d6f9, user_id=6b6f62b7ed2045ebbfa1664d8a8f97fc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:42.390253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:42.486311 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2657/5315] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:42 2022] PUT /identity/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9/users/6b6f62b7ed2045ebbfa1664d8a8f97fc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:42.496397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:42.526197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6d51-5372-4892-b1fe-9af7ef2192e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:42.737608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:42.773531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:42.779118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.779118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.779118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.779118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:42.779118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8fda8-3a84-4d0a-8cf0-e2961fc09797 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:42.807351 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2659/5316] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:42.811503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:42.836194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e18eb2-76e3-46da-ac0b-2b76f0757858 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:42.853402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:42.854245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.854763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.855230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] PATH_INFO: `/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9/users/6b6f62b7ed2045ebbfa1664d8a8f97fc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.857408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d90dcd9664ea199ec6643ab43d6f9, user_id=6b6f62b7ed2045ebbfa1664d8a8f97fc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:42.860692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:42.888536 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2658/5317] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:42 2022] PUT /identity/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9/users/6b6f62b7ed2045ebbfa1664d8a8f97fc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:42.901778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:42.902077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:42.902344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:42.966134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] MFA Rules not processed for user `6b6f62b7ed2045ebbfa1664d8a8f97fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:42.967476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:43.085965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2660/5318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:43.158009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:43.160474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:43.335397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328fe18-5ff8-431b-a5fc-99dbc325409f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:43.341839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:43.342467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:43.342778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:43.343050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:43.516052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:43.521061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a089d31-7b20-4882-93bb-add1ff050ef8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:43.545412 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2659/5319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:46.693114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:46.696685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:46.858535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71875-90f7-477e-8144-096d8dbc291d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:46.868920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:46.869892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:46.870459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:46.871582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] PATH_INFO: `/v3/users/0687e590435a48c589f956b60e33c99c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:46.873584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0687e590435a48c589f956b60e33c99c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:46.877191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:46.894911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:47.140374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0687e590435a48c589f956b60e33c99c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:47.141120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0687e590435a48c589f956b60e33c99c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:47.247894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0687e590435a48c589f956b60e33c99c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:47.278364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0687e590435a48c589f956b60e33c99c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:47.280940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0687e590435a48c589f956b60e33c99c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:47.325772 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2661/5320] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:46 2022] DELETE /identity/v3/users/0687e590435a48c589f956b60e33c99c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:47.330264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:47.331172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:47.331621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:47.370911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:47.372161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:47.476000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:47.507208 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2660/5321] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:47.515232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:47.516925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:47.642174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d634-5748-4796-8882-0e979384af9f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:47.646844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:47.648048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:47.648323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:47.648587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:47.664702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:47.668567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714110-dac4-48d0-8257-d95017375b8c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:47.687798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2662/5322] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:48.231205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:48.231205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:48.255883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c39e-80ef-4134-9d73-70fdb1e36a9f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:48.268286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:48.271216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:48.271216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:48.271216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] PATH_INFO: `/v3/projects/0f6d07638fc6417db8724efff32eb2e0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:48.271216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6d07638fc6417db8724efff32eb2e0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:48.279877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:48.533826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6d07638fc6417db8724efff32eb2e0', 'request_id': 'req-6f624428-76ab-427d-b02f-d5b2a637edca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:48.669257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6d07638fc6417db8724efff32eb2e0', 'request_id': 'req-6f624428-76ab-427d-b02f-d5b2a637edca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:48.677264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6d07638fc6417db8724efff32eb2e0', 'request_id': 'req-6f624428-76ab-427d-b02f-d5b2a637edca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:48.696823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] The token cache is being invalidate because project 0f6d07638fc6417db8724efff32eb2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:48.697098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:48.698024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f624428-76ab-427d-b02f-d5b2a637edca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:48.700051 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2661/5323] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:48 2022] DELETE /identity/v3/projects/0f6d07638fc6417db8724efff32eb2e0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:48.711747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:48.712686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:48.713747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:48.745229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:48.747076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:48.852782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2663/5324] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:39:48.867544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:48.868212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:48.869043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:48.908532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:48.911240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:48.924335 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2662/5325] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:48.928591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:48.944875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4737720-1d0c-41ad-ae5e-f353e67b8744 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:48.959028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:48.960275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:48.960568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:48.960841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:48.961557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:48.963295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:48.970986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.015317 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2664/5326] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:39:49.019910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.032844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bf2f9-c943-4912-bce1-cd2e028591ad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:49.043428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:49.044388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.044873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.046683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.050027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:49.052113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.178683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2663/5327] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:49.181277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.194561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00a8a-f701-4f55-9f84-3b125eb4758e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:49.236305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:49.294253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:49.294690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.295044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.295390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.296094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:49.298605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.414293 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2665/5328] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:49 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:39:49.414805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.418462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee112ca-e2a7-4545-bcf8-4d997dd9814f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:49.423375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:49.425971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.425971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.425971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.425971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:49.426812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.439312 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2664/5329] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:49.444798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.455741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef41e17-552e-463a-88bc-22e2ee63d1ec admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:49.463676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:49.464308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.464591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.464872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.465597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:49.467763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93481868-f598-47c9-8c32-40e29db3ca07 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.482570 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2666/5330] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:39:49.487998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.500082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830e7d1-94e3-408c-8acd-a32ef75914b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:49.508085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:49.508765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.509037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.509501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] PATH_INFO: `/v3/projects/8c74a9235e2c42cebdf1bb97ba57c761/users/aab3f4bf7807421ea95236b9250ad3db/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.527558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c74a9235e2c42cebdf1bb97ba57c761, user_id=aab3f4bf7807421ea95236b9250ad3db, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:49.531065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:49.642786 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2665/5331] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:39:49 2022] PUT /identity/v3/projects/8c74a9235e2c42cebdf1bb97ba57c761/users/aab3f4bf7807421ea95236b9250ad3db/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:49.652078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:49.652563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:49.652938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:49.739379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] MFA Rules not processed for user `aab3f4bf7807421ea95236b9250ad3db`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:49.741907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:49.884294 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2667/5332] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:49.937007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:49.943714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:50.187481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed798-2cfd-4c36-b1d9-517f3879a457 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:50.205140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:50.206269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:50.206848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:50.207379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:50.249440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:50.252407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:50.290200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2666/5333] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:39:55.678166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:55.681108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:55.854463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b2826-61f1-4b47-b524-ae72da2b3556 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:55.886430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:55.890342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:55.890653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:55.896031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] PATH_INFO: `/v3/users/74841477be3a432c96159bd8f463d02d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:55.899337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=74841477be3a432c96159bd8f463d02d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:55.901402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:56.172794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:56.196811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74841477be3a432c96159bd8f463d02d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:56.198984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74841477be3a432c96159bd8f463d02d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:56.320889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74841477be3a432c96159bd8f463d02d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:56.349321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74841477be3a432c96159bd8f463d02d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:56.350149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74841477be3a432c96159bd8f463d02d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:56.380290 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2668/5334] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:55 2022] DELETE /identity/v3/users/74841477be3a432c96159bd8f463d02d => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:57.087101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:57.104876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb255a8-649d-44b4-8db9-3f1fecb7308f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:57.114118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:57.212588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:57.213382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:57.213665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:57.213938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] PATH_INFO: `/v3/projects/f33b5f8b089e42e48449695fa2e58c94` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:57.215287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33b5f8b089e42e48449695fa2e58c94)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:57.217232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:57.384247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33b5f8b089e42e48449695fa2e58c94', 'request_id': 'req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.503338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33b5f8b089e42e48449695fa2e58c94', 'request_id': 'req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.514306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33b5f8b089e42e48449695fa2e58c94', 'request_id': 'req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.546441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] The token cache is being invalidate because project f33b5f8b089e42e48449695fa2e58c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:57.546441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.546441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.546441 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2667/5335] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:57 2022] DELETE /identity/v3/projects/f33b5f8b089e42e48449695fa2e58c94 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:57.548417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:57.550132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:57.576758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a92c-a6bb-4cfa-bf6b-0124b4b4d8dd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:57.661854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:57.662983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:57.663419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:57.663873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] PATH_INFO: `/v3/users/73b9a84d26714d11b7994a560c10aab5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:57.665385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b9a84d26714d11b7994a560c10aab5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:57.684637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:57.996415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b9a84d26714d11b7994a560c10aab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:57.998690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b9a84d26714d11b7994a560c10aab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:58.091356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b9a84d26714d11b7994a560c10aab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:58.116717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b9a84d26714d11b7994a560c10aab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:58.117795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55814b7d-02d2-4d1f-85e0-8bddf5624ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b9a84d26714d11b7994a560c10aab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:58.153539 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2669/5336] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:39:57 2022] DELETE /identity/v3/users/73b9a84d26714d11b7994a560c10aab5 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:58.708964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:58.708964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:58.728605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c2908-fdd6-4c6b-8e5e-23f737b99a60 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:58.813448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:58.814382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:58.814862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:58.815369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] PATH_INFO: `/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:58.817962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5108f142dad4fb59d3a59d2a1e03b90)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:58.820034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:59.046544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5108f142dad4fb59d3a59d2a1e03b90', 'request_id': 'req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:59.211796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5108f142dad4fb59d3a59d2a1e03b90', 'request_id': 'req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:59.227896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5108f142dad4fb59d3a59d2a1e03b90', 'request_id': 'req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:59.243042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] The token cache is being invalidate because project b5108f142dad4fb59d3a59d2a1e03b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:39:59.243330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:59.244197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2ec0ea-6ffb-40b7-8bdc-d640fb7c2977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:39:59.250206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2668/5337] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:39:58 2022] DELETE /identity/v3/projects/b5108f142dad4fb59d3a59d2a1e03b90 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:39:59.251853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:59.252381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:59.252381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:59.279029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:59.280670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:59.319215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:59.418130 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2670/5338] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:59.420639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:59.421587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:59.423220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:59.450704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:39:59.452642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:39:59.463332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2669/5339] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:39:59.466598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:59.480585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1112d-38ed-4783-a332-bd230f0c70ce None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:59.480761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:39:59.485923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:59.486737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:59.487019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:59.487380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:59.488198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:39:59.488508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:59.492089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:59.541393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:59.541595 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2671/5340] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:39:59.554058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf231d5-7b8b-4a2f-a90c-a5f7d154f9ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:39:59.559640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:39:59.564462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:39:59.564462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:39:59.564462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:39:59.564462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:39:59.564462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:39:59.893920 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2670/5341] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:39:59 2022] POST /identity/v3/projects => generated 383 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:39:59.896021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:39:59.908598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa1bf-edab-48f1-b9df-2bd2b7070b69 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.043065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:00.043962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.044536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.045000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:00.050476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:00.050476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:00.213019 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2672/5342] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:39:59 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:00.217057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:00.237626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b633-d68c-4b4c-885b-b2890f1a830b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.249658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:00.252607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.256714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.256992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:00.259751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:00.264197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:00.298850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2671/5343] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:00.299405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:00.314009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25253-3a03-4ae4-8980-8b60a756adea admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.325815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:00.326465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.326804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.327079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:00.327756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:00.329538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8682e-f8d6-4271-9888-52df68eb0ecf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:00.387652 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2673/5344] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:00.398881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:00.413475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cb22c-47fc-4467-879d-c65d50213e75 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.429534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:00.430444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.430971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.431409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] PATH_INFO: `/v3/projects/a1c9a71c813f4732b5df736816315d18/users/2857f070fe4f4625bf6a1e866863ea0d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:00.466159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c9a71c813f4732b5df736816315d18, user_id=2857f070fe4f4625bf6a1e866863ea0d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:00.469399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:00.624170 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2672/5345] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:00 2022] PUT /identity/v3/projects/a1c9a71c813f4732b5df736816315d18/users/2857f070fe4f4625bf6a1e866863ea0d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:00.632124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.632430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.633001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:00.669693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:00.685663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:00.837484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:00.841869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:00.860134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2674/5346] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:00.867604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:00.869332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:00.983760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22141c-7231-40b6-95b4-9eefe652ce3e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.992065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:00.993001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:00.993447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:00.993576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243933-1480-480b-b7f4-45b146da4cbe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:00.994423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:01.003727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:01.006056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:01.007673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:01.008360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:01.012027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:01.019509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:01.030430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:01.051983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:01.054714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:01.062046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2675/5347] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:40:01.114453 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2673/5348] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:40:01.145673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:01.147648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:01.184340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de45cb-8968-447d-b785-dff3587accfe service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:01.190915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:01.191559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:01.192302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:01.192302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:01.210883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:01.244897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:01.248851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de4de3-7446-406e-8478-e5ca9f72f851 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:01.280989 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2676/5349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:03.150643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:03.169593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:03.171282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:03.201712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35530bf-2a44-4b8e-a068-78c40a707ab2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:03.206812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:03.207737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:03.209391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:03.209939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:03.212360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:03.350547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:03.352286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:03.379259 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2674/5350] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:03.413005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:15.966113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=17 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:17.214807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:18.855874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:18.858398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:18.858398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:18.941501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] MFA Rules not processed for user `2857f070fe4f4625bf6a1e866863ea0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:18.944766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:19.160106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2677/5351] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:19.163735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:19.179550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97476-aeca-4abc-b278-5fbbf37432df service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:19.187637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:19.189129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:19.191015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:19.191477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:19.192541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:19.196849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:19.402490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2675/5352] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:19 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:19.403562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:19.417419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65bc78-531f-430f-b897-777e6535fc77 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:19.583859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:19.583859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:19.584582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:19.585117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:19.585944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:19.589050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:19.732890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2678/5353] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:19 2022] POST /identity/v3/users => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:19.735801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:19.768499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98224-34ca-4a32-922d-98ff5a6388f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:19.789946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:19.790713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:19.791724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:19.793560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:19.794287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:19.806184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:19.832579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2676/5354] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:19.836103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:19.848494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d314-76a8-4788-8842-525bfda5a9f6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:19.854218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:19.855221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:19.855827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:19.856757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] PATH_INFO: `/v3/projects/7955368b3d084860b33dc242ee0e8057/users/57f76dd056e84a0584dde26d5c61c44d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:19.881503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7955368b3d084860b33dc242ee0e8057, user_id=57f76dd056e84a0584dde26d5c61c44d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:19.884853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:20.004056 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2679/5355] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:19 2022] PUT /identity/v3/projects/7955368b3d084860b33dc242ee0e8057/users/57f76dd056e84a0584dde26d5c61c44d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:20.008899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:20.019591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a24f30-1f4d-423e-8f72-748e3e5ffb71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:20.232827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:20.246099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:20.252654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:20.252654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:20.256757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:20.262534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:20.304070 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2677/5356] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:20.305305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:20.336848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3320-20a1-4e9b-8e10-1ca453632d59 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:20.351205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:20.357029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:20.357705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:20.357984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:20.362378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] PATH_INFO: `/v3/projects/7955368b3d084860b33dc242ee0e8057/users/57f76dd056e84a0584dde26d5c61c44d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:20.369632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7955368b3d084860b33dc242ee0e8057, user_id=57f76dd056e84a0584dde26d5c61c44d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:20.382762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:20.424740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf74ad-5216-4f65-9ed3-991018953779 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:20.425819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2680/5357] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:20 2022] PUT /identity/v3/projects/7955368b3d084860b33dc242ee0e8057/users/57f76dd056e84a0584dde26d5c61c44d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:40:20.526995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:20.528844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:20.530757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:20.531388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:20.540980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:20.597750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:20.684622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:20.687403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97dda-5a87-4269-80e0-a926a6795977 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:20.712684 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2678/5358] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:24.492420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:24.496965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:24.752434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:24.817776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469582-5c83-4d41-8730-d82f5963b1e9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:24.837101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:24.840519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:24.842330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:24.842974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] PATH_INFO: `/v3/users/aab3f4bf7807421ea95236b9250ad3db` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:24.847790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab3f4bf7807421ea95236b9250ad3db)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:24.855599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:25.113194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab3f4bf7807421ea95236b9250ad3db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:25.113888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab3f4bf7807421ea95236b9250ad3db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:25.188927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab3f4bf7807421ea95236b9250ad3db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:25.208331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab3f4bf7807421ea95236b9250ad3db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:25.209165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab3f4bf7807421ea95236b9250ad3db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:25.272121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2681/5359] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:24 2022] DELETE /identity/v3/users/aab3f4bf7807421ea95236b9250ad3db => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:25.276520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:25.280891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:25.280891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:25.329178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:25.329178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:25.500713 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2679/5360] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:25.550223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:25.553177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:25.661494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd84f9-c640-465e-966f-a17f046f106f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:25.668174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:25.671291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:25.671951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:25.672919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:25.713059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:25.714904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491779dd-910b-4ae6-b2f0-accdb9940e73 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:25.735034 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2682/5361] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:26.487558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:26.487558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:26.511559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbae92-a72a-4fbd-8ed4-994be3728700 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:26.533447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:26.534513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:26.535775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:26.540080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] PATH_INFO: `/v3/projects/8c74a9235e2c42cebdf1bb97ba57c761` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:26.544898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c74a9235e2c42cebdf1bb97ba57c761)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:26.551400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:26.743721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c74a9235e2c42cebdf1bb97ba57c761', 'request_id': 'req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:26.840399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c74a9235e2c42cebdf1bb97ba57c761', 'request_id': 'req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:26.854109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c74a9235e2c42cebdf1bb97ba57c761', 'request_id': 'req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:26.877457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] The token cache is being invalidate because project 8c74a9235e2c42cebdf1bb97ba57c761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:26.878301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:26.884080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1fec8801-628c-4d28-8c5e-9cc0dca0bd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:26.888332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2680/5362] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:26 2022] DELETE /identity/v3/projects/8c74a9235e2c42cebdf1bb97ba57c761 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:26.892921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:26.893430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:26.893726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:26.937658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:26.939473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:27.111187 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2683/5363] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:27.119772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.120384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.120816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.157672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:27.159159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:27.181505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2681/5364] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:27.185161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.203713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:27.229022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7e1a-c929-4c26-84b6-b979ec3ed3d6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.247041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.248443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.249975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.250987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.253377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:40:27.254374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.258077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.307857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2684/5365] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:27.309425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.321773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b630787-ce68-4b7d-9a59-d665114d52bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.327773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.328940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.329459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.330012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.330903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.334340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.454738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2682/5366] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:27 2022] POST /identity/v3/projects => generated 351 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:27.458886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.476185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6dab-2a23-4026-922d-497843d11412 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.632824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.633292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.633639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.633850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.639080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.641172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.769158 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2685/5367] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:27 2022] POST /identity/v3/users => generated 276 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:27.770129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.783881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd87e0-a028-4922-841c-db8c54ad42c0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.799401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.800386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.800825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.801249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.802064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.804204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.824789 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2683/5368] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:27.828742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.844455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1754-9e36-4fc2-a23c-80b86c55321d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.855384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.856015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.856836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.856836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.857185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.861626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5532d-03b8-4e07-b111-35c23509ed5a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.886314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2686/5369] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:27.890685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:27.906088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db51e3-497a-4751-b352-5352a302ef4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:27.919019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:27.919928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:27.920400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:27.920843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] PATH_INFO: `/v3/projects/ced5edc24455463d96b8902a992cc6e3/users/773330131f044b01944d3c55a7c453b8/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:27.956482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced5edc24455463d96b8902a992cc6e3, user_id=773330131f044b01944d3c55a7c453b8, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:27.960120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:27.962732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:28.029775 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2684/5370] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:27 2022] PUT /identity/v3/projects/ced5edc24455463d96b8902a992cc6e3/users/773330131f044b01944d3c55a7c453b8/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:28.041066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:28.041595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:28.041686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:28.098471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] MFA Rules not processed for user `773330131f044b01944d3c55a7c453b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:28.100013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:28.240758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2687/5371] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:28.266927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:28.268851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:28.385274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1ee4e-3262-4b32-9e37-b7f65909af4f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:28.391139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:28.392351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:28.392351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:28.392351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:28.410262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:28.412298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659320cf-985f-46ee-bb1e-8f3ac892f53c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:28.434018 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2685/5372] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:29.906054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:29.907617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:29.927326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4b88f-e477-4465-9fc9-259ca8b0f478 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:29.935067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:29.935790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:29.937120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:29.937517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:29.942239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:30.074969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:30.081569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:30.084178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:30.115432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2688/5373] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:32.492040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8de26-d402-466c-a32d-b7ddc89b48a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:32.492988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8de26-d402-466c-a32d-b7ddc89b48a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:32.493446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8de26-d402-466c-a32d-b7ddc89b48a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:32.531183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b4a8de26-d402-466c-a32d-b7ddc89b48a2 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:32.532890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4a8de26-d402-466c-a32d-b7ddc89b48a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:32.624879 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2686/5374] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:32.834546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:32.841422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:33.062663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab7330-88c7-42f7-883a-1b1b0c34c918 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:33.072656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:33.074040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:33.074560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:33.075115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:33.086166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:33.088069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c764e6e-43f5-4d10-9c66-4ea7137d6020 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:33.098105 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2689/5375] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:40:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:40:34.123359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:34.123838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:34.131191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:34.144345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] MFA Rules not processed for user `a29fb36f4f794981a0dcf92416022670`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:34.146021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:34.278960 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2687/5376] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:34.289584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:34.290093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:34.290215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:34.326124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] MFA Rules not processed for user `a29fb36f4f794981a0dcf92416022670`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:34.329262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:34.345562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2690/5377] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:36.340850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:36.356744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01657e51-50dc-4136-b73f-bee4356b4f8f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:36.370906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:36.371805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:36.380207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:36.388063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:36.401678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:36.447057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:36.448208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77033-155b-4cee-91ff-e57e0d6b0b9c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:36.480869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2688/5378] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:37.755082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:37.794804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d5842-2079-4ca6-8c98-b5c278100312 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:37.814534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:37.820730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:37.821944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:37.822245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] PATH_INFO: `/v3/users/773330131f044b01944d3c55a7c453b8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:37.824062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773330131f044b01944d3c55a7c453b8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:37.843617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:38.118226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773330131f044b01944d3c55a7c453b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:38.119904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773330131f044b01944d3c55a7c453b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:38.218251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773330131f044b01944d3c55a7c453b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:38.247263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773330131f044b01944d3c55a7c453b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:38.250798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ddb4c2cf-70db-4551-89ee-5410d4604c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773330131f044b01944d3c55a7c453b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:38.298646 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2691/5379] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:37 2022] DELETE /identity/v3/users/773330131f044b01944d3c55a7c453b8 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:38.303054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:38.304279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:38.304724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:38.356494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:38.358419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:38.418276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:38.465542 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2689/5380] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:40:38.492215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:38.492215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:38.492215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:38.492536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:38.494058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:38.620957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] MFA Rules not processed for user `57f76dd056e84a0584dde26d5c61c44d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:38.624621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:38.740873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:38.793364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9939a6a-0a90-4740-a37a-8a86451f542b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:38.802129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:38.804923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:38.805506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:38.805506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:38.830027 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2692/5381] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:38.840727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:38.844080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:38.844547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:38.846334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:38.890130 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2690/5382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:39.026411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c8d9-403c-47a2-abb7-532a6298c26f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:39.031109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:39.031921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:39.032278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:39.032551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:39.039847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:39.304344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:39.309167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18908a0-2af2-483b-bdc0-94492281f0db service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:39.335058 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2693/5383] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:40.242835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:40.244826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:40.271144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1062e-663b-436d-a29f-5805edcd8d3d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:40.284873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:40.286969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:40.290173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:40.290736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] PATH_INFO: `/v3/projects/ced5edc24455463d96b8902a992cc6e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:40.292833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced5edc24455463d96b8902a992cc6e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:40.297398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:40.746610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced5edc24455463d96b8902a992cc6e3', 'request_id': 'req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:40.853118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced5edc24455463d96b8902a992cc6e3', 'request_id': 'req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:40.866268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced5edc24455463d96b8902a992cc6e3', 'request_id': 'req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:40.909977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] The token cache is being invalidate because project ced5edc24455463d96b8902a992cc6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:40.910283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:40.911206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7459c1a-c1f4-4e8d-b5ec-c345273088f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:40.932790 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2691/5384] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:40 2022] DELETE /identity/v3/projects/ced5edc24455463d96b8902a992cc6e3 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:40.933160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:40.933160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:40.933160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:41.017344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:41.022904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:41.196976 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2694/5385] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:41.272675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:41.273978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:41.274271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:41.330073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:41.334195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:41.352603 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2692/5386] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:41.358327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:41.377772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d55b0-43cb-4cad-8a56-58e8786c8cd9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:41.384360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:41.385347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:41.385859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:41.386345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:41.387302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:40:41.387848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:41.389823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:41.420352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:41.427554 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2695/5387] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:41.431982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17085620-a92c-4123-8510-41eb7da980d4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:41.437457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:41.438354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:41.438900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:41.439395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:41.441926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:41.445616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:41.633192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2693/5388] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:41 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:40:41.637466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:41.654745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fe9ed-50df-4806-9e31-4e1f6d79493e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:41.702738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:41.862229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:41.863594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:41.863884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:41.864641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:41.864897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:41.868582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:41.989079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:41.996125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2696/5389] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:41 2022] POST /identity/v3/users => generated 285 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:42.008656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7975e-d056-40ad-82b5-cc9de61502dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:42.014185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:42.015196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:42.032802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:42.032802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:42.032802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:42.032802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:42.047101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2694/5390] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:42.061553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:42.073842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ea6f-2b7b-4679-991d-73e011443eeb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:42.080043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:42.080959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:42.081334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:42.081717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:42.089303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:42.089303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1d1a-90bd-4da6-ada0-b1f17918ab96 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:42.101554 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2697/5391] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:42.107125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:42.120455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b825-3ace-47ae-bf4e-45ab689a3270 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:42.126521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:42.127460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:42.127944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:42.129578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] PATH_INFO: `/v3/projects/d884fae569624e2eba0cd828835e2b2d/users/1ae3a195d96a479db119156f19c69ebe/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:42.154317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d884fae569624e2eba0cd828835e2b2d, user_id=1ae3a195d96a479db119156f19c69ebe, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:42.157543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:42.161493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:42.268340 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2695/5392] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:42 2022] PUT /identity/v3/projects/d884fae569624e2eba0cd828835e2b2d/users/1ae3a195d96a479db119156f19c69ebe/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:40:42.279471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:42.279762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:42.280043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:42.352695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] MFA Rules not processed for user `1ae3a195d96a479db119156f19c69ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:42.355334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:42.502549 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2698/5393] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:42.509326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:42.621828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dcfd9-2cea-4d3e-aace-d3c7778ff623 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:42.629342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:42.632068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:42.632525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:42.632887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:42.633689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:42.636649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:42.770204 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2696/5394] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:42 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:42.775546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:42.796117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92379b-657b-4222-a266-43d369c5f192 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.039133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.039133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.039133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.039133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.040767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.040767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.278961 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2699/5395] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:42 2022] POST /identity/v3/users => generated 291 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:43.280240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:43.301220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62086-41e9-4501-82d3-1315cce847b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.324141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.324985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.325477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.325954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.326839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.334291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.371383 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2697/5396] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:43.372687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:43.400121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93048e-b893-47a6-a1fd-457049c58448 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.414240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.415795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.415795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.416971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] PATH_INFO: `/v3/projects/2d5270ace2294380807200bb75ce5eb4/users/0d06427e5c0f46f081177df21d800678/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.449826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:43.458998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5270ace2294380807200bb75ce5eb4, user_id=0d06427e5c0f46f081177df21d800678, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.462883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.496126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:43.496126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:43.505923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a1f9-bd46-4e92-9c6d-4041e3598832 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.538678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.542807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.542807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.542807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] PATH_INFO: `/v3/users/f6e5ac25311c4a979f5fdd0d3f02c3e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.582305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e5ac25311c4a979f5fdd0d3f02c3e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.584883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.604054 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2700/5397] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:43 2022] PUT /identity/v3/projects/2d5270ace2294380807200bb75ce5eb4/users/0d06427e5c0f46f081177df21d800678/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:43.606427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:43.758743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0fc6-4bf1-47b7-98e6-ade7aeca8d86 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.764516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.765396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.765773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.767918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.767918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.768478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.785282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2701/5398] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:40:43.789818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:43.803178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b75e-76cc-4c95-9e53-b514b8691e1a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:43.811786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:43.812595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.813071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.813458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] PATH_INFO: `/v3/projects/2d5270ace2294380807200bb75ce5eb4/users/0d06427e5c0f46f081177df21d800678/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.815570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5270ace2294380807200bb75ce5eb4, user_id=0d06427e5c0f46f081177df21d800678, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:43.819077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76e36-87ad-469c-8fb9-541700dc2d6b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:43.834867 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2702/5399] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:43 2022] PUT /identity/v3/projects/2d5270ace2294380807200bb75ce5eb4/users/0d06427e5c0f46f081177df21d800678/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:43.845256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:43.845831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:43.846384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:43.852124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e5ac25311c4a979f5fdd0d3f02c3e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:43.853890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e5ac25311c4a979f5fdd0d3f02c3e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:43.910195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e5ac25311c4a979f5fdd0d3f02c3e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:43.945361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] MFA Rules not processed for user `0d06427e5c0f46f081177df21d800678`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:43.947210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:43.968843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e5ac25311c4a979f5fdd0d3f02c3e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:43.969632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e5ac25311c4a979f5fdd0d3f02c3e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:44.015179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2698/5400] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:43 2022] DELETE /identity/v3/users/f6e5ac25311c4a979f5fdd0d3f02c3e1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:44.186255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2703/5401] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:40:44.197024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:44.201062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:44.322630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:44.380119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293eada0-6d8b-432f-a62b-20787a3f2d6c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:44.387775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:44.390210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:44.391353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:44.392330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:44.414162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:44.417234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:44.545736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:44.550103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:44.577044 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2699/5402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:44.643639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:44.653881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94bbd-a963-4c43-ba17-ab1ff4de0ead None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:44.680050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:44.682058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:44.876308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:44.879292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:44.880851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:44.881073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] PATH_INFO: `/v3/projects/9b8421af2aa3439b9f20d98ab9ded9c8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:44.911197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fa457-8893-489e-8ba9-1280ac999060 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:44.921888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8421af2aa3439b9f20d98ab9ded9c8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:44.924808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:44.934706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:44.936846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:44.943326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:44.943595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] PATH_INFO: `/v3/users/5a3a2b1754044a0e8bc2aeab66358d7e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:44.947103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3a2b1754044a0e8bc2aeab66358d7e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:44.960403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:45.126055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8421af2aa3439b9f20d98ab9ded9c8', 'request_id': 'req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.235811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8421af2aa3439b9f20d98ab9ded9c8', 'request_id': 'req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.251055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8421af2aa3439b9f20d98ab9ded9c8', 'request_id': 'req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.285146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] The token cache is being invalidate because project 9b8421af2aa3439b9f20d98ab9ded9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:45.286096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.286897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.289003 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2704/5403] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:44 2022] DELETE /identity/v3/projects/9b8421af2aa3439b9f20d98ab9ded9c8 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:45.291295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:45.295465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:45.310097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3a2b1754044a0e8bc2aeab66358d7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.310840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3a2b1754044a0e8bc2aeab66358d7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.405427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3a2b1754044a0e8bc2aeab66358d7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.433350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3a2b1754044a0e8bc2aeab66358d7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.434139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3a2b1754044a0e8bc2aeab66358d7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:45.451081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e14bd8-f3ab-4b24-8c59-1bf16eafa3c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:45.456418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:45.471837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:45.473723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:45.475794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:45.476277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:45.483068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:45.496223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2700/5404] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:44 2022] DELETE /identity/v3/users/5a3a2b1754044a0e8bc2aeab66358d7e => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:45.497535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:45.505896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:45.644739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:45.700224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:45.721088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a581-5ce4-4f4b-9fcd-fd9eb6afc5b5 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:45.733725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2705/5405] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:45.736279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62ba1-5cd3-4b39-b317-49c187b05827 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:45.736911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62ba1-5cd3-4b39-b317-49c187b05827 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:45.740263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62ba1-5cd3-4b39-b317-49c187b05827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:45.760707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21cfd7-77a9-4aaf-b05e-735b4183b911 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:45.786366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468086-f400-494b-9607-daba5189d42a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:45.789384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468086-f400-494b-9607-daba5189d42a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:45.789699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468086-f400-494b-9607-daba5189d42a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:45.789976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468086-f400-494b-9607-daba5189d42a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:45.796365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-61b62ba1-5cd3-4b39-b317-49c187b05827 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:45.800661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61b62ba1-5cd3-4b39-b317-49c187b05827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:45.800834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7468086-f400-494b-9607-daba5189d42a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:45.852494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7468086-f400-494b-9607-daba5189d42a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:45.855147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7468086-f400-494b-9607-daba5189d42a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:45.891556 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2701/5406] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:45.892448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468086-f400-494b-9607-daba5189d42a service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:45.897008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7468086-f400-494b-9607-daba5189d42a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.001865 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2706/5407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:46.003487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6f71-9834-4d24-84ed-ca4ad3c8b5ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.003770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6f71-9834-4d24-84ed-ca4ad3c8b5ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.004041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b6f71-9834-4d24-84ed-ca4ad3c8b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.030795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b16b6f71-9834-4d24-84ed-ca4ad3c8b5ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:46.032315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b16b6f71-9834-4d24-84ed-ca4ad3c8b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.041513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2707/5408] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:46.042487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.042805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.043076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.064951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:46.066209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.067324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468086-f400-494b-9607-daba5189d42a service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.077199 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2708/5409] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:46.077998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.079426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.082180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.082962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.088110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.088469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.091797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.111452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68491c0d-564a-419c-be54-4fc539fe0b19 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.127084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.128856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.129178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.129450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.151817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.156312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.183735 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2709/5410] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:46.184626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.198576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.201248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.222326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2702/5411] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:46.227830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de11cae-d56c-41ad-a7a3-798617a19c63 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.247907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.249273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.250539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.251032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.254976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:40:46.255881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.260059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.288864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2710/5412] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:46.293359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.312866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81726-04c8-442a-88e1-0bb02a138315 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.319427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.320419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.320884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.321380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.322169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.324664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.455033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2703/5413] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:46 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:46.458748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.477009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae564ab-a0b9-4fef-a497-6f6cbb7dce8b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.581941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.585911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:46.611591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:46.680886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.680886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.680886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.680886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.681315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.691664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.832262 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2711/5414] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:46 2022] POST /identity/v3/users => generated 284 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:46.836260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:46.902076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a732c7-ed3a-4463-959d-f97969082f2b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.908194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11203-5862-47ac-89ba-85bcbfb770ce admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:46.929842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.931074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.934244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.934532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] PATH_INFO: `/v3/projects/1f6ab65b2330441d99de1577d2e83d35` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.938427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:46.939902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:46.941174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6ab65b2330441d99de1577d2e83d35)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.943805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:46.944153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:46.944851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:46.946567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.951551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:46.992562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2712/5415] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:40:47.000150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:47.032518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0419b2-9326-4966-b9c9-5bff2ec89113 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:47.049061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:47.049680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.049967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.050233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.050905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:47.055214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cdd99-710b-45f3-ae1e-4eec20dbcc46 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:47.094457 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2713/5416] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:47.113001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.115993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.123110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.162871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6ab65b2330441d99de1577d2e83d35', 'request_id': 'req-9b2dd3f2-5836-4f40-957c-bc32548e7d63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.203290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] MFA Rules not processed for user `a55fa5e6656648faaf79309f68a9f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:47.204679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:47.212925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:47.247398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6ab65b2330441d99de1577d2e83d35', 'request_id': 'req-9b2dd3f2-5836-4f40-957c-bc32548e7d63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.254250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6ab65b2330441d99de1577d2e83d35', 'request_id': 'req-9b2dd3f2-5836-4f40-957c-bc32548e7d63'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.274771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] The token cache is being invalidate because project 1f6ab65b2330441d99de1577d2e83d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:47.275359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.276034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.284677 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2704/5417] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:46 2022] DELETE /identity/v3/projects/1f6ab65b2330441d99de1577d2e83d35 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:47.284677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:47.287921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:47.329849 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2714/5418] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:47.337476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:47.340997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:47.427677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd3f2-5836-4f40-957c-bc32548e7d63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:47.437657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce527a-d4c6-4669-baa6-7dc3d5ae835a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:47.446433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:47.447469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.447915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.448401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] PATH_INFO: `/v3/projects/b361a775d7924e60b283c7d78a9ed460/users/d70c77e609774393bdd3803768b1bab5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.451810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:47.452435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.452718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.453236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] PATH_INFO: `/v3/users/a0021c3b44e9428280c64717d16f02ba` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.454523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0021c3b44e9428280c64717d16f02ba)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:47.456555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:47.469495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b361a775d7924e60b283c7d78a9ed460, user_id=d70c77e609774393bdd3803768b1bab5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:47.473844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6981-fe46-4630-a41c-cdc88126cb38 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:47.639335 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2705/5419] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:47 2022] PUT /identity/v3/projects/b361a775d7924e60b283c7d78a9ed460/users/d70c77e609774393bdd3803768b1bab5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:47.641427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.641709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.641981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.685476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] MFA Rules not processed for user `d70c77e609774393bdd3803768b1bab5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:47.686915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:47.700444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:47.781051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0021c3b44e9428280c64717d16f02ba'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.782972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0021c3b44e9428280c64717d16f02ba'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.788837 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2706/5420] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:47.796340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:47.905884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83009-edc2-436d-a2af-ead7f417994f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:47.917567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:47.920048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:47.920447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:47.921355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:47.922452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:47.925659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:47.947256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0021c3b44e9428280c64717d16f02ba'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.974358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0021c3b44e9428280c64717d16f02ba'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:47.977410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0021c3b44e9428280c64717d16f02ba'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:48.059172 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2715/5421] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:47 2022] DELETE /identity/v3/users/a0021c3b44e9428280c64717d16f02ba => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:48.232458 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2707/5422] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:47 2022] POST /identity/v3/projects => generated 367 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:48.236537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:48.238266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:48.279451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:48.326959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e929e2-09fd-4553-85b0-da671f18605e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:48.492669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:48.495126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:48.495589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:48.497360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:48.498256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:48.504127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:48.921469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:48.923454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:48.938291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8baf-aa9e-4354-a5c2-f43a080492ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:48.944268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:48.944917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:48.945828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:48.945828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] PATH_INFO: `/v3/projects/5c07ff2e8ff44c799f9933b11d52bfe3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:48.946906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c07ff2e8ff44c799f9933b11d52bfe3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:48.951517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:48.954167 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2716/5423] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:48 2022] POST /identity/v3/users => generated 290 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:40:48.958416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:48.972135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405ff71-4fcf-401a-9dfa-9232619d4544 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:48.977761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:48.978394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:48.978699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:48.978971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:48.980022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:48.981629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.000312 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2717/5424] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:49.001231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.013491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49d06c-2ccc-48cd-8faf-6f72f7ee22c7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:49.018598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:49.019290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.019565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.019836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] PATH_INFO: `/v3/projects/b401ffa00ef247d282a740aa9477e92f/users/202338a5fa694f76a67f8482b6d1c777/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.036088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b401ffa00ef247d282a740aa9477e92f, user_id=202338a5fa694f76a67f8482b6d1c777, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:49.038915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.148170 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2718/5425] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:49 2022] PUT /identity/v3/projects/b401ffa00ef247d282a740aa9477e92f/users/202338a5fa694f76a67f8482b6d1c777/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:49.149297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.173709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c07ff2e8ff44c799f9933b11d52bfe3', 'request_id': 'req-7618a06a-ee13-4ca8-a345-1693e671965d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.259390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e869-1566-4041-a4e0-6243f1474d8b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:49.291370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c07ff2e8ff44c799f9933b11d52bfe3', 'request_id': 'req-7618a06a-ee13-4ca8-a345-1693e671965d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.303655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c07ff2e8ff44c799f9933b11d52bfe3', 'request_id': 'req-7618a06a-ee13-4ca8-a345-1693e671965d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.331152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] The token cache is being invalidate because project 5c07ff2e8ff44c799f9933b11d52bfe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:49.331152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.331152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.337884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2708/5426] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:48 2022] DELETE /identity/v3/projects/5c07ff2e8ff44c799f9933b11d52bfe3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:40:49.340661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.343505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:49.344452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:49.364284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:49.364944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.365226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.365506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.366147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:49.368273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.384297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:49.398950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2719/5427] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:49.400636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.406719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:49.463238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02388c27-4cf4-4c2e-bc55-e354bca0ec49 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:49.464786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618a06a-ee13-4ca8-a345-1693e671965d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:49.471933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:49.473269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.473649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.474095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] PATH_INFO: `/v3/projects/b401ffa00ef247d282a740aa9477e92f/users/202338a5fa694f76a67f8482b6d1c777/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.474726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:49.476630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.477079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b401ffa00ef247d282a740aa9477e92f, user_id=202338a5fa694f76a67f8482b6d1c777, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:49.478335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.479354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] PATH_INFO: `/v3/users/6b6f62b7ed2045ebbfa1664d8a8f97fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.480470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ce99-eede-4ad8-bad3-da1201c2d56d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.487411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6f62b7ed2045ebbfa1664d8a8f97fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:49.494847 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2720/5428] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:49 2022] PUT /identity/v3/projects/b401ffa00ef247d282a740aa9477e92f/users/202338a5fa694f76a67f8482b6d1c777/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:49.498894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.509291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.515154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.515154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.563053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] MFA Rules not processed for user `202338a5fa694f76a67f8482b6d1c777`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:49.564711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:49.717881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2721/5429] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:49.722875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.748519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8664e-d0ff-49ac-ac74-a3a9991f3cc8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:49.758728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:49.759449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:49.759735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:49.760342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:49.761096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:49.762789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:49.780115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6f62b7ed2045ebbfa1664d8a8f97fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.781790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6f62b7ed2045ebbfa1664d8a8f97fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.850242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2722/5430] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:40:49 2022] POST /identity/v3/domains => generated 275 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:49.853712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:49.855512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:49.914525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6f62b7ed2045ebbfa1664d8a8f97fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.935195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6f62b7ed2045ebbfa1664d8a8f97fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.936847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6f62b7ed2045ebbfa1664d8a8f97fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:49.951988 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2709/5431] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:49 2022] DELETE /identity/v3/users/6b6f62b7ed2045ebbfa1664d8a8f97fc => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:49.977636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec896-0a08-4d5c-a331-07bda507ae45 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:50.066584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:50.091711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:50.092876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:50.094008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:50.094008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:50.095129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:50.096955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:50.205085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:50.205685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2723/5432] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:40:49 2022] POST /identity/v3/domains => generated 276 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:40:50.226482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab2d5-4551-4a68-ba9c-b9bea4a9c38e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:50.315495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:50.315994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:50.316275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:50.316651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:50.317714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:50.319435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:50.396688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2710/5433] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:40:50 2022] POST /identity/v3/domains => generated 277 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:40:50.402186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:50.417813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d2df-8df8-454f-86b7-da35abeec8b7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:50.553466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:50.554387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:50.554634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:50.555624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:50.556303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:50.559381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:50.632726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:50.634789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:50.677064 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2724/5434] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:40:50 2022] POST /identity/v3/domains => generated 279 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:50.686977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:50.754300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:50.801326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ae96-5381-4785-af15-31e3518a6485 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:50.867135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756640e-14a2-45aa-87d1-724950ee5abc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:50.878090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:50.879636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:50.884830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:50.884830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/e6764cfc042241ab8a32e703eac22389` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:50.902561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e6764cfc042241ab8a32e703eac22389)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:50.906458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:50.963456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e6764cfc042241ab8a32e703eac22389'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:50.974854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:50.975745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:50.976063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:50.976485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] PATH_INFO: `/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:50.977781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9d90dcd9664ea199ec6643ab43d6f9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:50.980080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:50.980617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e6764cfc042241ab8a32e703eac22389'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.150087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9d90dcd9664ea199ec6643ab43d6f9', 'request_id': 'req-3475c12f-14be-40b8-844b-26d973e84479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.153031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:51.176657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.217899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9d90dcd9664ea199ec6643ab43d6f9', 'request_id': 'req-3475c12f-14be-40b8-844b-26d973e84479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.226567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9d90dcd9664ea199ec6643ab43d6f9', 'request_id': 'req-3475c12f-14be-40b8-844b-26d973e84479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.267163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] The token cache is being invalidate because project 6a9d90dcd9664ea199ec6643ab43d6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:51.268387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.273495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.281301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.283601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3475c12f-14be-40b8-844b-26d973e84479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.289939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2711/5435] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:50 2022] DELETE /identity/v3/projects/6a9d90dcd9664ea199ec6643ab43d6f9 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:51.298786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55475c4-c17e-4a4b-9227-e6aa6abdd11d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:51.299223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55475c4-c17e-4a4b-9227-e6aa6abdd11d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:51.299643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55475c4-c17e-4a4b-9227-e6aa6abdd11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:51.305810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project e6764cfc042241ab8a32e703eac22389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:51.307052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.309805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.332168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.337467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.340014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e6764cfc042241ab8a32e703eac22389', 'request_id': 'req-afe5d15f-5851-4524-98da-182e325aea99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:51.349998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b55475c4-c17e-4a4b-9227-e6aa6abdd11d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:51.359964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b55475c4-c17e-4a4b-9227-e6aa6abdd11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:51.397140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2725/5436] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:40:50 2022] DELETE /identity/v3/domains/e6764cfc042241ab8a32e703eac22389 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:51.400952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:51.406982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:51.575119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d15f-5851-4524-98da-182e325aea99 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:51.596044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:51.596679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:51.596960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:51.597233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:51.601302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:51.604252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:51.627057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2712/5437] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:51.634893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:51.639403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:51.639403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:51.693859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:51.696119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:51.711468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2713/5438] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:51.712352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:51.719444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:51.726184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856fc2b-cbd0-4c63-82d6-62a2fe6d8bfe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:51.747801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:51.748440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:51.748719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:51.748992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:51.749653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:40:51.749984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:51.751708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:51.767007 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2726/5439] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:40:51 2022] POST /identity/v3/domains => generated 249 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:51.771701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:51.791123 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2714/5440] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:51.792785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:51.826015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb9cd-ba0c-4238-bb2a-97b0c9daa859 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:51.977609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a93893-1478-4cc9-b004-d86d8211eb91 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:51.992243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:51.992909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:51.994660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:51.994660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/5afa002310af451a8b4ce3302867fa9c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:52.031581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5afa002310af451a8b4ce3302867fa9c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:52.034646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:52.108627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.112384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.219314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:52.222090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:52.222504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:52.223020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:52.224486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:52.235464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:52.235662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:52.240989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.241984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.256473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2727/5441] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:40:51 2022] PATCH /identity/v3/domains/5afa002310af451a8b4ce3302867fa9c => generated 250 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:52.257635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:52.261049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:52.415175 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2715/5442] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:51 2022] POST /identity/v3/projects => generated 369 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:52.421663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:52.424655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:52.498002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff18750-aee8-4d59-838b-5e063547b374 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:52.636341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:52.637236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:52.637755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:52.638553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/5afa002310af451a8b4ce3302867fa9c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:52.653304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eac3b-8df1-40a8-8137-111d52c0b0b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:52.658543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5afa002310af451a8b4ce3302867fa9c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:52.663878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:52.671307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:52.671939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:52.672270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:52.672590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:52.673223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:52.680059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:52.705156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.710603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5afa002310af451a8b4ce3302867fa9c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.828172 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2716/5443] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:52 2022] POST /identity/v3/users => generated 285 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:52.832812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:52.840566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:52.869935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed0ec8-804e-4bc1-8f14-70f83d97f8a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:52.909026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:52.997975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.013305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.056122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:53.059418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:53.060421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:53.060421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] PATH_INFO: `/v3/users/1ae3a195d96a479db119156f19c69ebe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:53.064172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project 5afa002310af451a8b4ce3302867fa9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:53.064476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.066663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae3a195d96a479db119156f19c69ebe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:53.068992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.073425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:53.080044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:53.096925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:53.102132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.107012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.110147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5afa002310af451a8b4ce3302867fa9c', 'request_id': 'req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.154590 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2728/5444] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:40:52 2022] DELETE /identity/v3/domains/5afa002310af451a8b4ce3302867fa9c => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:53.159384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:53.177456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:53.230375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5526bc7-f10b-49eb-8c21-be0b4c0d3d11 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:53.257842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:53.262745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:53.266335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:53.267000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:53.267724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:53.269443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:53.317834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2729/5445] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:53.318944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:53.333879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:53.635538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae3a195d96a479db119156f19c69ebe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.636270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae3a195d96a479db119156f19c69ebe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.735888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e80b05-a2be-47a6-9693-1f1e86da7c95 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:53.747041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:53.747673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:53.747959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:53.748230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:53.748901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:53.755784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125473de-54f5-482f-84fc-d3a33f50eecc tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:53.794419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae3a195d96a479db119156f19c69ebe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.814120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae3a195d96a479db119156f19c69ebe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.815504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae3a195d96a479db119156f19c69ebe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:53.846217 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2717/5446] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:52 2022] DELETE /identity/v3/users/1ae3a195d96a479db119156f19c69ebe => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:53.850094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:53.850590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:53.898434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2730/5447] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:40:53 2022] POST /identity/v3/domains => generated 278 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:53.903189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:53.905113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:53.905113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:53.968307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:53.976798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.048190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4475c7-693c-44f6-9d17-d11fc2c4bf23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:54.165277 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2731/5448] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:54.165277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:54.168628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.220117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:54.221004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:54.221262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:54.221534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:54.222168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:54.225625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:54.258383 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2718/5449] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:54.258383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:54.272322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.336712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14ff38-ffd9-40bb-a8df-4b2a7559223d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:54.350686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:54.350686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:54.350686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:54.351187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/df295973f61c4c44a367ef2ed3b2116b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:54.390549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=df295973f61c4c44a367ef2ed3b2116b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:54.390549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:54.398690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:54.408898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:54.444832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:54.450918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:54.479735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0285e-fec9-4105-bab6-c9dc3cbc40f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:54.585406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:54.586288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:54.586434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:54.586574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:54.587319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:54.587453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:54.594253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2732/5450] 10.222.0.13 () {60 vars in 1250 bytes} [Mon Oct 31 14:40:54 2022] PATCH /identity/v3/domains/df295973f61c4c44a367ef2ed3b2116b => generated 279 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:54.594253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:54.600487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.600619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.782801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:54.784546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:54.792745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1f8b7-ee10-4a36-a9ab-77e430bfb588 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:54.807891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:54.810410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:54.810410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:54.810410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] PATH_INFO: `/v3/projects/5163ccfc70344419a1532bbe3c3c1e9a/users/a1dbbb95303e4b5192ea98a0b86ce5e5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:54.820860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2719/5451] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:40:54.821870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:54.823282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:54.857191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5163ccfc70344419a1532bbe3c3c1e9a, user_id=a1dbbb95303e4b5192ea98a0b86ce5e5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:54.860956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ff884-c798-4bc2-b23a-ea3c45ea3512 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:54.953262 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2733/5452] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:54 2022] PUT /identity/v3/projects/5163ccfc70344419a1532bbe3c3c1e9a/users/a1dbbb95303e4b5192ea98a0b86ce5e5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:54.969033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:54.969861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:54.970414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:55.000110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ed58-9fb5-466d-89fc-095579b4490e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:55.065833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] MFA Rules not processed for user `a1dbbb95303e4b5192ea98a0b86ce5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:55.075730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:55.121844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:55.171012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:55.175466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:55.175466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:55.175466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/df295973f61c4c44a367ef2ed3b2116b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:55.201305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=df295973f61c4c44a367ef2ed3b2116b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:55.203668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:55.211359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2720/5453] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:40:54 2022] GET /identity/v3/domains/df295973f61c4c44a367ef2ed3b2116b => generated 279 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:55.219773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:55.246538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49671-e674-45ac-86b7-54e12b81d9e2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:55.260592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:55.262102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:55.262102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:55.262323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/df295973f61c4c44a367ef2ed3b2116b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:55.268430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=df295973f61c4c44a367ef2ed3b2116b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:55.269199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:55.338307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2734/5454] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:55.342274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:55.408219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.422034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.561046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:55.561046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcd78-6fd9-4218-8dac-1f116dbb4c27 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:55.561046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:55.561046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:55.562332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:55.562332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:55.562332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:55.562332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:55.785230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2735/5455] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:40:55 2022] POST /identity/v3/projects => generated 369 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:55.786029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:55.790358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:55.833443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.929695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.939266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.971792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project df295973f61c4c44a367ef2ed3b2116b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:55.975747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:55.976850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.001944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.004797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.006933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'df295973f61c4c44a367ef2ed3b2116b', 'request_id': 'req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.031269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2721/5456] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:40:55 2022] DELETE /identity/v3/domains/df295973f61c4c44a367ef2ed3b2116b => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:56.032507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.038503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:56.077067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74eb47-360c-427b-ad1d-60f411e7fe3c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.081222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.082107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.082497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.083267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] PATH_INFO: `/v3/projects/d884fae569624e2eba0cd828835e2b2d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.088930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d884fae569624e2eba0cd828835e2b2d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.091117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:56.289071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd884fae569624e2eba0cd828835e2b2d', 'request_id': 'req-0b329985-3cc0-4f55-bb97-a99d8d309a34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.298495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ac75f-31a1-4f6c-9dc1-ddb220cff7fe tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.361113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd884fae569624e2eba0cd828835e2b2d', 'request_id': 'req-0b329985-3cc0-4f55-bb97-a99d8d309a34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.372239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd884fae569624e2eba0cd828835e2b2d', 'request_id': 'req-0b329985-3cc0-4f55-bb97-a99d8d309a34'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.385711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:56.408054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] The token cache is being invalidate because project d884fae569624e2eba0cd828835e2b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:56.413697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.417598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.430679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2736/5457] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:55 2022] DELETE /identity/v3/projects/d884fae569624e2eba0cd828835e2b2d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:56.432256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.436835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:56.532211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.537068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.537617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.538221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.541023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.545126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:56.602939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:56.633346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b329985-3cc0-4f55-bb97-a99d8d309a34 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.641510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.642344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.642726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.643665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.644267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.646928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:56.674834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2737/5458] 10.222.0.13 () {58 vars in 1128 bytes} [Mon Oct 31 14:40:56 2022] GET /identity/v3/domains => generated 1346 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:56.676454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.678489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:56.698256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bf417-f546-4ead-a3b0-e941d939a994 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.699173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2722/5459] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:56 2022] POST /identity/v3/users => generated 291 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:56.700166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.714266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.714266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.714687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.715100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] PATH_INFO: `/v3/users/0d06427e5c0f46f081177df21d800678` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.716315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d06427e5c0f46f081177df21d800678)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.718938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:56.753868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fa95-2162-474e-afee-780389ab994e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.779502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.779502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.779502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.779941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/df295973f61c4c44a367ef2ed3b2116b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.807421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find domain: df295973f61c4c44a367ef2ed3b2116b.: keystone.exception.DomainNotFound: Could not find domain: df295973f61c4c44a367ef2ed3b2116b. Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: df295973f61c4c44a367ef2ed3b2116b. Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:40:56.822976 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:40:56.824294 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: df295973f61c4c44a367ef2ed3b2116b. Oct 31 14:40:56.825373 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:40:56.827179 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2723/5460] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:40:56 2022] PATCH /identity/v3/domains/df295973f61c4c44a367ef2ed3b2116b => generated 112 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:40:56.830433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.837223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:56.865259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff4206-61b6-4a84-a982-c521b96bcc24 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.880364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.882057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.883087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.883432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.884158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.886563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:56.922857 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2724/5461] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:56.927490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:56.936822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d06427e5c0f46f081177df21d800678'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.941249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d06427e5c0f46f081177df21d800678'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:56.956938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26338d70-3092-4c6c-86f5-351f2b2cb5bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:56.972943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:56.973608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:56.973946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:56.974227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:56.974950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:56.976602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.028626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d06427e5c0f46f081177df21d800678'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:57.059521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d06427e5c0f46f081177df21d800678'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:57.063612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d06427e5c0f46f081177df21d800678'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:57.066891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2725/5462] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:40:56 2022] POST /identity/v3/domains => generated 276 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:57.068293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.072752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:57.106302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2738/5463] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:40:56 2022] DELETE /identity/v3/users/0d06427e5c0f46f081177df21d800678 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:57.106302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.108364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:57.269435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06761e2-2334-4566-bcb1-284b8c7a23a1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.277695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77a45a-0d77-417e-affd-af434714f2e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.285710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.286973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.287428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.287934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.289575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.293195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.363278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.365115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.365559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.366005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] PATH_INFO: `/v3/projects/4413f1bbfa0d4440ae194ed8b528be04/users/d7bb056a7f754ccaaebbeeaac8c1bbdc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.390599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413f1bbfa0d4440ae194ed8b528be04, user_id=d7bb056a7f754ccaaebbeeaac8c1bbdc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.393562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.467932 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2739/5464] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:40:57 2022] POST /identity/v3/users => generated 348 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:57.476742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.483136 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2726/5465] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:57 2022] PUT /identity/v3/projects/4413f1bbfa0d4440ae194ed8b528be04/users/d7bb056a7f754ccaaebbeeaac8c1bbdc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:40:57.486072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.501156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:57.509552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d903c5-5a16-4782-ac99-7523b3363ef1 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.609145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:57.633482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbea68f-8a32-4a18-863e-34c30c1deda7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.648364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.650765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.657485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.657485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.657485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.657485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.658233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.658482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.658854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.659198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/groups` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.660266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.666039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.687647 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2727/5466] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:40:57.689419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.706580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce276-c964-4c65-a04b-edb424a2e7e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.711904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.712591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.712869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.713142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] PATH_INFO: `/v3/projects/4413f1bbfa0d4440ae194ed8b528be04/users/d7bb056a7f754ccaaebbeeaac8c1bbdc/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.718690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413f1bbfa0d4440ae194ed8b528be04, user_id=d7bb056a7f754ccaaebbeeaac8c1bbdc, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.726824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cc482-885d-4eed-af81-ec0cacaa2122 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:57.741575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2728/5467] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:40:57 2022] PUT /identity/v3/projects/4413f1bbfa0d4440ae194ed8b528be04/users/d7bb056a7f754ccaaebbeeaac8c1bbdc/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:40:57.752675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.752959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.753237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.802515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] MFA Rules not processed for user `d7bb056a7f754ccaaebbeeaac8c1bbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:57.802515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:57.838427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2740/5468] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:40:57 2022] POST /identity/v3/groups => generated 324 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:40:57.842841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.864359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf3909-ce07-42c9-a389-c26625cf5126 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:57.893405 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2729/5469] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:40:57.914700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:57.918851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:57.976865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:57.977733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:57.978016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:57.978291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/10bb0edf7be346a5a8c5432cad7669c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:57.980497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=10bb0edf7be346a5a8c5432cad7669c7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:57.984965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:58.038153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.040096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.084718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d6ed-124c-4c16-9eb0-742cde099167 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:58.133890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.137049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.146554 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2741/5470] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:40:57 2022] PATCH /identity/v3/domains/10bb0edf7be346a5a8c5432cad7669c7 => generated 277 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:40:58.148000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:58.159982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:58.168372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:58.169454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:58.169903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:58.170325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:58.172599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:58.274077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41869f-44dc-4c5e-bb00-68baea4422cb tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:58.287327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:58.292043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:58.292043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:58.300000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:58.301481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:58.302877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:58.303848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/10bb0edf7be346a5a8c5432cad7669c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:58.309183 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2730/5471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:40:58.350670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=10bb0edf7be346a5a8c5432cad7669c7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:58.352336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:58.418179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.431366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:58.627127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:58.628723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:58.757107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:58.790215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185345b-3263-43fd-bf6b-966e2e98c52a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:59.039341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:59.039341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:59.039341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:59.039341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] PATH_INFO: `/v3/projects/2d5270ace2294380807200bb75ce5eb4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:59.045443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5270ace2294380807200bb75ce5eb4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:59.045443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:59.371417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5270ace2294380807200bb75ce5eb4', 'request_id': 'req-60e7660e-68fc-452f-aa84-8bdb185dbab4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.419346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b186b40063242bbba1d01ec4be17303'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.420768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b186b40063242bbba1d01ec4be17303'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.487471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5270ace2294380807200bb75ce5eb4', 'request_id': 'req-60e7660e-68fc-452f-aa84-8bdb185dbab4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.495355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5270ace2294380807200bb75ce5eb4', 'request_id': 'req-60e7660e-68fc-452f-aa84-8bdb185dbab4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.521330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] The token cache is being invalidate because project 2d5270ace2294380807200bb75ce5eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:59.521687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.524786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60e7660e-68fc-452f-aa84-8bdb185dbab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.531210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:40:59.532125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2731/5472] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:40:58 2022] DELETE /identity/v3/projects/2d5270ace2294380807200bb75ce5eb4 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:40:59.544237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69dfb-760f-4748-92ef-7098a13b563a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:59.544546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69dfb-760f-4748-92ef-7098a13b563a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:59.544803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc69dfb-760f-4748-92ef-7098a13b563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:59.560512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b186b40063242bbba1d01ec4be17303'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.580206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6bc69dfb-760f-4748-92ef-7098a13b563a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:59.582184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bc69dfb-760f-4748-92ef-7098a13b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:59.587605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b186b40063242bbba1d01ec4be17303'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.589465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b186b40063242bbba1d01ec4be17303'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.690823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2732/5473] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:40:59.692988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:59.693277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:59.693549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:59.727710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:40:59.729377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:40:59.815984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.839916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2733/5474] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:40:59.844617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:40:59.858578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb112-9613-4b3c-a73d-d0bb48a9d0f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:40:59.908403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.918675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.964690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project 10bb0edf7be346a5a8c5432cad7669c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:40:59.967819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.971053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:40:59.986021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:40:59.986737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:40:59.987047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:40:59.987323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:40:59.987978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:40:59.988592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:40:59.991157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:40:59.995503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:00.000535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:00.001244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '10bb0edf7be346a5a8c5432cad7669c7', 'request_id': 'req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:00.018574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2734/5475] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:41:00.024672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2742/5476] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:40:58 2022] DELETE /identity/v3/domains/10bb0edf7be346a5a8c5432cad7669c7 => generated 0 bytes in 1875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:00.025906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.028700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:00.028862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.033133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:00.054189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473a73-5082-4ad8-8db1-fbd7e0ac060d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.070007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.070932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.071571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.072000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.072910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.075045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.175100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aedec-89fb-4bb4-a3c4-0eabb3309d50 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.194774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.196494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.196494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.196494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/10bb0edf7be346a5a8c5432cad7669c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.205319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=10bb0edf7be346a5a8c5432cad7669c7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.207355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7.: keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.221979 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.223505 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.225137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2743/5477] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/domains/10bb0edf7be346a5a8c5432cad7669c7 => generated 112 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:00.233303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.250015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a120db0-edf7-4bac-b9e8-497ad0f6dc09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.258756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.259558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.259962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.260369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/users/7b186b40063242bbba1d01ec4be17303` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.271870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:get_user(user_id=7b186b40063242bbba1d01ec4be17303)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.273970 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2735/5478] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:00 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:00.275459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.278064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find user: 7b186b40063242bbba1d01ec4be17303.: keystone.exception.UserNotFound: Could not find user: 7b186b40063242bbba1d01ec4be17303. Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:41:00.297133 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.298481 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7b186b40063242bbba1d01ec4be17303. Oct 31 14:41:00.299833 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.306901 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2744/5479] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/users/7b186b40063242bbba1d01ec4be17303 => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:00.307967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.321284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075491a2-0d73-45e7-b4f7-372f5aa42c9a tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.406517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.406517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.406517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.407005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/groups/aec73b53a0be445491758cabeae7795d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.414531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:get_group(group_id=aec73b53a0be445491758cabeae7795d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.416925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find group: aec73b53a0be445491758cabeae7795d.: keystone.exception.GroupNotFound: Could not find group: aec73b53a0be445491758cabeae7795d. Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 31 14:41:00.448679 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.450496 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: aec73b53a0be445491758cabeae7795d. Oct 31 14:41:00.451649 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.455785 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2745/5480] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/groups/aec73b53a0be445491758cabeae7795d => generated 111 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:00.464162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.480719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901211-2a46-4322-b3a2-1da3bc981f69 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.505213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.505754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.506972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.507335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/groups/aec73b53a0be445491758cabeae7795d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.510949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a23a8d-bfcd-49a8-b9db-e9dcf3cc2d68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.524385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:00.529511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.530137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.530416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.530704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.531340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.533260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find group: aec73b53a0be445491758cabeae7795d.: keystone.exception.GroupNotFound: Could not find group: aec73b53a0be445491758cabeae7795d. Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 31 14:41:00.534055 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.535290 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: aec73b53a0be445491758cabeae7795d. Oct 31 14:41:00.537350 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.544009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2746/5481] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:41:00 2022] DELETE /identity/v3/groups/aec73b53a0be445491758cabeae7795d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:00.544794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.568880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4d8a8-a4ce-490e-88c7-2bbff00f07c0 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.578771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.580510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.581118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.582344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/users/7b186b40063242bbba1d01ec4be17303` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.599064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7b186b40063242bbba1d01ec4be17303)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.606685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find user: 7b186b40063242bbba1d01ec4be17303.: keystone.exception.UserNotFound: Could not find user: 7b186b40063242bbba1d01ec4be17303. Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 31 14:41:00.630548 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.631704 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 7b186b40063242bbba1d01ec4be17303. Oct 31 14:41:00.632896 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.634917 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2747/5482] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:00 2022] DELETE /identity/v3/users/7b186b40063242bbba1d01ec4be17303 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:00.635996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.648183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ab2c-724d-4f77-9844-1930072e55ca tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.654104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.654703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.655091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.655884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/10bb0edf7be346a5a8c5432cad7669c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.666723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:00.669772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:00.671405 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2736/5483] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:00 2022] POST /identity/v3/users => generated 290 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7.: keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:00.673552 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:00.674749 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:00.675794 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:00.677550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.687309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2748/5484] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:00 2022] PATCH /identity/v3/domains/10bb0edf7be346a5a8c5432cad7669c7 => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:41:00.688383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.703307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec822dc3-aeea-40a3-a858-3ba28e024a75 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.703568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e2ded-b0a1-4b59-9e3d-c63453d9dc5f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.715895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.716527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.716962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.717238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.718042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.726662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.732142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.732142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.732142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.732467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.732467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.732467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.760509 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2749/5485] 10.222.0.13 () {58 vars in 1128 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/domains => generated 1346 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:00.766686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.766883 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2737/5486] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:00.771385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.783898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972c94-343e-4eb1-abaf-55645e68e32f tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.795872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260da28b-c6c7-4bc3-97a5-db2dc6e57da9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.801304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.809690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.810413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.811265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.812104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.815190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.823365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.824008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.824294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.824572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.829530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:00.829861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.830227 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2750/5487] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:00.835204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.837461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.850386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23014acb-b13c-4c16-9480-fd42936a3f32 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.861743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=73,keystone:DELETE=25,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:00.867503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.868722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.869960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.869960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] PATH_INFO: `/v3/projects/37f82d5507b04016b96a765677bacac3/users/1743e0244d094856a9587bc0d1c18003/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.903798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f82d5507b04016b96a765677bacac3, user_id=1743e0244d094856a9587bc0d1c18003, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.907229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67bd68-1640-43d9-b6a2-9edd41bad956 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:00.924105 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2738/5488] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:41:00.932917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:00.954382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eff1e-dc5d-4378-8f3a-bdfa8b0bf569 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:00.964723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:00.971505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:00.977964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:00.979105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:00.980597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-860057948) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:00.981787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:00.984222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:01.011544 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2739/5489] 10.222.0.13 () {58 vars in 1197 bytes} [Mon Oct 31 14:41:00 2022] GET /identity/v3/domains?name=tempest-test_domain-860057948 => generated 406 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:01.016977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:01.056403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2751/5490] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:00 2022] PUT /identity/v3/projects/37f82d5507b04016b96a765677bacac3/users/1743e0244d094856a9587bc0d1c18003/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:01.056663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65004343-48e1-42a7-a82d-02168f6c5f2e tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:01.060408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.060979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.061256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.165795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] MFA Rules not processed for user `1743e0244d094856a9587bc0d1c18003`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:01.167099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:01.252926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:01.253582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.253862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.254137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/10bb0edf7be346a5a8c5432cad7669c7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.288286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7.: keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:01.302042 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:01.303453 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 10bb0edf7be346a5a8c5432cad7669c7. Oct 31 14:41:01.304962 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:01.306241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2740/5491] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:01 2022] PATCH /identity/v3/domains/10bb0edf7be346a5a8c5432cad7669c7 => generated 112 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:01.307554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:01.338430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2979-04a0-4b75-88ee-09cbb09d88c7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:01.354150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:01.356640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.357153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.357642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/b473203bf22149ea81b96ff6971de41c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.365359 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2752/5492] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:01.368537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:01.386821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b473203bf22149ea81b96ff6971de41c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:01.388911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:01.498669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2741/5493] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:01 2022] PATCH /identity/v3/domains/b473203bf22149ea81b96ff6971de41c => generated 277 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:01.500924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:01.518983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6af5-3184-4dc7-a5b0-a429955c4ab7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:01.526087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:01.527007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.527362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.527706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/b473203bf22149ea81b96ff6971de41c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.542538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b473203bf22149ea81b96ff6971de41c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:01.543803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0de27-a79f-45f3-828d-f7996e703c68 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:01.545000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:01.549997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:01.550740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.551099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.551449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.552696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:01.557402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:01.580109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b473203bf22149ea81b96ff6971de41c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.584843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b473203bf22149ea81b96ff6971de41c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.733659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2753/5494] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:01 2022] POST /identity/v3/projects => generated 379 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:01.741129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:01.816668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.846028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d3e3-f445-42aa-8109-dddc438aa959 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:01.940550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.946077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:01.949328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:01.949328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:01.949328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:01.949328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:01.949895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:01.954370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.970967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project b473203bf22149ea81b96ff6971de41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:01.971257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.971916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.991316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.992793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:01.994175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b473203bf22149ea81b96ff6971de41c', 'request_id': 'req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.011945 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2742/5495] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:01 2022] DELETE /identity/v3/domains/b473203bf22149ea81b96ff6971de41c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:02.016016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.017536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.095397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2754/5496] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:01 2022] POST /identity/v3/users => generated 290 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:02.097685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.099114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.113016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fcc96-9ac2-4b3a-b947-bd9de60d81b5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.118936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:02.119703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.120236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.120577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.121432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:02.124083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:02.144574 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2755/5497] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:02.149008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.151460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0da1c-b22c-45fb-a5f2-ee055bc0bb09 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.158531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:02.159225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.159511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.159787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/1bcf0e5953db41a5a4e6274521ab0933` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.179064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1bcf0e5953db41a5a4e6274521ab0933)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:02.181779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:02.185049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c40e-1bae-4f60-8f1f-60d3290efe8a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.195094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:02.196188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.196467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.196743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.197450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:02.199170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:02.236735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.240235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.240850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2756/5498] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:41:02.241821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.245590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.276317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4230c-81c4-4863-a54c-185251ab6583 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.393880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.397162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.397745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:02.398857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.400276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.401719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] PATH_INFO: `/v3/projects/d0f9b48841b04ab183f368f8ea54ecd9/users/9908433e215e4b7688b16825a4a18113/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.403674 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2743/5499] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:02 2022] PATCH /identity/v3/domains/1bcf0e5953db41a5a4e6274521ab0933 => generated 277 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:41:02.407389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.428808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.438479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f9b48841b04ab183f368f8ea54ecd9, user_id=9908433e215e4b7688b16825a4a18113, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:02.441283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dac5d-bbf0-4e95-badc-01efa0a6d65a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:02.537033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22e7f-b2d9-4b55-9c8b-bc5809793f06 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.551315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:02.551315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.551315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.551819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/1bcf0e5953db41a5a4e6274521ab0933` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.576909 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2757/5500] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:02 2022] PUT /identity/v3/projects/d0f9b48841b04ab183f368f8ea54ecd9/users/9908433e215e4b7688b16825a4a18113/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:02.578859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194455-3988-47d0-8512-101388369dc1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:02.579237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194455-3988-47d0-8512-101388369dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:02.579522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194455-3988-47d0-8512-101388369dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:02.584453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1bcf0e5953db41a5a4e6274521ab0933)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:02.586142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:02.628655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b6194455-3988-47d0-8512-101388369dc1 None None] MFA Rules not processed for user `9908433e215e4b7688b16825a4a18113`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:02.632175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b6194455-3988-47d0-8512-101388369dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.649414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.653915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.773575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:02.790651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2758/5501] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:02.792137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194455-3988-47d0-8512-101388369dc1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:02.794857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b6194455-3988-47d0-8512-101388369dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:02.836745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.921060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194455-3988-47d0-8512-101388369dc1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:02.954709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.966147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.991956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project 1bcf0e5953db41a5a4e6274521ab0933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:02.992665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:02.996037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.013085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.016149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.026671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1bcf0e5953db41a5a4e6274521ab0933', 'request_id': 'req-97594909-32f4-4657-b302-3f629afd7fc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.042144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:03.044079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.046011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2744/5502] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:02 2022] DELETE /identity/v3/domains/1bcf0e5953db41a5a4e6274521ab0933 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:03.048769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:03.051161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:03.055678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.055678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:03.055678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:03.056101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.056511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:03.079702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594909-32f4-4657-b302-3f629afd7fc2 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:03.091010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:03.091674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.091956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.092231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] PATH_INFO: `/v3/users/a1dbbb95303e4b5192ea98a0b86ce5e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:03.093809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dbbb95303e4b5192ea98a0b86ce5e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:03.096673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:03.278040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2759/5503] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:02 2022] POST /identity/v3/projects => generated 379 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:03.279548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:03.290459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.414035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dbbb95303e4b5192ea98a0b86ce5e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.416020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dbbb95303e4b5192ea98a0b86ce5e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.441704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:03.499556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703605bf-d1d1-4694-8a81-4939e1c4944e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:03.505058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:03.505819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.506200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.506546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/b47f3f8706e34c3880631d3823a85d29` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:03.526410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b47f3f8706e34c3880631d3823a85d29)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:03.528597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:03.555389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.557696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.561219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dbbb95303e4b5192ea98a0b86ce5e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.584569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dbbb95303e4b5192ea98a0b86ce5e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.585726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dbbb95303e4b5192ea98a0b86ce5e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.603915 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2745/5504] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:03 2022] DELETE /identity/v3/users/a1dbbb95303e4b5192ea98a0b86ce5e5 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:03.609633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:03.612283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.668592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.670487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3fd7385b-0031-485b-b06d-70897d12a412 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:03.683746 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2760/5505] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:03 2022] PATCH /identity/v3/domains/b47f3f8706e34c3880631d3823a85d29 => generated 276 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:03.685261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.685548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.685819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:03.748780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:03.774291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:03.775549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.799197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2761/5506] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:03.805567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:03.809950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.810484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4c8c-35f8-4ec8-8c0f-780960b3d371 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:03.824893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:03.825529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.825813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.826093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:03.829061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:03.833329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:03.951055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2746/5507] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:03 2022] POST /identity/v3/users => generated 296 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:03.954357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:03.958293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:03.979826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826fc68-802e-4fb9-9068-c9136667555f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:03.996246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202338a5fa694f76a67f8482b6d1c777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b401ffa00ef247d282a740aa9477e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:03.996897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:03.997217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:03.997491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] PATH_INFO: `/v3/domains/b47f3f8706e34c3880631d3823a85d29` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.026586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b47f3f8706e34c3880631d3823a85d29)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.028667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.070003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a84d-f510-4d10-a4a3-288547b05e32 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.074757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.075636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.076002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.076350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.081741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.088118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.090554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.092047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.102373 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2747/5508] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:04.103828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:04.106019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:04.133677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a174c-760e-41bc-b8a4-003d02348072 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.142807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.148933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.150492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.150953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.155103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.156857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.181577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2748/5509] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:04.182807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:04.199606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824d597-4119-4262-9cfc-7de52bd0f62d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.231603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.275193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.276461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.276797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.277138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] PATH_INFO: `/v3/projects/2192ca78952644d793c564e113235f2e/users/6343ce63121e4805828c44d60687cbad/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.297844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2192ca78952644d793c564e113235f2e, user_id=6343ce63121e4805828c44d60687cbad, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.302325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.561108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.564432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:04.570212 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2749/5510] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:04 2022] PUT /identity/v3/projects/2192ca78952644d793c564e113235f2e/users/6343ce63121e4805828c44d60687cbad/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:04.574235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.575947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:04.596875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] The token cache is being invalidate because project b47f3f8706e34c3880631d3823a85d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:04.597208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.598993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.615962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.616985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.619021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b47f3f8706e34c3880631d3823a85d29', 'request_id': 'req-61a1c07c-b16d-48d3-b272-24c04e4503d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:04.636350 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2762/5511] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:03 2022] DELETE /identity/v3/domains/b47f3f8706e34c3880631d3823a85d29 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:04.640599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:04.643684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:04.678201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c07c-b16d-48d3-b272-24c04e4503d7 tempest-DomainsTestJSON-1085468115 tempest-DomainsTestJSON-1085468115-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.734392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27d1d-8c4c-49e1-9369-d7193a9c0695 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.754113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.754113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.754113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.754113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.754489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.754489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.776993 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2750/5512] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:41:04.782904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:04.786830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:04.816194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284122ce-c372-4d39-aee8-b8faf7795759 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:04.818783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.820543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.821031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.821485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] PATH_INFO: `/v3/users/d70c77e609774393bdd3803768b1bab5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.823683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70c77e609774393bdd3803768b1bab5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.826427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.826585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:04.827333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.827718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.829657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] PATH_INFO: `/v3/projects/2192ca78952644d793c564e113235f2e/users/6343ce63121e4805828c44d60687cbad/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.835356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2192ca78952644d793c564e113235f2e, user_id=6343ce63121e4805828c44d60687cbad, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:04.838202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2bf0c-1611-4dfa-b244-890f6ef58fe0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:04.873888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2751/5513] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:04 2022] PUT /identity/v3/projects/2192ca78952644d793c564e113235f2e/users/6343ce63121e4805828c44d60687cbad/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:04.884983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:04.885430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:04.885807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:04.943841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] MFA Rules not processed for user `6343ce63121e4805828c44d60687cbad`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:04.945566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.134143 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2752/5514] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:05.147455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:05.149575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.152436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70c77e609774393bdd3803768b1bab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:05.153231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70c77e609774393bdd3803768b1bab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:05.246065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70c77e609774393bdd3803768b1bab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:05.267688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70c77e609774393bdd3803768b1bab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:05.268645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bf262b54-77e3-4339-8948-4fff125583a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70c77e609774393bdd3803768b1bab5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:05.280585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad852a53-51e9-4f13-95a1-12a4ef84fe16 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:05.286653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:05.288185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:05.288881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:05.289165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:05.289599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:05.291699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.291994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2763/5515] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:04 2022] DELETE /identity/v3/users/d70c77e609774393bdd3803768b1bab5 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:05.297256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:05.297631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:05.297810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:05.318967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:05.319195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:05.335097 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2753/5516] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:05.361140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:05.362461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.468548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:05.470196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.479041 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2764/5517] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:05.485513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58dae-eebc-4e21-a7a5-88ddd6147e69 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:05.536014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:05.537702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.551400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:05.552964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:05.553431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:05.553749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:05.556880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.606967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:05.690305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e23a4-23ff-460e-a8e5-7f49b79bc288 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:05.700832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:05.701690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:05.702127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:05.702584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:05.709108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:05.710817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:05.719913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:05.721994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:05.733013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2754/5518] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:05.734059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:05.740077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:05.749946 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2765/5519] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:05.773661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8bab-22c8-493f-afee-79ed3ddb788b service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:05.783786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:05.783986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:05.784275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:05.789281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] PATH_INFO: `/v3/projects/5163ccfc70344419a1532bbe3c3c1e9a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:05.789281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5163ccfc70344419a1532bbe3c3c1e9a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:05.790532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:06.068021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5163ccfc70344419a1532bbe3c3c1e9a', 'request_id': 'req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.195247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5163ccfc70344419a1532bbe3c3c1e9a', 'request_id': 'req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.207518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5163ccfc70344419a1532bbe3c3c1e9a', 'request_id': 'req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.244976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] The token cache is being invalidate because project 5163ccfc70344419a1532bbe3c3c1e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:06.244976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.245438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.249520 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2755/5520] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:05 2022] DELETE /identity/v3/projects/5163ccfc70344419a1532bbe3c3c1e9a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:06.253715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:06.276221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37657-0914-4eb8-b661-b4763e1d6d0b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:06.487005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:06.489143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:06.490853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:06.491196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] PATH_INFO: `/v3/users/d7bb056a7f754ccaaebbeeaac8c1bbdc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:06.493953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bb056a7f754ccaaebbeeaac8c1bbdc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:06.506387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:06.599291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:06.768529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bb056a7f754ccaaebbeeaac8c1bbdc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.771384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bb056a7f754ccaaebbeeaac8c1bbdc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.794209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:06.795980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:06.828200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4913-6d9f-44c8-ae6b-0f0ac6352476 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:06.847430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:06.848186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:06.848591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:06.848935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] PATH_INFO: `/v3/projects/b361a775d7924e60b283c7d78a9ed460` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:06.859570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b361a775d7924e60b283c7d78a9ed460)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:06.861635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:06.866170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bb056a7f754ccaaebbeeaac8c1bbdc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.900691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bb056a7f754ccaaebbeeaac8c1bbdc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.915159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bb056a7f754ccaaebbeeaac8c1bbdc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:06.969560 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2766/5521] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:06 2022] DELETE /identity/v3/users/d7bb056a7f754ccaaebbeeaac8c1bbdc => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:07.043246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b361a775d7924e60b283c7d78a9ed460', 'request_id': 'req-1aa0c5df-425a-448e-8b6f-28762bd1f178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.126557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b361a775d7924e60b283c7d78a9ed460', 'request_id': 'req-1aa0c5df-425a-448e-8b6f-28762bd1f178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.136203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b361a775d7924e60b283c7d78a9ed460', 'request_id': 'req-1aa0c5df-425a-448e-8b6f-28762bd1f178'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.160111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] The token cache is being invalidate because project b361a775d7924e60b283c7d78a9ed460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:07.164963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.164963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.169955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2756/5522] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:06 2022] DELETE /identity/v3/projects/b361a775d7924e60b283c7d78a9ed460 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:07.170416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:07.172231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:07.246174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:07.333593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c03ff4-1e60-4f1e-b9e8-c7df794158fd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:07.455420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:07.456963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:07.457453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:07.458531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] PATH_INFO: `/v3/users/202338a5fa694f76a67f8482b6d1c777` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:07.460351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202338a5fa694f76a67f8482b6d1c777)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:07.462824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:07.771626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202338a5fa694f76a67f8482b6d1c777'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.773069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202338a5fa694f76a67f8482b6d1c777'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.864916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202338a5fa694f76a67f8482b6d1c777'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.887518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202338a5fa694f76a67f8482b6d1c777'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.891450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202338a5fa694f76a67f8482b6d1c777'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:07.919657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2767/5523] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:07 2022] DELETE /identity/v3/users/202338a5fa694f76a67f8482b6d1c777 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:08.873095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:08.875244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:08.891310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c5df-425a-448e-8b6f-28762bd1f178 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:09.059413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:09.060176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.060578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.060953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] PATH_INFO: `/v3/projects/4413f1bbfa0d4440ae194ed8b528be04` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.062498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4413f1bbfa0d4440ae194ed8b528be04)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:09.065239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:09.103372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:09.227061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4413f1bbfa0d4440ae194ed8b528be04', 'request_id': 'req-46838316-ce54-4638-946c-8c1b2831f802'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:09.263387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:09.304414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:09.306139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:09.320948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4413f1bbfa0d4440ae194ed8b528be04', 'request_id': 'req-46838316-ce54-4638-946c-8c1b2831f802'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:09.338975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4413f1bbfa0d4440ae194ed8b528be04', 'request_id': 'req-46838316-ce54-4638-946c-8c1b2831f802'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:09.384249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] The token cache is being invalidate because project 4413f1bbfa0d4440ae194ed8b528be04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:09.384520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:09.393438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-46838316-ce54-4638-946c-8c1b2831f802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:09.397785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2757/5524] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:08 2022] DELETE /identity/v3/projects/4413f1bbfa0d4440ae194ed8b528be04 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:09.404882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa962be-5246-4f8c-ac55-437482248cb8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.405170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa962be-5246-4f8c-ac55-437482248cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.405449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa962be-5246-4f8c-ac55-437482248cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.419908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976707e4-e7d4-42c1-9696-e074670ea665 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:09.479283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:09.480425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.480907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.481394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.483724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:09.485594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2aa962be-5246-4f8c-ac55-437482248cb8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:09.486831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2aa962be-5246-4f8c-ac55-437482248cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:09.654999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2758/5525] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:09.663128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.663407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.663814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.694000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:09.699686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:09.725267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:09.737296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2768/5526] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:09.745893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:09.776571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:09.800138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2759/5527] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:09.802768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fceab0-ab0e-4de5-bc75-85f760d12d9e service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:09.821881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:09.822703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.823046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.828812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.828812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:09.828812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:09.829715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:09.860736 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2769/5528] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:09.862879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:09.883121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430b40-118b-4a5d-898c-c628bb272a95 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:09.895567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:09.896198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:09.903122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:09.903122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:09.903122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:09.903122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.035696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2760/5529] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:09 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:10.039807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.057385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59222601-6eaf-4cd2-83e0-f0bfb58c6e5e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.062720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.064545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.199753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a52a-589b-45a0-a6e5-2f6eeff39735 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.205429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.206148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.206505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.206869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.216382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.235695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.237321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.274535 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2761/5530] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:10.275510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.279086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.279957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.280604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.295981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.296411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.298715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.310421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.321500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497611c-115c-4742-bd3d-4ae4fd0ce08b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.326902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.328102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.328560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.328993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] PATH_INFO: `/v3/projects/b401ffa00ef247d282a740aa9477e92f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.330470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b401ffa00ef247d282a740aa9477e92f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.332814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.470454 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2770/5531] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:10 2022] POST /identity/v3/users => generated 303 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:10.471502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.502550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e063d-a7c3-422c-91d7-009e8c9c0df7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.510120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b401ffa00ef247d282a740aa9477e92f', 'request_id': 'req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:10.641528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:10.642391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b401ffa00ef247d282a740aa9477e92f', 'request_id': 'req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:10.652496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.653462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.653954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.655117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b401ffa00ef247d282a740aa9477e92f', 'request_id': 'req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:10.655646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.656619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.658885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.677886 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2771/5532] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:41:10.679474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.685704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] The token cache is being invalidate because project b401ffa00ef247d282a740aa9477e92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:10.685997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:10.691041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ee38d4e-d1c2-46f4-8a08-4c1e9887ee80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:10.692070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c24844-c53f-43c0-a39d-43022c19719f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.693802 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2762/5533] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:10 2022] DELETE /identity/v3/projects/b401ffa00ef247d282a740aa9477e92f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:10.697354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d6f1-8447-4f5f-9827-a9a9bd46342a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.697675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d6f1-8447-4f5f-9827-a9a9bd46342a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.697950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d6f1-8447-4f5f-9827-a9a9bd46342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.704021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.704853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.708314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.708314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.708314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.709230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.741670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf56d6f1-8447-4f5f-9827-a9a9bd46342a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:10.745423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf56d6f1-8447-4f5f-9827-a9a9bd46342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.756042 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2772/5534] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:10.762304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.764308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.780548 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2763/5535] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:10.802891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.803329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.803751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.831503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f23bf-4f15-4c8f-a26d-91ecb310b095 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.853052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.853927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.854063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.854272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] PATH_INFO: `/v3/projects/9185166f4b0c490facd88677d4f74720/users/27d09c00d18e43c98907f7cbf3e379ea/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.863228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:10.866266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:10.880881 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2764/5536] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:10.886778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9185166f4b0c490facd88677d4f74720, user_id=27d09c00d18e43c98907f7cbf3e379ea, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.889644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d33b95-b369-4014-8d2c-62103603a25f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.892807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.921135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767aa0-bb3d-402a-8933-46c0fb53033d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:10.936354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:10.938461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:10.940744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:10.941184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:10.942785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:10.944620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:10.948456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:10.984994 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2765/5537] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:10.988929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:10.999718 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2773/5538] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:10 2022] PUT /identity/v3/projects/9185166f4b0c490facd88677d4f74720/users/27d09c00d18e43c98907f7cbf3e379ea/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:11.013306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.013632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.013913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.016383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6b30-0a7d-45cf-85d7-841dee620292 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.050273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] MFA Rules not processed for user `27d09c00d18e43c98907f7cbf3e379ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:11.052487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:11.099048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:11.180888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.181844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.182363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.182860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.183718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:11.186678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:11.208688 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2774/5539] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:11.212065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.236580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecee26-2548-40b1-91f6-2b903b8fa3e0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.242221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.242989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.243401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.243769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.244559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:11.246643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:11.376237 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2775/5540] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:11 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:11.380443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.413041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2766/5541] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:10 2022] POST /identity/v3/projects => generated 387 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:11.418427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.544383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b6d1-ddbe-44ed-9592-661f41bb69a7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.717300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6f6e-82ba-420f-931e-0ad354a167a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.718639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.719270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.719550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.719827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.720469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:11.722417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:11.758971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.759605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.759886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.760154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.760981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:11.765993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:11.882822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2767/5542] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:11 2022] POST /identity/v3/users => generated 294 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:11.883991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.897921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2776/5543] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:11 2022] POST /identity/v3/users => generated 309 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:11.898500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c194f0-f381-4dbb-85bd-0df55cfbcfb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.902429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.906768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.907735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.908229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.908667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.909476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:11.915164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:11.927765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2768/5544] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:11.934112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:11.956219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24fcb8-60ec-4e14-b720-81a374cb6955 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.984106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78afca-73b4-4f95-82b6-c9696c6e2fa3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:11.992921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:11.993551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:11.993824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:11.998424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:11.999317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.003836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.005672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.007156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.010886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.013488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.019823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.026582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.034580 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2769/5545] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:41:12.040442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.061151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bb53-c5ec-409e-b095-e968790440d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.078939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.080042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.080486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.081172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] PATH_INFO: `/v3/projects/26ca27980abd4e5db9936cbcecb4e53f/users/8b28bc2621a445fab373050e3b8b0609/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.085893 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2777/5546] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:12.090370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.112731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ca27980abd4e5db9936cbcecb4e53f, user_id=8b28bc2621a445fab373050e3b8b0609, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.115213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f436d72-e2e3-45d9-9726-a7b0b46df1d7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.117434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab62d-5bbb-4033-90cb-2729c6c2115d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.124174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.125441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.126008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.126474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] PATH_INFO: `/v3/projects/0455598fe6f9433e819822a91c713bfe/users/bd33bc08dd8e49978ad5ac89f01d727b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.151908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:12.164126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0455598fe6f9433e819822a91c713bfe, user_id=bd33bc08dd8e49978ad5ac89f01d727b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.171241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.216012 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2770/5547] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:12 2022] PUT /identity/v3/projects/26ca27980abd4e5db9936cbcecb4e53f/users/8b28bc2621a445fab373050e3b8b0609/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:12.233614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.234116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.234567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.269389 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2778/5548] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:12 2022] PUT /identity/v3/projects/0455598fe6f9433e819822a91c713bfe/users/bd33bc08dd8e49978ad5ac89f01d727b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:12.274715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.351755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] MFA Rules not processed for user `8b28bc2621a445fab373050e3b8b0609`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:12.354676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:12.530595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eb13a-6339-4ffb-8603-912e62515539 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.543569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.546909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.546909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.546909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.548276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.552294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.592890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2779/5549] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:12.599569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.605668 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2771/5550] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:12.611755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.644505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32007a9-fd1c-443a-8b9a-e16c2f52ca1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.658561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5d43-4f99-4b5f-af40-e966c886a86f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.666851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.667542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.667939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.668215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.668856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.677142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.680370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.682490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.683508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.684181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] PATH_INFO: `/v3/projects/0455598fe6f9433e819822a91c713bfe/users/bd33bc08dd8e49978ad5ac89f01d727b/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.688289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0455598fe6f9433e819822a91c713bfe, user_id=bd33bc08dd8e49978ad5ac89f01d727b, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.694308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0f70-8a22-4286-83c8-69c85607c946 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.729336 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2780/5551] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:12 2022] PUT /identity/v3/projects/0455598fe6f9433e819822a91c713bfe/users/bd33bc08dd8e49978ad5ac89f01d727b/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:12.740228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.746572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.747245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.796815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2772/5552] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:12.800648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.833694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] MFA Rules not processed for user `bd33bc08dd8e49978ad5ac89f01d727b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:12.833694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:12.907074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72b43-eb1a-4fd9-87a2-30e1edfef1de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:12.913835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:12.914704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:12.916007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:12.916007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:12.916354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:12.918833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:12.978756 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2781/5553] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:12.989655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:12.992864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:13.083627 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2773/5554] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:12 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:13.086566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:13.105216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d10a-e74c-4437-a8b2-e685b6461b0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.119741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.121069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.121503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.122004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.123058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.126002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:13.152534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2774/5555] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:13.157166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:13.173663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ceb0e-bb36-47ae-abcb-8277d5ae5af9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.185076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.185599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.186083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.186455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] PATH_INFO: `/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82/users/2c1c570273d24f43906a8d0ef0693913/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.198157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb2256-9db8-4ce9-8bc9-4fac0ae95d60 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.207381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.208595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.208873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.209142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.223868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5661fbf46004e7caf8e1dd7d7ac7b82, user_id=2c1c570273d24f43906a8d0ef0693913, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.234677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:13.326347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2775/5556] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:13 2022] PUT /identity/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82/users/2c1c570273d24f43906a8d0ef0693913/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:13.332275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.334217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:13.335041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:13.350146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2782/5557] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:13.534906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d69ce-997f-4a06-ad2c-7452caad65cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.534906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.534906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.534906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.535680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.535680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.536021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dbf5-98da-42fd-b80f-3b0071292150 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:13.549468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2776/5558] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:13.555753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:13.572493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:13.580961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816295-a358-4ed8-9a56-1d804ed79eac service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.589518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.590344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.590804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.591262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] PATH_INFO: `/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82/users/2c1c570273d24f43906a8d0ef0693913/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.593931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5661fbf46004e7caf8e1dd7d7ac7b82, user_id=2c1c570273d24f43906a8d0ef0693913, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.597978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:13.614716 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2783/5559] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:13 2022] PUT /identity/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82/users/2c1c570273d24f43906a8d0ef0693913/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:13.626655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.628186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.628685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.694648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] MFA Rules not processed for user `2c1c570273d24f43906a8d0ef0693913`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:13.696505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:13.868705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2777/5560] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:13.870568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:13.890503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2776b-ba98-4cf0-9db3-056f0d53c357 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:13.903186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:13.903985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:13.906014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:13.907112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/services` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:13.908408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:13.916634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.028354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2784/5561] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:13 2022] POST /identity/v3/services => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:14.047513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.062068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9fbc-0fbf-4449-8c32-3a8621df8351 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.094760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.095395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.095683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.095973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.096709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.097872 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:41:14.097872 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:41:14.097872 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:41:14.100975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: 'False' Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.129812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:41:14.131780 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.133031 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2778/5562] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:41:14 2022] POST /identity/v3/endpoints => generated 283 bytes in 85 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:41:14.137315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.153675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fe2eb-676e-4f3b-98a7-f6411b8564a1 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.159813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.160568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.161506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.161842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.163263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.166117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: On instance['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: On instance['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: 'True' Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise error Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application 'True' Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.177319 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:41:14.185137 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application 'True' Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:14.186832 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2785/5563] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:41:14 2022] POST /identity/v3/endpoints => generated 281 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:41:14.187944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.204893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb81cc-b127-4761-865d-85bc11bb9369 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.213888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.214719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.214999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.215274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.216961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.220405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.352835 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-697926950. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:41:14.352835 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:41:14.352835 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:41:14.373205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.376001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:14.492808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=7,keystone:SELECT=91 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:14.563746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2779/5564] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:41:14 2022] POST /identity/v3/endpoints => generated 358 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:14.568148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.589975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de98-619d-4c12-8acf-65dd8b17079d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.627263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7032ed-57af-4998-9ba7-b5c4c4fd39d0 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.629572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.630256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.630918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.631254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.642210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.642814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.643243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.643522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/regions/tempest-region-697926950` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.644129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-697926950)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.645242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.647253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2780/5565] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 14:41:14 2022] GET /identity/v3/regions/tempest-region-697926950 => generated 178 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:14.653385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.672479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e352-d4ad-4632-bb70-f9493179b989 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.687131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.687776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.688062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.688338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints/261f61c1b46d44aa8ba62f3a44513fc9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.704023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=261f61c1b46d44aa8ba62f3a44513fc9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.709672 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:41:14.709672 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:41:14.709672 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:41:14.709672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: 'False' Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.713434 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:41:14.715412 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 31 14:41:14.716903 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:14.728730 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2781/5566] 10.222.0.13 () {60 vars in 1255 bytes} [Mon Oct 31 14:41:14 2022] PATCH /identity/v3/endpoints/261f61c1b46d44aa8ba62f3a44513fc9 => generated 283 bytes in 75 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:41:14.731343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.770602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab7382-cc0e-4519-b14f-c9224a4a6323 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:14.774219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.775895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.784914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:14.785370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:14.785654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:14.786467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints/261f61c1b46d44aa8ba62f3a44513fc9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:14.788928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=261f61c1b46d44aa8ba62f3a44513fc9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:14.790973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:14.827748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2786/5567] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3662 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:14.912571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '261f61c1b46d44aa8ba62f3a44513fc9', 'request_id': 'req-e802d7f2-d2ac-4921-9032-45fdc4eec641'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:14.940393 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2782/5568] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:14 2022] DELETE /identity/v3/endpoints/261f61c1b46d44aa8ba62f3a44513fc9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:14.941750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:14.968529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65238-394e-4ff8-95e1-7578b63083c6 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.003600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.005426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.006011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.006531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/regions/tempest-region-697926950` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.007348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-697926950)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.009412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.222966 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-697926950. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:41:15.222966 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:41:15.222966 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:41:15.233824 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2787/5569] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:41:14 2022] DELETE /identity/v3/regions/tempest-region-697926950 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:15.242660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.262229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d7f2-d2ac-4921-9032-45fdc4eec641 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.280760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.285877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.285877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.285877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.285877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.285877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.395459 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-173162859. To ensure interoperability, identifiers should be a valid uuid. Oct 31 14:41:15.395459 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 31 14:41:15.395459 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:41:15.510509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2783/5570] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Oct 31 14:41:15 2022] POST /identity/v3/endpoints => generated 358 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:15.514818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.537387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374882c-4212-4b54-b9a5-75e37cc1b09a tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.571928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.572959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.573427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.573865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/regions/tempest-region-173162859` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.574654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-173162859)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.590733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.595078 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2788/5571] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 14:41:15 2022] GET /identity/v3/regions/tempest-region-173162859 => generated 178 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:15.601432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.614218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d13c0-692f-4d05-abce-65ed394bd450 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.619945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.620877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.621325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.621787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints/b70219c12ab44161991cdbc040075a98` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.646073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=b70219c12ab44161991cdbc040075a98)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.653269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: On instance['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: 'True' Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.664882 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:41:15.666860 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 31 14:41:15.668247 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:15.671192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2784/5572] 10.222.0.13 () {60 vars in 1255 bytes} [Mon Oct 31 14:41:15 2022] PATCH /identity/v3/endpoints/b70219c12ab44161991cdbc040075a98 => generated 281 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:41:15.675476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.693570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccb72-1425-4e2a-af83-d49fea533388 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.704198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.704995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.705472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.705916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/endpoints/b70219c12ab44161991cdbc040075a98` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.709564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b70219c12ab44161991cdbc040075a98)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.711748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.828344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b70219c12ab44161991cdbc040075a98', 'request_id': 'req-71ce5251-be2f-46fe-bdda-e36005cf7ec6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:15.843341 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2789/5573] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 14:41:15 2022] DELETE /identity/v3/endpoints/b70219c12ab44161991cdbc040075a98 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:15.844537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.865163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c8cf7-6a79-4cef-a15a-4205161168db tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:15.880757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:15.881391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:15.881670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:15.881942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/regions/tempest-region-173162859` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:15.882513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-173162859)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:15.884125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:15.969044 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2785/5574] 10.222.0.13 () {58 vars in 1206 bytes} [Mon Oct 31 14:41:15 2022] DELETE /identity/v3/regions/tempest-region-173162859 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:15.974919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:15.994933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5251-be2f-46fe-bdda-e36005cf7ec6 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:16.019342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1c570273d24f43906a8d0ef0693913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:16.029568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:16.029568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:16.029568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] PATH_INFO: `/v3/services/30627e718c734432ba43595b72cf4f68` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:16.029568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorizing `identity:delete_service(service_id=30627e718c734432ba43595b72cf4f68)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:16.030240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d3d0c-11bb-4918-85c2-abc6d461d24d tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:16.149590 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2790/5575] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:15 2022] DELETE /identity/v3/services/30627e718c734432ba43595b72cf4f68 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:16.154108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:16.267100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dac56-9334-452d-a485-799c63ad5a85 tempest-EndpointsNegativeTestJSON-637012472 tempest-EndpointsNegativeTestJSON-637012472-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:16.278661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:16.290608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:16.291533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:16.292690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:16.293180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] PATH_INFO: `/v3/users/8b28bc2621a445fab373050e3b8b0609` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:16.294552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b28bc2621a445fab373050e3b8b0609)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:16.297661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:16.615250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b28bc2621a445fab373050e3b8b0609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:16.616605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b28bc2621a445fab373050e3b8b0609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:16.775651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b28bc2621a445fab373050e3b8b0609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:16.802547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b28bc2621a445fab373050e3b8b0609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:16.805721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b28bc2621a445fab373050e3b8b0609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:16.834689 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2786/5576] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:16 2022] DELETE /identity/v3/users/8b28bc2621a445fab373050e3b8b0609 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:16.839294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:16.840202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:16.840494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:16.886876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:16.888174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:17.012736 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2791/5577] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:17.080080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:17.082097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:17.086994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:17.220082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fe83a-3dc8-44e6-8f4f-9ed3879818f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:17.226028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:17.227836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:17.228498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:17.229452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:17.248912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:17.251255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:17.264183 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2787/5578] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:17.537795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:18.582152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:18.584081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:18.602431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241880fa-d052-45b8-b61e-1ea1a1f19b86 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:18.618645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:18.619922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:18.620407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:18.622365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] PATH_INFO: `/v3/projects/26ca27980abd4e5db9936cbcecb4e53f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:18.623356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ca27980abd4e5db9936cbcecb4e53f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:18.628392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:18.701213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:18.756052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:18.809049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ca27980abd4e5db9936cbcecb4e53f', 'request_id': 'req-bbbffe75-df1d-4529-bcbf-6104f9afd697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:18.904203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ca27980abd4e5db9936cbcecb4e53f', 'request_id': 'req-bbbffe75-df1d-4529-bcbf-6104f9afd697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:18.915331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ca27980abd4e5db9936cbcecb4e53f', 'request_id': 'req-bbbffe75-df1d-4529-bcbf-6104f9afd697'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:18.991963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] The token cache is being invalidate because project 26ca27980abd4e5db9936cbcecb4e53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:18.992556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:18.996944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.008304 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2792/5579] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:18 2022] DELETE /identity/v3/projects/26ca27980abd4e5db9936cbcecb4e53f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:19.009913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:19.021424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287d12d-994c-4d6a-b621-116299aa97f3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:19.129014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:19.130583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:19.131061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:19.131502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] PATH_INFO: `/v3/users/2c1c570273d24f43906a8d0ef0693913` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:19.132830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1c570273d24f43906a8d0ef0693913)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:19.135183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:19.327824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1c570273d24f43906a8d0ef0693913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.329218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1c570273d24f43906a8d0ef0693913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.423397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1c570273d24f43906a8d0ef0693913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.468459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:19.469902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1c570273d24f43906a8d0ef0693913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.474167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de06f961-4a10-4916-bf7a-9335ca826fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1c570273d24f43906a8d0ef0693913'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:19.497599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2788/5580] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:19 2022] DELETE /identity/v3/users/2c1c570273d24f43906a8d0ef0693913 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:19.578082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:20.092794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:20.094254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:20.124291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbffe75-df1d-4529-bcbf-6104f9afd697 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:20.218437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:20.219397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.219929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.220435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] PATH_INFO: `/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.221668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5661fbf46004e7caf8e1dd7d7ac7b82)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:20.224282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:20.338490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'request_id': 'req-6a08a922-c37a-4ea3-969b-706f360926c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:20.397985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'request_id': 'req-6a08a922-c37a-4ea3-969b-706f360926c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:20.404495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5661fbf46004e7caf8e1dd7d7ac7b82', 'request_id': 'req-6a08a922-c37a-4ea3-969b-706f360926c2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:20.416813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] The token cache is being invalidate because project e5661fbf46004e7caf8e1dd7d7ac7b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:20.417109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:20.418610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a08a922-c37a-4ea3-969b-706f360926c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:20.420265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2793/5581] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:20 2022] DELETE /identity/v3/projects/e5661fbf46004e7caf8e1dd7d7ac7b82 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:20.425358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.425823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.425940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.452412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:20.453901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:20.531540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:20.543426 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2789/5582] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:20.560261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.560261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.560261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.581267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:20.583492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:20.592094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2794/5583] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:20.596448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:20.606544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a2c6-d8f5-4e38-9f50-3745b4b411ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:20.611543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:20.612141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.612465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.612735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.613376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:20.614266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:20.615894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:20.628195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2790/5584] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:20.632821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:20.653637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bcece-b150-456e-8ce3-3a38eff50791 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:20.661351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:20.662213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.662888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.663318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.667299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:20.667482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:20.670207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:20.795273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:20.795729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2795/5585] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:20 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:20.807394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5380-563d-4647-88d6-1e8422223e73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:20.867049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:20.867685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:20.868122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:20.868398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:20.869031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:20.871315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.034061 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2791/5586] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:20 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:21.038378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.056475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2528-1a5d-4068-bcf6-4b04f0d2a0bf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.070001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.070539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.070841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.071110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.071752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.079121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.091839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2796/5587] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:21.095975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.112031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c059-6c84-4733-9e49-bf1aec193320 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.117735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.118350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.118651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.118924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.119565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.121399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a66b54-e1dc-4420-a694-ed902ad8ca68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.144147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.150880 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2792/5588] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:21.156363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0a5a9-69be-4224-9d97-17560c25c7d8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.161914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.162854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.163383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.163847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] PATH_INFO: `/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/dfad0c5f1ce946fab644d2c900cca455/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.180846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d04518447a40d6ac6c1f364da0f38b, user_id=dfad0c5f1ce946fab644d2c900cca455, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.184174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.291243 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2797/5589] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:21 2022] PUT /identity/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/dfad0c5f1ce946fab644d2c900cca455/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:21.293189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.293576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.293945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.324466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] MFA Rules not processed for user `dfad0c5f1ce946fab644d2c900cca455`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:21.325712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:21.396032 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2793/5590] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:21.397094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.463823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b2d8-71cc-438f-b08f-9d17c75e61bd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.508207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.512058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.516092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.518003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.519917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.527265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.675512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2798/5591] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:21 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:21.679608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.691344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9baceb-3023-4cd8-8a66-aecb4b1839a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.741882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:21.774384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.775524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.775970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.776525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.777645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.779963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.921657 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2794/5592] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:21 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:21.925577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.947407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88536921-0c45-410f-9986-9b498de84fa2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.947407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.947407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:21.947407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:21.947948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:21.947948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:21.947948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:21.961117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2799/5593] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:21.965564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:21.978454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78c69-b12d-48fc-8f99-f36d265956fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:21.998147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:21.999640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.000330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.001382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] PATH_INFO: `/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.045274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5dd0fad0d434c6fbc2cba6763a79dda, user_id=1d0c32724381417bab21fdc949bb9d4d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.048289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.148762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2795/5594] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:21 2022] PUT /identity/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:22.152567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:22.182807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ffd02-27d3-42df-81fb-ca872028d45e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:22.258159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:22.259162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.259826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.260437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.261490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.263493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b5123-8ac4-43c9-9a0f-535118285a93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.276743 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2800/5595] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:22.280487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:22.292359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17063b4-c344-4cd9-8390-52cef6bc6163 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:22.297649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:22.298420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.298806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.299331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] PATH_INFO: `/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.302068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5dd0fad0d434c6fbc2cba6763a79dda, user_id=1d0c32724381417bab21fdc949bb9d4d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.304847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.317953 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2796/5596] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:22 2022] PUT /identity/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:22.328336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.329028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.329522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.361521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] MFA Rules not processed for user `1d0c32724381417bab21fdc949bb9d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:22.363231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:22.459186 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2801/5597] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:22.460439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:22.463226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:22.534320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17800100-03cf-46ab-b148-cba3ebecb19a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:22.539936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:22.540728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.541001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.541281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.541919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.543867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.668479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2797/5598] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:22 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:22.676152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:22.691107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec996-7819-41c5-ad82-7855dd09e7b7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:22.793995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:22.794629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.794924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.795280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.795915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.797966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.948924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2802/5599] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:22 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:22.953110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:22.966651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628267-6692-4846-8a95-5484b11e4a1b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:22.972000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:22.972825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:22.973794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:22.974219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:22.975087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:22.976872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:22.988894 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2798/5600] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:22.992755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:23.004853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d1dc-d8ae-478d-8f42-546bfdf6d3a0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:23.010300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:23.010942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.011225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.011501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:23.012151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:23.013810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77cb2a-c742-410a-b1c4-968e82710b91 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:23.037710 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2803/5601] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:23.047731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:23.068824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ba4f-45ab-4644-8bc3-f59cb4fcc60b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:23.073841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:23.075007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.075632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.076184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] PATH_INFO: `/v3/projects/a1524ab5307a4bd982ec6cbc89107cff/users/a1e59f866fbb46d99f76fb439167ce23/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:23.097566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1524ab5307a4bd982ec6cbc89107cff, user_id=a1e59f866fbb46d99f76fb439167ce23, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:23.101834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:23.217985 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2799/5602] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:23 2022] PUT /identity/v3/projects/a1524ab5307a4bd982ec6cbc89107cff/users/a1e59f866fbb46d99f76fb439167ce23/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:23.229231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.230132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.230592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:23.315897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] MFA Rules not processed for user `a1e59f866fbb46d99f76fb439167ce23`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:23.315897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:23.410635 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2804/5603] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:23.415530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:23.530546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed157a-58b1-4c05-b39e-7b413e97964f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:23.536552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:23.537479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.537981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.538510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:23.539429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:23.541393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:23.553699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:23.638675 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2800/5604] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:41:23 2022] POST /identity/v3/domains => generated 276 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:23.641478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:23.653857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c53cc9-90b8-4083-bd82-ed524209e74e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:23.823388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:23.824726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.825240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.825966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:23.827623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:23.830052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:23.913656 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2805/5605] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:41:23 2022] POST /identity/v3/roles => generated 239 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:23.917508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:23.939782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c24b7-a5ea-44ca-b392-5801da1299c3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:23.951728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:23.951728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:23.952099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:23.952214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/a71c63275b974f8cb5d85059782db925/users/a1e59f866fbb46d99f76fb439167ce23/roles/170b5e931bf24f27a31c3c475585aeef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:24.006111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a71c63275b974f8cb5d85059782db925, user_id=a1e59f866fbb46d99f76fb439167ce23, role_id=170b5e931bf24f27a31c3c475585aeef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:24.009095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:24.119651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:24.121810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:24.131130 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2801/5606] 10.222.0.13 () {60 vars in 1480 bytes} [Mon Oct 31 14:41:23 2022] PUT /identity/v3/domains/a71c63275b974f8cb5d85059782db925/users/a1e59f866fbb46d99f76fb439167ce23/roles/170b5e931bf24f27a31c3c475585aeef => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:24.138491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:24.287898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd123e-1c73-4272-bcec-4fdf047e58fb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:24.308781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c7ad-0818-4815-ae91-ea7ed4e0866b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:24.328316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:24.329268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:24.329652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:24.330058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:24.331702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:24.333627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:24.440447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:24.441553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:24.441553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:24.442344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] PATH_INFO: `/v3/users/1743e0244d094856a9587bc0d1c18003` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:24.447471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1743e0244d094856a9587bc0d1c18003)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:24.448976 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2802/5607] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:41:24 2022] POST /identity/v3/domains => generated 275 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:24.449458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:24.455139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:24.527760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:24.596453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e701c-6e93-4cd0-927c-0c4e668ffb8f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:24.610147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:24.611182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:24.611687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:24.612201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:24.613100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:24.615053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:24.895436 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2803/5608] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:41:24 2022] POST /identity/v3/roles => generated 239 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:24.899807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:24.936639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae88ab-5cdb-46b7-bd91-a72aca598fa1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:24.940774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:24.941619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:24.942681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:24.943149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:24.944183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:24.946311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:25.035724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1743e0244d094856a9587bc0d1c18003'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:25.036829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1743e0244d094856a9587bc0d1c18003'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:25.047220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:25.054660 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2804/5609] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:24 2022] POST /identity/v3/groups => generated 326 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:25.059037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:25.060967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:25.075094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947e7-07f9-492f-8471-f20119004bfd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:25.080869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:25.082050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.082050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.083027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6/users/a1e59f866fbb46d99f76fb439167ce23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.096435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7ec57caa4aeb4ab88178d84960eb7ad6, user_id=a1e59f866fbb46d99f76fb439167ce23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:25.098436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:25.109847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1743e0244d094856a9587bc0d1c18003'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:25.130755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1743e0244d094856a9587bc0d1c18003'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:25.131885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-486d2a15-1220-4ee8-8b39-739d22699309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1743e0244d094856a9587bc0d1c18003'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:25.147917 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2806/5610] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:24 2022] DELETE /identity/v3/users/1743e0244d094856a9587bc0d1c18003 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:25.152423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.160161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.161237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.191177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:25.193252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:25.220188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2805/5611] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:41:25 2022] PUT /identity/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6/users/a1e59f866fbb46d99f76fb439167ce23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:25.221237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:25.314767 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2807/5612] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:25.332129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:25.333931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:25.360074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9c3c2-54a4-4ce5-bc25-f5a07516ef20 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:25.375870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:25.377088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.377088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.377535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/9fd9707703ab470caa5070d3d91143b2/groups/7ec57caa4aeb4ab88178d84960eb7ad6/roles/4d09e715f5834b73b664a15f463af5e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.386817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9fd9707703ab470caa5070d3d91143b2, group_id=7ec57caa4aeb4ab88178d84960eb7ad6, role_id=4d09e715f5834b73b664a15f463af5e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:25.386817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:25.454659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f554eb-378a-49a7-8e7c-01c7a04c263c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:25.526164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2806/5613] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:25 2022] PUT /identity/v3/domains/9fd9707703ab470caa5070d3d91143b2/groups/7ec57caa4aeb4ab88178d84960eb7ad6/roles/4d09e715f5834b73b664a15f463af5e3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:25.540397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:25.569528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:25.570510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.571657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.572862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.665384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:25.667893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:25.679960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2808/5614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:25.711497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2446-2b48-4af1-8cad-0da108aff025 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:25.720344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:25.720635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.720916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.721192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.721861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:25.723571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:25.839670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2807/5615] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:41:25 2022] POST /identity/v3/domains => generated 276 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:25.840021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:25.852805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964e36-2407-4343-b614-1068ca9a360c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:25.958633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:25.961062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:25.963064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:25.963307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:25.964029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:25.968992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.064130 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2809/5616] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:41:25 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:26.066323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.175195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53768-f6d3-470c-8213-be536e997ced tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:26.196213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:26.197405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:26.200179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:26.202420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc/users/a1e59f866fbb46d99f76fb439167ce23/roles/1346c4012d294c489a0ce6068dc02f48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:26.236514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=46c3c492ff6a4201a7ce9746c760c6bc, user_id=a1e59f866fbb46d99f76fb439167ce23, role_id=1346c4012d294c489a0ce6068dc02f48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:26.240408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.325686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.334997 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2808/5617] 10.222.0.13 () {60 vars in 1480 bytes} [Mon Oct 31 14:41:26 2022] PUT /identity/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc/users/a1e59f866fbb46d99f76fb439167ce23/roles/1346c4012d294c489a0ce6068dc02f48 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:26.338796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.340513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:26.461792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a03035-3e29-4068-a7ae-4c8c2bfd2f7c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:26.468238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:26.472307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:26.472307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:26.472307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:26.473291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:26.492051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.537172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86720-b455-446f-b6de-4799cd2516c7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:26.586955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2809/5618] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:41:26 2022] POST /identity/v3/domains => generated 276 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:26.589908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.637812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:26.643944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:26.644480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:26.645981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] PATH_INFO: `/v3/projects/37f82d5507b04016b96a765677bacac3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:26.647422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f82d5507b04016b96a765677bacac3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:26.650444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.744927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5a925-4827-43b3-ac27-7af4d1120341 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:26.753112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:26.760350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:26.760350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:26.760350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:26.760350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:26.760350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.800499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:26.856406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2810/5619] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:41:26 2022] POST /identity/v3/roles => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:26.858524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.860082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f82d5507b04016b96a765677bacac3', 'request_id': 'req-ec95644a-792b-4b1b-8e73-50552a325dc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:26.872988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083ab0-fae3-42f3-aa5e-6dd6e7ca252a tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:26.924416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f82d5507b04016b96a765677bacac3', 'request_id': 'req-ec95644a-792b-4b1b-8e73-50552a325dc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:26.950093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f82d5507b04016b96a765677bacac3', 'request_id': 'req-ec95644a-792b-4b1b-8e73-50552a325dc0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:26.950993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:26.951720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:26.952466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:26.952887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:26.953979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:26.957132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:26.980159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] The token cache is being invalidate because project 37f82d5507b04016b96a765677bacac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:26.980923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:26.982492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:26.983172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:26.985432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2810/5620] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:26 2022] DELETE /identity/v3/projects/37f82d5507b04016b96a765677bacac3 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:26.992075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:26.992933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:27.075660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95644a-792b-4b1b-8e73-50552a325dc0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:27.081404 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2811/5621] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:41:26 2022] POST /identity/v3/groups => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:27.083567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:27.085754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:27.086717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:27.087640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:27.088498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:27.088994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] PATH_INFO: `/v3/users/9908433e215e4b7688b16825a4a18113` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:27.090502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9908433e215e4b7688b16825a4a18113)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:27.092828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:27.124799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe0c5-91cb-4d9b-8364-471e9162ca24 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:27.136098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:27.136098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:27.136098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:27.136398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/5aec9d7e7405455f945946753e3deda0/users/a1e59f866fbb46d99f76fb439167ce23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:27.141929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5aec9d7e7405455f945946753e3deda0, user_id=a1e59f866fbb46d99f76fb439167ce23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:27.144320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:27.285155 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2812/5622] 10.222.0.13 () {60 vars in 1360 bytes} [Mon Oct 31 14:41:27 2022] PUT /identity/v3/groups/5aec9d7e7405455f945946753e3deda0/users/a1e59f866fbb46d99f76fb439167ce23 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:27.293374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:27.346990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9908433e215e4b7688b16825a4a18113'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:27.348013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9908433e215e4b7688b16825a4a18113'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:27.421592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4f04-9c27-422b-8cfe-3ca7253cb666 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:27.433101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:27.435600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:27.436373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:27.436893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/906bd7c6bbcc4c3097be71949fb37e58/groups/5aec9d7e7405455f945946753e3deda0/roles/6cce736f8cbc41b99f1e180a67205ba3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:27.439557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=906bd7c6bbcc4c3097be71949fb37e58, group_id=5aec9d7e7405455f945946753e3deda0, role_id=6cce736f8cbc41b99f1e180a67205ba3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:27.440633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9908433e215e4b7688b16825a4a18113'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:27.443532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:27.460763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9908433e215e4b7688b16825a4a18113'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:27.461774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9908433e215e4b7688b16825a4a18113'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:27.481710 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2811/5623] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:26 2022] DELETE /identity/v3/users/9908433e215e4b7688b16825a4a18113 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:27.595855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2813/5624] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:27 2022] PUT /identity/v3/domains/906bd7c6bbcc4c3097be71949fb37e58/groups/5aec9d7e7405455f945946753e3deda0/roles/6cce736f8cbc41b99f1e180a67205ba3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:27.601142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:27.601142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:27.764754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c822f0-3e09-441b-99aa-2b933767c368 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:27.896055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e59f866fbb46d99f76fb439167ce23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1524ab5307a4bd982ec6cbc89107cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:27.896715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:27.896996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:27.897271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] PATH_INFO: `/v3/auth/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:27.897836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:27.898954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:27.914575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:27.990923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2812/5625] 10.222.0.13 () {58 vars in 1143 bytes} [Mon Oct 31 14:41:27 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:27.992710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:27.994556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:28.057841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:28.112797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbc01-b951-4458-96ca-a49d7c022e9b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.118103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.118856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.119882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.120175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/906bd7c6bbcc4c3097be71949fb37e58/groups/5aec9d7e7405455f945946753e3deda0/roles/6cce736f8cbc41b99f1e180a67205ba3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.122364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=906bd7c6bbcc4c3097be71949fb37e58, group_id=5aec9d7e7405455f945946753e3deda0, role_id=6cce736f8cbc41b99f1e180a67205ba3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.125112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.132156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 6cce736f8cbc41b99f1e180a67205ba3 was removed from group 5aec9d7e7405455f945946753e3deda0 on domain 906bd7c6bbcc4c3097be71949fb37e58. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:28.132453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.133159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.210572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:28.212437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:28.249277 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2814/5626] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:41:27 2022] DELETE /identity/v3/domains/906bd7c6bbcc4c3097be71949fb37e58/groups/5aec9d7e7405455f945946753e3deda0/roles/6cce736f8cbc41b99f1e180a67205ba3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:28.254015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:28.257221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:28.330843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9c31f-43f6-413c-bdb4-830a6bac3a18 tempest-TokensV3TestJSON-1068167440 tempest-TokensV3TestJSON-1068167440-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.370746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6579027-29b5-4cd2-ae9e-2a583d810be1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.377433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.378305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.378814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.379794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/5aec9d7e7405455f945946753e3deda0/users/a1e59f866fbb46d99f76fb439167ce23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.383288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5aec9d7e7405455f945946753e3deda0, user_id=a1e59f866fbb46d99f76fb439167ce23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.387217 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:41:28.387217 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:41:28.387217 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:41:28.387217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.406264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.410210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.410210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.410492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:28.410636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] PATH_INFO: `/v3/projects/d0f9b48841b04ab183f368f8ea54ecd9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.410636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f9b48841b04ab183f368f8ea54ecd9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.410854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.457161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.541278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f9b48841b04ab183f368f8ea54ecd9', 'request_id': 'req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.578325 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2815/5627] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:41:28 2022] DELETE /identity/v3/groups/5aec9d7e7405455f945946753e3deda0/users/a1e59f866fbb46d99f76fb439167ce23 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:28.580183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:28.640811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f9b48841b04ab183f368f8ea54ecd9', 'request_id': 'req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.646967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f9b48841b04ab183f368f8ea54ecd9', 'request_id': 'req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.660350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] The token cache is being invalidate because project d0f9b48841b04ab183f368f8ea54ecd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:28.660749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.661436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:28.663928 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2813/5628] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:28 2022] DELETE /identity/v3/projects/d0f9b48841b04ab183f368f8ea54ecd9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:28.667780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:28.669954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:28.675098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fae7e-ac95-4912-a6ff-13c9ace8be44 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.682367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.683832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.684274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.684739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/5aec9d7e7405455f945946753e3deda0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.686113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5aec9d7e7405455f945946753e3deda0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.688790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.749991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d0556-e3ab-403c-ac12-33ef7857a5f5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.798054 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2816/5629] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:41:28 2022] DELETE /identity/v3/groups/5aec9d7e7405455f945946753e3deda0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:28.802882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:28.805475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:28.832736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.832736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.832736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.832736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] PATH_INFO: `/v3/users/6343ce63121e4805828c44d60687cbad` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.833175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6343ce63121e4805828c44d60687cbad)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.834407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.852037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:28.888944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea7635-285e-4c23-b546-ac262eb2ac8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:28.894080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:28.895190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:28.895562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:28.895929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles/6cce736f8cbc41b99f1e180a67205ba3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:28.897820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6cce736f8cbc41b99f1e180a67205ba3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:28.899732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:28.950155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:29.012375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6343ce63121e4805828c44d60687cbad'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.013686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6343ce63121e4805828c44d60687cbad'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.018489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 6cce736f8cbc41b99f1e180a67205ba3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:29.019139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.021053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.026706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2817/5630] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:28 2022] DELETE /identity/v3/roles/6cce736f8cbc41b99f1e180a67205ba3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:29.027836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:29.030236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.097067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6343ce63121e4805828c44d60687cbad'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.119017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6343ce63121e4805828c44d60687cbad'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.119870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00b8fd7-7c7a-4058-a61d-0668c2c9b419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6343ce63121e4805828c44d60687cbad'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.149078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad6de5-ce29-4a2c-b96b-19a484b357de tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:29.162641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:29.165451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:29.165451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:29.165451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/906bd7c6bbcc4c3097be71949fb37e58` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:29.165737 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2814/5631] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:28 2022] DELETE /identity/v3/users/6343ce63121e4805828c44d60687cbad => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:29.172274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=906bd7c6bbcc4c3097be71949fb37e58)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:29.175412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:29.197360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:29.197803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:29.198195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:29.223373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.228788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.234848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:29.236085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.388822 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2815/5632] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:29.389461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.394156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.397869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2818/5633] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:29 2022] PATCH /identity/v3/domains/906bd7c6bbcc4c3097be71949fb37e58 => generated 277 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:29.398860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:29.400727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:29.401365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.402330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.466305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:29.546021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec7973-d64f-403d-8b3d-775654deb816 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:29.551768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:29.553021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:29.553382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:29.553789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/906bd7c6bbcc4c3097be71949fb37e58` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:29.566859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c31a-5bbf-4df4-88d8-8c1469a036ca None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:29.568177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=906bd7c6bbcc4c3097be71949fb37e58)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:29.571288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:29.573883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:29.574774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:29.575234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:29.575674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:29.577776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.602292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.615067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:29.617685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:29.625663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:29.640006 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2816/5634] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:41:29.678021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:29.683778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:29.686089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:29.768148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000475-996e-4c8b-94d9-e3800226c78d service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:29.775905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:29.776758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:29.777225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:29.777782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] PATH_INFO: `/v3/users/27d09c00d18e43c98907f7cbf3e379ea` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:29.779330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d09c00d18e43c98907f7cbf3e379ea)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:29.782346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:29.856539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.166417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.166417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.166417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project 906bd7c6bbcc4c3097be71949fb37e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:30.166417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.171078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.171078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.171078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.171078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '906bd7c6bbcc4c3097be71949fb37e58', 'request_id': 'req-e4509ad6-8129-4b8f-9524-bc2757605a8d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.172923 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2819/5635] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:29 2022] DELETE /identity/v3/domains/906bd7c6bbcc4c3097be71949fb37e58 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:30.172923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:30.172923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:30.209186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d09c00d18e43c98907f7cbf3e379ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.211586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d09c00d18e43c98907f7cbf3e379ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.261069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509ad6-8129-4b8f-9524-bc2757605a8d tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:30.273094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:30.278671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:30.278671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:30.278671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc/users/a1e59f866fbb46d99f76fb439167ce23/roles/1346c4012d294c489a0ce6068dc02f48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:30.278671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=46c3c492ff6a4201a7ce9746c760c6bc, user_id=a1e59f866fbb46d99f76fb439167ce23, role_id=1346c4012d294c489a0ce6068dc02f48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:30.280210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:30.287986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 1346c4012d294c489a0ce6068dc02f48 was removed from user a1e59f866fbb46d99f76fb439167ce23 on domain 46c3c492ff6a4201a7ce9746c760c6bc. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:30.289636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.290900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-60187806-7b78-4f9e-8908-6e5f7352ccc7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.298943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d09c00d18e43c98907f7cbf3e379ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.339467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d09c00d18e43c98907f7cbf3e379ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.340322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d09c00d18e43c98907f7cbf3e379ea'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.377832 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2817/5636] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:29 2022] DELETE /identity/v3/users/27d09c00d18e43c98907f7cbf3e379ea => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:30.379068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:30.383981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:30.404248 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2820/5637] 10.222.0.13 () {58 vars in 1464 bytes} [Mon Oct 31 14:41:30 2022] DELETE /identity/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc/users/a1e59f866fbb46d99f76fb439167ce23/roles/1346c4012d294c489a0ce6068dc02f48 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:30.407346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:30.407346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:30.407346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:30.503088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:30.508070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:30.542340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b273e-0031-4a6f-bbc8-f82bc0588d51 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:30.615115 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2821/5638] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:30.616178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:30.618244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:30.643019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:30.643972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:30.644528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:30.645020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] PATH_INFO: `/v3/projects/2192ca78952644d793c564e113235f2e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:30.647157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2192ca78952644d793c564e113235f2e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:30.650017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:30.750127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a45c-1bf8-4562-93c0-524d3d062e17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:30.776142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:30.809918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:30.810219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:30.810480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles/1346c4012d294c489a0ce6068dc02f48` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:30.821686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1346c4012d294c489a0ce6068dc02f48)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:30.831409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:30.849782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2192ca78952644d793c564e113235f2e', 'request_id': 'req-5a2e191b-f852-475d-868e-7a2270333275'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.924947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:30.953178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2192ca78952644d793c564e113235f2e', 'request_id': 'req-5a2e191b-f852-475d-868e-7a2270333275'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.962484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2192ca78952644d793c564e113235f2e', 'request_id': 'req-5a2e191b-f852-475d-868e-7a2270333275'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.987187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 1346c4012d294c489a0ce6068dc02f48 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:30.987969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.989580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:30.996831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2822/5639] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:30 2022] DELETE /identity/v3/roles/1346c4012d294c489a0ce6068dc02f48 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:30.998025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:31.001157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.023594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:31.025391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] The token cache is being invalidate because project 2192ca78952644d793c564e113235f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:31.025759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.026527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.031716 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2818/5640] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:30 2022] DELETE /identity/v3/projects/2192ca78952644d793c564e113235f2e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:31.031716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:31.032323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.222209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e191b-f852-475d-868e-7a2270333275 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:31.240332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e862-49f7-4422-a9d6-380ec802afe6 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:31.243899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:31.244985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.245236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.245719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.247682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.370062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:31.370788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.371130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.371337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.372682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=46c3c492ff6a4201a7ce9746c760c6bc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:31.378910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:31.429062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:31.430810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9237d78-8613-4081-820a-88112b25ded5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:31.435754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.436557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.452341 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2823/5641] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:31.455848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b0be-d9c5-4919-812a-00fa3d7e7cc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.456134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b0be-d9c5-4919-812a-00fa3d7e7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.456405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899b0be-d9c5-4919-812a-00fa3d7e7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.577154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8899b0be-d9c5-4919-812a-00fa3d7e7cc0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:31.578826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.580976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.581536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8899b0be-d9c5-4919-812a-00fa3d7e7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.592738 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2819/5642] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:31 2022] PATCH /identity/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc => generated 277 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:31.596629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:31.604550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.747798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:31.774946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e44068-b74d-4b70-9bdc-0990164b19e2 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:31.787077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2824/5643] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:31.795683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.796538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:31.798548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.799227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.799760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.820763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.821533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.827325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=46c3c492ff6a4201a7ce9746c760c6bc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:31.829330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:31.857079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.861250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:31.868171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:31.868171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:31.876432 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2825/5644] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:31.881418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:31.902325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332283f5-d1d0-483a-8b61-f5265a56cb60 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:31.915221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:31.916867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:31.918471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:31.918471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:31.918734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:31.923785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:31.923785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:31.923785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:31.952745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2826/5645] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:31.960266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:31.988128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b582f9-a893-4f3d-b99d-2ddb7729bc8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:32.002816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:32.003447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:32.004620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:32.004956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:32.006023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:32.012814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:32.042437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.092285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.120956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.135692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.159765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2827/5646] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:31 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:32.161572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:32.173063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project 46c3c492ff6a4201a7ce9746c760c6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:32.173340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.173498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:32.176274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.196113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.197077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.209993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '46c3c492ff6a4201a7ce9746c760c6bc', 'request_id': 'req-3cd599c0-4d56-4277-b14a-61dce13044e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.234530 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2820/5647] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:31 2022] DELETE /identity/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:32.234530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:32.237271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:32.293472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.340390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed9e7b-f13c-411c-9aeb-29085065f674 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:32.364352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:32.365114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:32.365453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:32.365799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] PATH_INFO: `/v3/projects/9185166f4b0c490facd88677d4f74720` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:32.373955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9185166f4b0c490facd88677d4f74720)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:32.383933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:32.411031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd599c0-4d56-4277-b14a-61dce13044e8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:32.427964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:32.431120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:32.431120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:32.431120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:32.431120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:32.433089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:32.438848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.547704 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2821/5648] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:32 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:32.547704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:32.564899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:32.579240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9185166f4b0c490facd88677d4f74720', 'request_id': 'req-942f4158-495b-4d7d-a86c-2330009d93c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.682348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.684092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9185166f4b0c490facd88677d4f74720', 'request_id': 'req-942f4158-495b-4d7d-a86c-2330009d93c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.689359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b810686-3d6d-4232-9af2-3f6d3f3ce4c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:32.700827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9185166f4b0c490facd88677d4f74720', 'request_id': 'req-942f4158-495b-4d7d-a86c-2330009d93c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.740493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] The token cache is being invalidate because project 9185166f4b0c490facd88677d4f74720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:32.740823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.756610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.758885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2828/5649] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:32 2022] DELETE /identity/v3/projects/9185166f4b0c490facd88677d4f74720 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:32.763552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:32.769500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:32.782212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.907691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:32.908495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:32.908840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:32.909194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/9fd9707703ab470caa5070d3d91143b2/groups/7ec57caa4aeb4ab88178d84960eb7ad6/roles/4d09e715f5834b73b664a15f463af5e3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:32.912489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9fd9707703ab470caa5070d3d91143b2, group_id=7ec57caa4aeb4ab88178d84960eb7ad6, role_id=4d09e715f5834b73b664a15f463af5e3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:32.916817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:32.918864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:32.922306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 4d09e715f5834b73b664a15f463af5e3 was removed from group 7ec57caa4aeb4ab88178d84960eb7ad6 on domain 9fd9707703ab470caa5070d3d91143b2. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:32.922761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.923810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:32.995197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f4158-495b-4d7d-a86c-2330009d93c7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.004568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.007843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.007843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.007843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.007843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.008768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.013675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2822/5650] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:41:32 2022] DELETE /identity/v3/domains/9fd9707703ab470caa5070d3d91143b2/groups/7ec57caa4aeb4ab88178d84960eb7ad6/roles/4d09e715f5834b73b664a15f463af5e3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:33.013675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:33.015739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:33.031117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2829/5651] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:32 2022] GET /identity/v3/roles => generated 1880 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:33.031117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:33.032551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:33.066368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efa5e0-df56-4fb3-a575-05764f4b303d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.100434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:33.166647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9b02-9174-4dc4-921c-5781025f8835 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.177128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.179683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.189494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.189494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] PATH_INFO: `/v3/users/bd33bc08dd8e49978ad5ac89f01d727b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.189494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd33bc08dd8e49978ad5ac89f01d727b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.189494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.201783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.202549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.202930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.203281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6/users/a1e59f866fbb46d99f76fb439167ce23` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.205136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7ec57caa4aeb4ab88178d84960eb7ad6, user_id=a1e59f866fbb46d99f76fb439167ce23)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.207701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.291672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.294236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:33.391742 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2830/5652] 10.222.0.13 () {58 vars in 1344 bytes} [Mon Oct 31 14:41:33 2022] DELETE /identity/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6/users/a1e59f866fbb46d99f76fb439167ce23 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:33.396744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:33.396744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:33.417049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd33bc08dd8e49978ad5ac89f01d727b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.418240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd33bc08dd8e49978ad5ac89f01d727b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.525836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd33bc08dd8e49978ad5ac89f01d727b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.532756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:33.549500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351415d-46e8-4e02-8658-55e5f1faa241 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.557203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:33.559169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd33bc08dd8e49978ad5ac89f01d727b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.561877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd33bc08dd8e49978ad5ac89f01d727b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:33.569930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.570531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.570910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.571126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.571750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.584449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.598963 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2823/5653] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:33 2022] DELETE /identity/v3/users/bd33bc08dd8e49978ad5ac89f01d727b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:33.599945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:33.601417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:33.618364 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2831/5654] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:33 2022] GET /identity/v3/roles => generated 1880 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:33.619376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:33.624788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:33.660060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81763d-5cd9-4ad1-a620-a1fd5f24e4fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.751200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022928c7-c5f6-4610-8d46-08cbf509c329 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:33.773332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.774264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.774722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.775178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.777047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7ec57caa4aeb4ab88178d84960eb7ad6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.779803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.873610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:33.874342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:33.874654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:33.874978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] PATH_INFO: `/v3/projects/79ef17441681482b8fb80f68cbf9d530/users/a05cdb9c60e64a5fb3c9733c4484ee7f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:33.932821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ef17441681482b8fb80f68cbf9d530, user_id=a05cdb9c60e64a5fb3c9733c4484ee7f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:33.936463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9c96e-4855-4d2a-8d57-abd58de8175f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:33.996777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2824/5655] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:41:33 2022] DELETE /identity/v3/groups/7ec57caa4aeb4ab88178d84960eb7ad6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:33.998163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:34.091850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2832/5656] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:33 2022] PUT /identity/v3/projects/79ef17441681482b8fb80f68cbf9d530/users/a05cdb9c60e64a5fb3c9733c4484ee7f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:34.118006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:34.118374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:34.118566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:34.180178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3032c-cb49-46da-a722-972b83b213aa tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:34.182157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] MFA Rules not processed for user `a05cdb9c60e64a5fb3c9733c4484ee7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:34.183551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:34.318122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2833/5657] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:34.319066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:34.323691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:34.378999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:34.398048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:34.398942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:34.399956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:34.400332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles/4d09e715f5834b73b664a15f463af5e3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:34.404015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d09e715f5834b73b664a15f463af5e3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:34.406527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:34.478107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179db1c-398b-486d-91a0-e9195f3f2146 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:34.485871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:34.487092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:34.487551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:34.488126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] PATH_INFO: `/v3/projects/0455598fe6f9433e819822a91c713bfe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:34.489572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0455598fe6f9433e819822a91c713bfe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:34.493237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:34.513575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:34.545777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 4d09e715f5834b73b664a15f463af5e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:34.554647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.554647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.554647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2825/5658] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:33 2022] DELETE /identity/v3/roles/4d09e715f5834b73b664a15f463af5e3 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:34.554647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:34.554647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:34.639444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0455598fe6f9433e819822a91c713bfe', 'request_id': 'req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.681521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329fa21-d2ba-45c9-b144-92beaae5809b tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:34.720029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0455598fe6f9433e819822a91c713bfe', 'request_id': 'req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.730986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0455598fe6f9433e819822a91c713bfe', 'request_id': 'req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.761201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] The token cache is being invalidate because project 0455598fe6f9433e819822a91c713bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:34.761645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.763617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:34.767983 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2834/5659] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:34 2022] DELETE /identity/v3/projects/0455598fe6f9433e819822a91c713bfe => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:34.767983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:34.767983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:34.864914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:34.865630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:34.865771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:34.866011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:34.866707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:34.868607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c20b0-beb9-4688-9e28-929a37441142 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:34.981251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314cb62-f7d5-4ccf-9f97-e1c71b9cb8de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:34.998011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:34.999253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:34.999705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.000528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/9fd9707703ab470caa5070d3d91143b2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.001890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2826/5660] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:34 2022] POST /identity/v3/projects => generated 385 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:35.002791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9fd9707703ab470caa5070d3d91143b2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.003339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.003632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.003906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.008845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.054733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.057666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.095411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:35.099839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:35.200136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:35.200916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.202175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.208710 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2835/5661] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:34 2022] PATCH /identity/v3/domains/9fd9707703ab470caa5070d3d91143b2 => generated 276 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:35.210046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.217472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:35.228732 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2827/5662] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:35.229883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.231468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:35.253271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647eb8-e3e6-4d36-9e08-aa5e22d4366e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:35.267555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:35.268268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.271190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.271524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.272251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.279578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcd951-7099-43e5-8dfa-bad893dc13fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.405838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845202b7-79ff-4beb-8f7e-8a201432179a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:35.421987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:35.422195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2836/5663] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:35 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:35.423605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.424283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.425013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/9fd9707703ab470caa5070d3d91143b2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.428829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.433102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.434039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.463385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9fd9707703ab470caa5070d3d91143b2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.468046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.519380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:35.521580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:35.527185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.545866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9fd9707703ab470caa5070d3d91143b2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.559435 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2837/5664] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:35.560466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.600538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6ec87-be33-4cd2-9bd7-a02af0e5abcf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:35.632569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:35.633479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.633943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.634373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.635220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.637212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.662317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2838/5665] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:35 2022] GET /identity/v3/roles => generated 1650 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:35.663207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.688852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4a7d-7c25-4086-a2c9-8348cd455b31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:35.697842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:35.698757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.699169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.699547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.700513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:35.701475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.726269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.757656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.764336 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2839/5666] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:35.765454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.783777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a530263-5a87-4111-b27b-934aa104d922 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:35.803925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:35.825611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.839209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.888363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project 9fd9707703ab470caa5070d3d91143b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:35.891838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.891838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.911734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.913172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.914094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9fd9707703ab470caa5070d3d91143b2', 'request_id': 'req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:35.936990 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2828/5667] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:35 2022] DELETE /identity/v3/domains/9fd9707703ab470caa5070d3d91143b2 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:35.937244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:35.937410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:35.937562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:35.938200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:35.938837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] PATH_INFO: `/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a/users/578ab638ce9a45f68f520997e7641b45/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:35.942377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:35.972357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9518d655ac8f4cc1a993f682e7a5af9a, user_id=578ab638ce9a45f68f520997e7641b45, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:35.976895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:35.997682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca261e-a3a3-4b2d-81fc-baeb062d6f09 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.008216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.008855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.009139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.009413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.010063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.034429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.087241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2840/5668] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:35 2022] PUT /identity/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a/users/578ab638ce9a45f68f520997e7641b45/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:36.090277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.092425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.178101 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2829/5669] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:35 2022] POST /identity/v3/projects => generated 395 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:36.180316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.183311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67344fc6-4c1a-418e-8f81-b6940ffdd6ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.185041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.231979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:36.323923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.329197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.329197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.329197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/a71c63275b974f8cb5d85059782db925/users/a1e59f866fbb46d99f76fb439167ce23/roles/170b5e931bf24f27a31c3c475585aeef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.330876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a71c63275b974f8cb5d85059782db925, user_id=a1e59f866fbb46d99f76fb439167ce23, role_id=170b5e931bf24f27a31c3c475585aeef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.334126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.354524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 170b5e931bf24f27a31c3c475585aeef was removed from user a1e59f866fbb46d99f76fb439167ce23 on domain a71c63275b974f8cb5d85059782db925. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:36.354847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:36.357811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:36.398015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c2639-d2dd-46f3-9216-690da1e9f05a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.426585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.427251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.427531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.427800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.428512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.430086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.447207 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2841/5670] 10.222.0.13 () {58 vars in 1464 bytes} [Mon Oct 31 14:41:36 2022] DELETE /identity/v3/domains/a71c63275b974f8cb5d85059782db925/users/a1e59f866fbb46d99f76fb439167ce23/roles/170b5e931bf24f27a31c3c475585aeef => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:36.448942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.452052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.469981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2830/5671] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:36 2022] GET /identity/v3/roles => generated 1650 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:36.473632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.486106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.520249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b7680-2de0-440c-bed4-43f860b22736 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.561556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:36.592283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.593123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.593264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.593651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles/170b5e931bf24f27a31c3c475585aeef` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.594982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_role(role_id=170b5e931bf24f27a31c3c475585aeef)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.596773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.633210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d869198-3c37-4c96-a04e-77d8fa483694 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.642737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.643538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.643711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.644090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.645183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.657401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.698578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 170b5e931bf24f27a31c3c475585aeef has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:36.699055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:36.700229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:36.703144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2831/5672] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:36 2022] DELETE /identity/v3/roles/170b5e931bf24f27a31c3c475585aeef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:36.720681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.730767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.785645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2842/5673] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:36 2022] POST /identity/v3/users => generated 298 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:36.786574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.791238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.831203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38eb1d-6ce8-486e-a1c6-f0952dca0d5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.853827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e661f-a0fa-452b-aeaa-54ab4141521e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:36.861004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:36.861696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:36.861978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:36.862311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] PATH_INFO: `/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a/users/578ab638ce9a45f68f520997e7641b45/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:36.879391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9518d655ac8f4cc1a993f682e7a5af9a, user_id=578ab638ce9a45f68f520997e7641b45, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:36.882653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:36.933319 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2832/5674] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:36 2022] PUT /identity/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a/users/578ab638ce9a45f68f520997e7641b45/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:36.934271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:36.944918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:36.959689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:37.024996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:37.025736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:37.026102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:37.026413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/a71c63275b974f8cb5d85059782db925` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:37.031621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a71c63275b974f8cb5d85059782db925)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:37.040356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:37.112481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.115326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.115455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa407ce-83c9-468d-8767-69121cf0773a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:37.202492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.205439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaf3a79a-d828-4f74-8409-ffb044845931 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.217010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2843/5675] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:36 2022] PATCH /identity/v3/domains/a71c63275b974f8cb5d85059782db925 => generated 277 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:37.218368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:37.219472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:37.219472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:37.252295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:37.252938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:37.253226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:37.253498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:37.254861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:37.256529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:37.270401 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2833/5676] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:37.271470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:37.275115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:37.296511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] MFA Rules not processed for user `578ab638ce9a45f68f520997e7641b45`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:37.298503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:37.393410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cd91e-9eaf-46c2-82c0-681ea50c6133 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:37.407192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:37.408628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:37.409255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:37.409720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/a71c63275b974f8cb5d85059782db925` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:37.438170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a71c63275b974f8cb5d85059782db925)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:37.441104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:37.480892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2844/5677] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:37.483307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:37.488864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:37.490599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.503716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a71c63275b974f8cb5d85059782db925'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.524581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864d9c3-e280-4651-9c5a-a3a4f85309ea None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:37.533120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:37.535286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:37.535631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:37.536130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:37.537023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:37.550034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:37.554975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:37.608443 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2845/5678] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:37.609241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:37.630411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:37.655730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:37.699739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.756352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.775284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.814802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project a71c63275b974f8cb5d85059782db925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:37.815079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.817215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.835885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.837268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.838804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a71c63275b974f8cb5d85059782db925', 'request_id': 'req-ce4c2072-859f-4701-9c7a-99fa68a5b143'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:37.865028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2834/5679] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:41:37 2022] DELETE /identity/v3/domains/a71c63275b974f8cb5d85059782db925 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:37.872745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:37.876470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:37.904715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e14c80-50b4-4c29-8c73-48f57c21747b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.027016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c2072-859f-4701-9c7a-99fa68a5b143 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.058187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.058943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.059222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.061042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] PATH_INFO: `/v3/projects/e76148808051497baa2c3189ad901209/users/20eab75e6e144c5fbe14685738b5dee3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.107325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.107857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76148808051497baa2c3189ad901209, user_id=20eab75e6e144c5fbe14685738b5dee3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.108012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.108213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.108456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.112041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:38.115278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:38.232112 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2835/5680] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:37 2022] PUT /identity/v3/projects/e76148808051497baa2c3189ad901209/users/20eab75e6e144c5fbe14685738b5dee3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:38.235923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.237881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:38.238713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75574b0-6315-4dff-ab0f-c885bf850428 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:38.242700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:38.268840 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2846/5681] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:38.271171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.271600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.273029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.332016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] MFA Rules not processed for user `20eab75e6e144c5fbe14685738b5dee3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:38.334397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:38.443824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:38.488435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139844-4861-408f-86cd-43a500ac2a8d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.502488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.503391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.503663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.503885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2847/5682] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:38.504629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.505415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:38.511322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.513190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:38.538953 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2836/5683] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:38.541135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:38.552978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:38.564169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c69b4-be8d-47dc-8a89-72f6cdc6e2ec tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.577183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.577870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.578153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.578433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.587837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(project_id=51d04518447a40d6ac6c1f364da0f38b, user_id=1d0c32724381417bab21fdc949bb9d4d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.591503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:38.678641 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2837/5684] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:38 2022] PUT /identity/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:38.693572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:38.709185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7f59d-e96e-40c9-8840-92e47c2b2c1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.869897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.870770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.871575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.872613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.874334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.876389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:38.877126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac038d7-0c7e-4fd5-9193-892de9b87e91 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:38.884899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:38.885523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:38.885811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:38.888645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:38.889279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:38.890443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.021882 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2838/5685] 10.222.0.13 () {58 vars in 1146 bytes} [Mon Oct 31 14:41:38 2022] GET /identity/v3/auth/projects => generated 826 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:39.026092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.044930 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2848/5686] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:38 2022] POST /identity/v3/projects => generated 399 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:39.045752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ec7cc-fb8d-4c20-ab32-3b84e6f4697e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.047861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.222452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b2e6d-98e7-4ed3-b0a1-c656c3999246 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.235471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.236500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.236981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.237451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.239165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.242685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.301918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.303690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.306222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.308753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.317750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=51d04518447a40d6ac6c1f364da0f38b, user_id=1d0c32724381417bab21fdc949bb9d4d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.328063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.333567 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2849/5687] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:39 2022] POST /identity/v3/users => generated 306 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:39.337641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.358672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role cdd12ff38c8843ef896a12ed03c315ae was removed from user 1d0c32724381417bab21fdc949bb9d4d on project 51d04518447a40d6ac6c1f364da0f38b. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:39.360727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:39.378104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:39.389965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d8ef-ad21-4400-b7d0-b2553e397d6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.407602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.408441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.409275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.411095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.413201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.416669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.432153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:39.447775 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2850/5688] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:39.449004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.450984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:39.467771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0af0f-4109-4840-8882-a0b52e8561a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.481305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.482405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.483867 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2839/5689] 10.222.0.13 () {58 vars in 1467 bytes} [Mon Oct 31 14:41:39 2022] DELETE /identity/v3/projects/51d04518447a40d6ac6c1f364da0f38b/users/1d0c32724381417bab21fdc949bb9d4d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:39.483997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.483997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] PATH_INFO: `/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9/users/5cbee58f75884c36af349efe262e45a4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.488364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.492190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:39.519454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbe85d163cd495fbf6325f410ccf9f9, user_id=5cbee58f75884c36af349efe262e45a4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.522960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.603829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:39.646693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49b7a-06fd-44dd-b5cf-639ab86a8b9c tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.658965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2851/5690] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:39 2022] PUT /identity/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9/users/5cbee58f75884c36af349efe262e45a4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:39.658965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:39.767268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.767999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.768427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.769045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.770488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.773531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.858593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c314f7-fb4d-4c4b-b462-98e48141480b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:39.866806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:39.868975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:39.868975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:39.879975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:39.880900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:39.912146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:39.970413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2852/5691] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:39.976296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:40.002051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ebb46-26a6-4b7c-98e1-652c7712aa23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:40.087265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:40.087265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:40.087265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:40.087265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] PATH_INFO: `/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9/users/5cbee58f75884c36af349efe262e45a4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:40.087668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbe85d163cd495fbf6325f410ccf9f9, user_id=5cbee58f75884c36af349efe262e45a4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:40.087668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fbd4c-1e33-438d-9bae-0e2836ab3022 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:40.087845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2840/5692] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:39 2022] POST /identity/v3/users => generated 323 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:40.088274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2853/5693] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:39 2022] PUT /identity/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9/users/5cbee58f75884c36af349efe262e45a4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:40.088370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:40.090524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:40.174213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:40.174213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:40.175445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de74a-ee22-4032-a397-e30d6bec5b80 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:40.175889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] MFA Rules not processed for user `5cbee58f75884c36af349efe262e45a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:40.175889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:40.223302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:40.223942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:40.224225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:40.224502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:40.225172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:40.239508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:40.338444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2854/5694] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:40.363187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:40.365922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:40.453219 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2841/5695] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:40 2022] POST /identity/v3/projects => generated 364 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:40.458346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:40.587569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:40.631619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13859d8f-f7a1-4bcf-ad8f-00afb0892dbf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:40.728854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3de4e4-bcbb-448d-b380-3f0bf2ee9176 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:40.746661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:40.747446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:40.747734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:40.748014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:40.756003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:40.762816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:40.767900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:40.768707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:40.769163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:40.770133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:40.772756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:40.779547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:40.874892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:40.884362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:40.896345 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2855/5696] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:40.897693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:40.899984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:40.915286 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2842/5697] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:40 2022] POST /identity/v3/projects => generated 364 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:40.917045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:41.080516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0ccde-8b33-48a7-b225-822de4bfb0d0 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:41.097104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdfcd-f195-433d-ba71-e53079110c6e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:41.109729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:41.114079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.114079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.114079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.114079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:41.114079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:41.206232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:41.217926 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2843/5698] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:41:40 2022] POST /identity/v3/roles => generated 240 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:41.219141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:41.226282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:41.233632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:41.236039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.236039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.236039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.240003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:41.356335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b993b05-3a16-4be1-a33e-5f5f1b714ea8 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:41.361071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:41.362460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:41.362824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:41.363803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.364293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.364704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] PATH_INFO: `/v3/users/a05cdb9c60e64a5fb3c9733c4484ee7f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.366034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05cdb9c60e64a5fb3c9733c4484ee7f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:41.368015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:41.373491 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2856/5699] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:41:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:41:41.381362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:41.390321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4429-0a1b-44c8-9bf2-2b2dd22e0cb3 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:41.396799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:41.397795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.397904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.398125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/a0e7bad018d44a25a09056e27ff3a71e/users/5ff48c42f74046d19a9b477d17b4bc85/roles/2957da46bdca4442b4d92873884c61a2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.419168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a0e7bad018d44a25a09056e27ff3a71e, user_id=5ff48c42f74046d19a9b477d17b4bc85, role_id=2957da46bdca4442b4d92873884c61a2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:41.423519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:41.557039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2857/5700] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:41 2022] PUT /identity/v3/projects/a0e7bad018d44a25a09056e27ff3a71e/users/5ff48c42f74046d19a9b477d17b4bc85/roles/2957da46bdca4442b4d92873884c61a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:41.558298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:41.628136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05cdb9c60e64a5fb3c9733c4484ee7f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:41.630817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05cdb9c60e64a5fb3c9733c4484ee7f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:41.701144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eabbf5-2a28-44fd-9bfb-92737d12fd56 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:41.711419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:41.717772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.718540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.718540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/024d651c76d94cd49663c1727b54e255/users/5ff48c42f74046d19a9b477d17b4bc85/roles/2957da46bdca4442b4d92873884c61a2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.721443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:create_grant(project_id=024d651c76d94cd49663c1727b54e255, user_id=5ff48c42f74046d19a9b477d17b4bc85, role_id=2957da46bdca4442b4d92873884c61a2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:41.724430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538acd3-8cfe-4fd8-a29f-4581e9ec0ef7 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:41.780861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05cdb9c60e64a5fb3c9733c4484ee7f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:41.804130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05cdb9c60e64a5fb3c9733c4484ee7f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:41.804130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9f1bc931-7736-4394-abec-91976bc4dde4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05cdb9c60e64a5fb3c9733c4484ee7f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:41.838108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:41.848639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2844/5701] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:41 2022] DELETE /identity/v3/users/a05cdb9c60e64a5fb3c9733c4484ee7f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:41.853168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.853867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.854498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.867293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2858/5702] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:41 2022] PUT /identity/v3/projects/024d651c76d94cd49663c1727b54e255/users/5ff48c42f74046d19a9b477d17b4bc85/roles/2957da46bdca4442b4d92873884c61a2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:41.870480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798db8-bb08-42e3-ba71-7286d732facf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.870807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798db8-bb08-42e3-ba71-7286d732facf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.871244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a798db8-bb08-42e3-ba71-7286d732facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.881565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:41.886182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:41.930439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a798db8-bb08-42e3-ba71-7286d732facf None None] MFA Rules not processed for user `5ff48c42f74046d19a9b477d17b4bc85`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:41.932015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a798db8-bb08-42e3-ba71-7286d732facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:41.941923 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2859/5703] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:41 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:41:41.944099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:41.944387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:41.944670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:41.977609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] MFA Rules not processed for user `5ff48c42f74046d19a9b477d17b4bc85`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:41.979009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.052778 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2845/5704] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:42.089305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:42.095167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.130863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:42.147591 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2860/5705] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 14:41:42.147591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:42.155593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.289601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1216-a2bf-4c77-9daf-11de69ba1270 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:42.298266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:42.299861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:42.301636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:42.302020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:42.328858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:42.330409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca1d2-1471-4629-90a8-1227be4cb8bb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:42.332728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:42.345362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:42.346297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:42.348362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:42.348944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:42.353554 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2861/5706] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:42.354648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:42.355563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.360356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.491534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6b0a-93b2-4093-b5c1-949a33dc1bd6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:42.497027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:42.497648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:42.497942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:42.498246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:42.507486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:42.510061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:42.516647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:42.520537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6e64e-ac4e-4222-91e0-3d2006d48293 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:42.584991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2846/5707] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:41:42.612548 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2862/5708] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Oct 31 14:41:42 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:42.625382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:42.625831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:42.626218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:42.676314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] MFA Rules not processed for user `5ff48c42f74046d19a9b477d17b4bc85`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:42.680107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:42.771789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:42.898191 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2847/5709] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 31 14:41:42.902580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:42.919580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424a16-c6b1-431e-80e4-7f57b406032f tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:42.948695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:42.949328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:42.949328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:42.949613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/roles/2957da46bdca4442b4d92873884c61a2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:42.955826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2957da46bdca4442b4d92873884c61a2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:42.958033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:43.966816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:43.968299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:43.975047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invalidating the token cache because role 2957da46bdca4442b4d92873884c61a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:43.975676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:43.976956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:43.979058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2863/5710] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:42 2022] DELETE /identity/v3/roles/2957da46bdca4442b4d92873884c61a2 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:43.995667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:44.000183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:44.001596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c978ce-4761-46b0-a7c5-bbb166d30acb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:44.120900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:44.126266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:44.126266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:44.126266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] PATH_INFO: `/v3/projects/79ef17441681482b8fb80f68cbf9d530` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:44.126266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ef17441681482b8fb80f68cbf9d530)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:44.128111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:44.179470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:44.229931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0f77-1820-4e88-9fac-56394840b15e tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:44.237346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:44.249310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:44.249966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:44.260228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/024d651c76d94cd49663c1727b54e255` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:44.269084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_project(project_id=024d651c76d94cd49663c1727b54e255)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:44.269084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:44.294138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ef17441681482b8fb80f68cbf9d530', 'request_id': 'req-64451349-0035-48b3-9473-cedb51a59e9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.389248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ef17441681482b8fb80f68cbf9d530', 'request_id': 'req-64451349-0035-48b3-9473-cedb51a59e9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.398252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ef17441681482b8fb80f68cbf9d530', 'request_id': 'req-64451349-0035-48b3-9473-cedb51a59e9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.425467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] The token cache is being invalidate because project 79ef17441681482b8fb80f68cbf9d530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:44.426186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.435701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.440224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2848/5711] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:43 2022] DELETE /identity/v3/projects/79ef17441681482b8fb80f68cbf9d530 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:44.442856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:44.449695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:44.553434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024d651c76d94cd49663c1727b54e255', 'request_id': 'req-77551aee-a970-42dc-9fa3-199aba743ae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.608204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:44.658809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451349-0035-48b3-9473-cedb51a59e9f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:44.678116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024d651c76d94cd49663c1727b54e255', 'request_id': 'req-77551aee-a970-42dc-9fa3-199aba743ae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.687096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024d651c76d94cd49663c1727b54e255', 'request_id': 'req-77551aee-a970-42dc-9fa3-199aba743ae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.734777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project 024d651c76d94cd49663c1727b54e255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:44.734777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.737345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:44.740373 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2864/5712] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:43 2022] DELETE /identity/v3/projects/024d651c76d94cd49663c1727b54e255 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:44.741416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:44.743742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:44.781731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:44.785708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:44.786017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:44.786324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:44.794283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:44.827199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:44.828853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:44.862115 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2849/5713] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:44.864312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:44.868145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:44.896337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551aee-a970-42dc-9fa3-199aba743ae3 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:44.911403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:44.912276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:44.912701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:44.913285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] PATH_INFO: `/v3/users/578ab638ce9a45f68f520997e7641b45` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:44.915331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578ab638ce9a45f68f520997e7641b45)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:44.919330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:45.061872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0da6-0f54-4d39-96eb-bcef65906e24 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:45.069081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:45.071548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:45.071548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:45.071548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/024d651c76d94cd49663c1727b54e255` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:45.078304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_project(project_id=024d651c76d94cd49663c1727b54e255)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:45.080314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Could not find project: 024d651c76d94cd49663c1727b54e255.: keystone.exception.ProjectNotFound: Could not find project: 024d651c76d94cd49663c1727b54e255. Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 31 14:41:45.093402 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 024d651c76d94cd49663c1727b54e255. Oct 31 14:41:45.094669 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:45.101010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2850/5714] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:44 2022] DELETE /identity/v3/projects/024d651c76d94cd49663c1727b54e255 => generated 113 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:45.101010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:45.101010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:45.112749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ac6ad-a258-4256-8acf-52dd5f35d3bd tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:45.120193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:45.120424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:45.120684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:45.121007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] PATH_INFO: `/v3/users/6408ad6468c84b9f8f7d6f98e26415c6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:45.122790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6408ad6468c84b9f8f7d6f98e26415c6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:45.125028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:45.236958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578ab638ce9a45f68f520997e7641b45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.238002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578ab638ce9a45f68f520997e7641b45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.314819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578ab638ce9a45f68f520997e7641b45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.332311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578ab638ce9a45f68f520997e7641b45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.333108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578ab638ce9a45f68f520997e7641b45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.347897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2865/5715] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:44 2022] DELETE /identity/v3/users/578ab638ce9a45f68f520997e7641b45 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:45.349173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:45.350823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:45.369241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6408ad6468c84b9f8f7d6f98e26415c6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.377114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6408ad6468c84b9f8f7d6f98e26415c6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.452384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e68d9-8c5d-4733-9ddb-e19c183209d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:45.458190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:45.459334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:45.459496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6408ad6468c84b9f8f7d6f98e26415c6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.459939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:45.460397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/projects/a0e7bad018d44a25a09056e27ff3a71e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:45.462121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0e7bad018d44a25a09056e27ff3a71e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:45.467359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:45.479711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6408ad6468c84b9f8f7d6f98e26415c6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.481323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6408ad6468c84b9f8f7d6f98e26415c6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.507163 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2851/5716] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:45 2022] DELETE /identity/v3/users/6408ad6468c84b9f8f7d6f98e26415c6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:45.602815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e7bad018d44a25a09056e27ff3a71e', 'request_id': 'req-5d416d60-676f-4fc9-ba12-091a8a73ca01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.691893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e7bad018d44a25a09056e27ff3a71e', 'request_id': 'req-5d416d60-676f-4fc9-ba12-091a8a73ca01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.699817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e7bad018d44a25a09056e27ff3a71e', 'request_id': 'req-5d416d60-676f-4fc9-ba12-091a8a73ca01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.723953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] The token cache is being invalidate because project a0e7bad018d44a25a09056e27ff3a71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:45.723953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.725959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:45.727780 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2866/5717] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:45 2022] DELETE /identity/v3/projects/a0e7bad018d44a25a09056e27ff3a71e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:45.732127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:45.733774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:45.813042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b322-29c9-425a-b758-34a60182e53d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:45.829619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:45.874826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:45.875461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:45.875769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:45.876063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/users/5ff48c42f74046d19a9b477d17b4bc85` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:45.877251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ff48c42f74046d19a9b477d17b4bc85)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:45.879846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:45.888535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:45.890285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:45.994381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d416d60-676f-4fc9-ba12-091a8a73ca01 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:45.999886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.000867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.001232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.001372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] PATH_INFO: `/v3/projects/4b2e8cbc96a14f9ebf4525e011ee88fa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.003187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2e8cbc96a14f9ebf4525e011ee88fa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.014219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.083180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff48c42f74046d19a9b477d17b4bc85'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.084161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff48c42f74046d19a9b477d17b4bc85'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.183398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff48c42f74046d19a9b477d17b4bc85'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.202959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff48c42f74046d19a9b477d17b4bc85'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.203874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff48c42f74046d19a9b477d17b4bc85'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.216777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e8cbc96a14f9ebf4525e011ee88fa', 'request_id': 'req-af3ca109-40d0-4663-8d48-eb5c21cd91a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.221379 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2852/5718] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:45 2022] DELETE /identity/v3/users/5ff48c42f74046d19a9b477d17b4bc85 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:46.224004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.227555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.241037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:46.314595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e8cbc96a14f9ebf4525e011ee88fa', 'request_id': 'req-af3ca109-40d0-4663-8d48-eb5c21cd91a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.323280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e8cbc96a14f9ebf4525e011ee88fa', 'request_id': 'req-af3ca109-40d0-4663-8d48-eb5c21cd91a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.347226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408b53-a903-4fbe-9944-71f6c6c5b7eb tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.354835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.355748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.356267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.356765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] PATH_INFO: `/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.358792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9518d655ac8f4cc1a993f682e7a5af9a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.360923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] The token cache is being invalidate because project 4b2e8cbc96a14f9ebf4525e011ee88fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:46.361335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.362526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.363445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.366314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2867/5719] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:45 2022] DELETE /identity/v3/projects/4b2e8cbc96a14f9ebf4525e011ee88fa => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:46.367318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.369002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.449560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca109-40d0-4663-8d48-eb5c21cd91a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.496233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9518d655ac8f4cc1a993f682e7a5af9a', 'request_id': 'req-d59b1766-1493-4557-8e50-f6dbd1fb04dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.525503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.526143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.526425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.526742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/906bd7c6bbcc4c3097be71949fb37e58` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.533809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b3e3e839-71ad-4ea8-b2a7-f8df28c382f1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Could not find domain: 906bd7c6bbcc4c3097be71949fb37e58.: keystone.exception.DomainNotFound: Could not find domain: 906bd7c6bbcc4c3097be71949fb37e58. Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 906bd7c6bbcc4c3097be71949fb37e58. Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:46.538914 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:46.540322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 906bd7c6bbcc4c3097be71949fb37e58. Oct 31 14:41:46.541576 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.542973 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2868/5720] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:46 2022] PATCH /identity/v3/domains/906bd7c6bbcc4c3097be71949fb37e58 => generated 112 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:46.542973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d07f-dea3-4940-8b7b-9b67b95208c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.542973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d07f-dea3-4940-8b7b-9b67b95208c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.542973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49d07f-dea3-4940-8b7b-9b67b95208c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.562182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc49d07f-dea3-4940-8b7b-9b67b95208c5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:46.563442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc49d07f-dea3-4940-8b7b-9b67b95208c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.586185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9518d655ac8f4cc1a993f682e7a5af9a', 'request_id': 'req-d59b1766-1493-4557-8e50-f6dbd1fb04dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.593426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9518d655ac8f4cc1a993f682e7a5af9a', 'request_id': 'req-d59b1766-1493-4557-8e50-f6dbd1fb04dc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.605301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] The token cache is being invalidate because project 9518d655ac8f4cc1a993f682e7a5af9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:46.612320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.612320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:46.612320 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2853/5721] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:46 2022] DELETE /identity/v3/projects/9518d655ac8f4cc1a993f682e7a5af9a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:46.612320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.612320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.648478 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2869/5722] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:46.650154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c153-d1b4-4923-a2d6-b270efd9e9cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.650770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c153-d1b4-4923-a2d6-b270efd9e9cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.655809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c153-d1b4-4923-a2d6-b270efd9e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.679529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6d07c153-d1b4-4923-a2d6-b270efd9e9cb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:46.684415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d07c153-d1b4-4923-a2d6-b270efd9e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.684542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b1766-1493-4557-8e50-f6dbd1fb04dc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.687407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.688049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.688330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.688721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.700753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2870/5723] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:46.700753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.701486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.702691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:46.708590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-33ac59c9-4d58-49a0-b4f0-85867c1cdb03 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Could not find domain: 46c3c492ff6a4201a7ce9746c760c6bc.: keystone.exception.DomainNotFound: Could not find domain: 46c3c492ff6a4201a7ce9746c760c6bc. Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 46c3c492ff6a4201a7ce9746c760c6bc. Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:46.710050 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:46.711386 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 46c3c492ff6a4201a7ce9746c760c6bc. Oct 31 14:41:46.712620 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.714802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2854/5724] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:46 2022] PATCH /identity/v3/domains/46c3c492ff6a4201a7ce9746c760c6bc => generated 112 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:46.716974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.716974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.716974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.741271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:46.743096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.747861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:46.749031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:46.752292 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2855/5725] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:46.753244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.765940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a490e1-c13e-427c-9c5c-5c8998b57e9b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.766155 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2871/5726] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:46.767092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.774572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.775599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.778304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.778304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/9fd9707703ab470caa5070d3d91143b2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.782941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35efda-da66-43a0-8f1e-74bbc4e4634c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.784154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Could not find domain: 9fd9707703ab470caa5070d3d91143b2.: keystone.exception.DomainNotFound: Could not find domain: 9fd9707703ab470caa5070d3d91143b2. Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9fd9707703ab470caa5070d3d91143b2. Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:46.789772 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:46.791256 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9fd9707703ab470caa5070d3d91143b2. Oct 31 14:41:46.792553 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:41:46.794709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2856/5727] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:46 2022] PATCH /identity/v3/domains/9fd9707703ab470caa5070d3d91143b2 => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:46.795622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.795781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.797014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.797309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.797704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.798411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:46.800178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.803227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.812399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d960-d6a8-4eee-829f-2eb321753154 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.818048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.818940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.822738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.822738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.822738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:46.822738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.822738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.823760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2872/5728] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:46.825169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.839047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee5e0-f37a-40de-a195-d595ed385d6c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.840059 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2857/5729] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:46.841040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.847730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0c32724381417bab21fdc949bb9d4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.848673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.849119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.849603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] PATH_INFO: `/v3/domains/a71c63275b974f8cb5d85059782db925` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.854127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb06e8-bd4b-4ae1-8f23-5c79db57725c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.858342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:41:46.860239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.861019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.861399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.861730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.862422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.865346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Could not find domain: a71c63275b974f8cb5d85059782db925.: keystone.exception.DomainNotFound: Could not find domain: a71c63275b974f8cb5d85059782db925. Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a71c63275b974f8cb5d85059782db925. Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:41:46.866551 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:41:46.867973 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a71c63275b974f8cb5d85059782db925. Oct 31 14:41:46.869290 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:41:46.872349 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2873/5730] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:41:46 2022] PATCH /identity/v3/domains/a71c63275b974f8cb5d85059782db925 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:41:46.873334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.887291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09618-f45d-4825-af43-478147e5f5d1 tempest-TokensV3TestJSON-1687142087 tempest-TokensV3TestJSON-1687142087-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:46.894960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:46.895732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:46.896307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:46.896592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:46.897501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:46.899706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:46.983849 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2858/5731] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:46.984860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:46.987262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.014538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2874/5732] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:46 2022] POST /identity/v3/projects => generated 395 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:47.015724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.072438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b66f8-61c1-44ed-bb43-e5475090a45c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.093802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9109de7-4eff-4604-af52-f363ce101701 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.099588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.100290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.100569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.100838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.101487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.103760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.135207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.135966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.136246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.136518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] PATH_INFO: `/v3/users/dfad0c5f1ce946fab644d2c900cca455` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.137661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfad0c5f1ce946fab644d2c900cca455)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.139690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.242077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2875/5733] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:47 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:47.242077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.249831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cc9-dbe8-4964-8132-cda9fc3ae054 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.255140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.256094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.256405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.257065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.258325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.260502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.264188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:47.379997 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2876/5734] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:47 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:47.379997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.397865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfad0c5f1ce946fab644d2c900cca455'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:47.402030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfad0c5f1ce946fab644d2c900cca455'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:47.409481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5d56-5694-4bd2-9ecc-37adc0027867 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.416716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.417510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.418275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.418786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.419510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.422012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.440306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2877/5735] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:47.441182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.447679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.463567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1a86-1897-455c-a52a-6408edde29e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.469750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.470382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.470693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.470965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.471596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.473518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.485367 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2878/5736] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:47.486413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.493474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.494234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfad0c5f1ce946fab644d2c900cca455'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:47.497051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:47.507908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd215a-74c1-44c7-9391-7b6f2ebf11e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.509457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfad0c5f1ce946fab644d2c900cca455'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:47.510245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfad0c5f1ce946fab644d2c900cca455'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:47.513554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.514391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.514926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.515527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.516352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.518587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff84a3-e89c-4207-b36d-96a4816d9b80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.524605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2859/5737] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:46 2022] DELETE /identity/v3/users/dfad0c5f1ce946fab644d2c900cca455 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:47.525538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.533381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2879/5738] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:47.535097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.535798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.537573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.564190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:47.565388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.633456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d48390-6a03-47c2-a789-cce798197950 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.641748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.642885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.643176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.643605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.644436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.646745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.658668 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2880/5739] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:47.663664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.667867 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2860/5740] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:47.669161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.679853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f994e4a-d27e-49c9-b473-32d561326742 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.681579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651e33-77f2-426a-a17c-61f3851ba124 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.685475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.686593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.686593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.686858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] PATH_INFO: `/v3/projects/b9a7e83286cc4dd49ea94a79b85c0ffd/users/7b765bef9fc541b1bc65212ca6f05f79/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.689731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.691889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.692826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.694076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] PATH_INFO: `/v3/projects/4097d9e16c8d481e951d47a79c0f685f/users/787c6c3a8fd442768f77735c4beff9f5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.713007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a7e83286cc4dd49ea94a79b85c0ffd, user_id=7b765bef9fc541b1bc65212ca6f05f79, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.715869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.725954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4097d9e16c8d481e951d47a79c0f685f, user_id=787c6c3a8fd442768f77735c4beff9f5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:47.730331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a11ad-f10b-491a-8b8c-d6c7224ec323 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:47.812792 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2861/5741] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:47 2022] PUT /identity/v3/projects/b9a7e83286cc4dd49ea94a79b85c0ffd/users/7b765bef9fc541b1bc65212ca6f05f79/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:47.814018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:47.815628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.845208 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2881/5742] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:47 2022] PUT /identity/v3/projects/4097d9e16c8d481e951d47a79c0f685f/users/787c6c3a8fd442768f77735c4beff9f5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:47.852535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2568-7f03-4c61-bfd7-99b5f3de3377 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.853038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2568-7f03-4c61-bfd7-99b5f3de3377 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.853771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2568-7f03-4c61-bfd7-99b5f3de3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.881371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-774f2568-7f03-4c61-bfd7-99b5f3de3377 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:47.890949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-774f2568-7f03-4c61-bfd7-99b5f3de3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:47.891056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ef5c-1670-414b-8400-f86c94860340 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:47.949731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:47.950344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.950648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.950917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:47.968186 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2882/5743] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:47.977531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:47.978156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:47.978738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:48.005895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:48.007525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:48.016912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2883/5744] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:48.018087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:48.033858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:48.033858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:48.037841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:48.050750 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2862/5745] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:48.050750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:48.056075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22b8a2-4bd6-44af-9267-46a29b741899 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:48.060477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:48.061241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:48.061372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42baa0-e919-482b-ba62-3938c1d098a0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:48.061639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:48.062022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:48.066972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:48.068604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:48.073591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:48.073591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:48.073861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:48.074569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:48.076261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:48.083169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:48.084803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:48.087696 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2863/5746] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:48.098503 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2884/5747] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:48.795025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:48.798582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:48.821881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b3d94-07c9-49ba-843e-b971b2e9cb39 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:48.834655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:48.835313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:48.835593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:48.835864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] PATH_INFO: `/v3/projects/51d04518447a40d6ac6c1f364da0f38b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:48.842019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d04518447a40d6ac6c1f364da0f38b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:48.844029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:48.908995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:49.021617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:49.043748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d04518447a40d6ac6c1f364da0f38b', 'request_id': 'req-f13be129-3ebf-4007-acb9-a8213ca3a1ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.156334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d04518447a40d6ac6c1f364da0f38b', 'request_id': 'req-f13be129-3ebf-4007-acb9-a8213ca3a1ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.179092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d04518447a40d6ac6c1f364da0f38b', 'request_id': 'req-f13be129-3ebf-4007-acb9-a8213ca3a1ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.204948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] The token cache is being invalidate because project 51d04518447a40d6ac6c1f364da0f38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:49.206277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.207613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f13be129-3ebf-4007-acb9-a8213ca3a1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.209829 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2864/5748] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:48 2022] DELETE /identity/v3/projects/51d04518447a40d6ac6c1f364da0f38b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:49.213503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:49.229706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ccf8e-9ffc-4368-9617-dd94cee65e89 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:49.305178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:49.306351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:49.306657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:49.307008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] PATH_INFO: `/v3/users/1d0c32724381417bab21fdc949bb9d4d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:49.312838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0c32724381417bab21fdc949bb9d4d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:49.312838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:49.619101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:49.626531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0c32724381417bab21fdc949bb9d4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.628028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0c32724381417bab21fdc949bb9d4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.835308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0c32724381417bab21fdc949bb9d4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.857858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0c32724381417bab21fdc949bb9d4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.859240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0c32724381417bab21fdc949bb9d4d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:49.881175 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2885/5749] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:49 2022] DELETE /identity/v3/users/1d0c32724381417bab21fdc949bb9d4d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:50.269780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:50.270312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:50.270312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:50.382988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] MFA Rules not processed for user `787c6c3a8fd442768f77735c4beff9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:50.386609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:50.536661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:50.588923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2865/5750] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:50.589640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:50.591237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:50.631441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:50.633645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:50.730118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89086a7-c5bf-43d2-8565-3b8139294353 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:50.747334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:50.747959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:50.748455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:50.748921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:50.750503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:50.752799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:50.818510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bef07-9020-4a9d-8e9d-8096a9397562 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:50.829791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:50.830683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:50.831160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:50.831656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] PATH_INFO: `/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:50.833601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5dd0fad0d434c6fbc2cba6763a79dda)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:50.840023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:50.866712 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2886/5751] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:50 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:50.885842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.007930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'request_id': 'req-aad2a4fb-937e-4879-b717-65720e18924f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.017905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923d70b-a4bc-4238-b16d-8674cdbf7184 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.073648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'request_id': 'req-aad2a4fb-937e-4879-b717-65720e18924f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.084964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5dd0fad0d434c6fbc2cba6763a79dda', 'request_id': 'req-aad2a4fb-937e-4879-b717-65720e18924f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.101355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] The token cache is being invalidate because project a5dd0fad0d434c6fbc2cba6763a79dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:51.102189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.109931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.116337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2866/5752] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:50 2022] DELETE /identity/v3/projects/a5dd0fad0d434c6fbc2cba6763a79dda => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:41:51.121374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.126763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:51.168035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.169745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.170831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.171358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.172223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.174867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.282479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:51.285671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a4fb-937e-4879-b717-65720e18924f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.292711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2887/5753] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:50 2022] POST /identity/v3/users => generated 293 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:51.292950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.293128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.293430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.293713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] PATH_INFO: `/v3/users/a1e59f866fbb46d99f76fb439167ce23` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.294174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.295163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e59f866fbb46d99f76fb439167ce23)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.296112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:51.297364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.318822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d4330-468c-4f83-bf69-397fbf673906 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.329600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.330223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.332746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.333184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.333854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.339779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.383619 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2888/5754] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:51.387107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.402414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ef7e-b079-4045-a72f-c52ef4578c53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.412576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.413616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.413901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.414176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] PATH_INFO: `/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4/users/fdafd1823228468181c2b658c4d02f0f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.440345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c08b5982d44ad5a4ceb9c18f7e64d4, user_id=fdafd1823228468181c2b658c4d02f0f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.443893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.599163 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2889/5755] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:51 2022] PUT /identity/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4/users/fdafd1823228468181c2b658c4d02f0f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:51.601873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.607249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.608861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.618158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:51.724545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.727023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb711d3-912d-4653-ba9b-2c530c3ed905 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.739692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.743906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e59f866fbb46d99f76fb439167ce23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:51.753062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.754401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.756388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.756687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.761352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.763655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.787381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2867/5756] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:51 2022] DELETE /identity/v3/users/a1e59f866fbb46d99f76fb439167ce23 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:51.809327 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2890/5757] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:51.813150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:51.815183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:51.931187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606bff8-e6bd-48a1-9936-bbe733e5dc9a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:51.947486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:51.949428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:51.951951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:51.952470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] PATH_INFO: `/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4/users/fdafd1823228468181c2b658c4d02f0f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:51.960441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c08b5982d44ad5a4ceb9c18f7e64d4, user_id=fdafd1823228468181c2b658c4d02f0f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:51.969710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41baa-9faa-44bd-b973-3bfe38264be4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:51.997481 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2868/5758] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:51 2022] PUT /identity/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4/users/fdafd1823228468181c2b658c4d02f0f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:53.015489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:53.020621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:53.103270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb04a9-9368-4741-8d6b-7b08151ccb8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:53.220170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:53.353877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:53.363921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:53.364362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:53.365274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] PATH_INFO: `/v3/projects/a1524ab5307a4bd982ec6cbc89107cff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:53.367163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1524ab5307a4bd982ec6cbc89107cff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:53.370372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:53.578564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:53.585519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1524ab5307a4bd982ec6cbc89107cff', 'request_id': 'req-b63e61e9-222b-447c-b5a9-148d3502f2e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:53.703315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1524ab5307a4bd982ec6cbc89107cff', 'request_id': 'req-b63e61e9-222b-447c-b5a9-148d3502f2e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:53.710086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1524ab5307a4bd982ec6cbc89107cff', 'request_id': 'req-b63e61e9-222b-447c-b5a9-148d3502f2e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:53.755520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] The token cache is being invalidate because project a1524ab5307a4bd982ec6cbc89107cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:53.755819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:53.763144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b63e61e9-222b-447c-b5a9-148d3502f2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:53.769612 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2891/5759] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:53 2022] DELETE /identity/v3/projects/a1524ab5307a4bd982ec6cbc89107cff => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:53.775190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:53.775803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:53.776390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:53.811382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:53.813083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:53.904267 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2869/5760] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:53.913794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:53.914195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:53.916727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:53.962144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:53.963948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:53.975450 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2892/5761] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:53.979668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:53.996172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151378a-363a-4b67-b980-ffdcf655d39e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.005307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.006519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.006951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.007478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.008358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:54.008788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.011578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.026961 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2870/5762] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:54.031912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:54.043592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892af5-79f4-4563-9e14-29168baad3fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.054803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.055592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.056840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.057173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.058505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.060542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.174122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2893/5763] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:54 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:54.179684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:54.212434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd449de-5d5d-428e-a711-f4716842dfb8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.336200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.336891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.337001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.337766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.338883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.341584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.527038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2871/5764] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:54 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:54.530403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:54.558836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d913b-e3b6-4c4c-b148-3bb7580a13b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.569179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.575219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.575219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.575219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.576622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.579199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.594511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2894/5765] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:54.599523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:54.610748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7b41-8ff7-4e75-aeba-1327a9dca33e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.617948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.617948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.618383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.618507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.619243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.621142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652bf6a-abf7-4272-a5f1-dc256fef1136 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.650230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2872/5766] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:54.661297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:54.674738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227055c2-e0f5-4d3a-bc1f-b70e04c28773 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:54.683256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:54.684396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.689964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.689964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] PATH_INFO: `/v3/projects/ea16740e1f1a4b8292aaa8897ccbd090/users/b0460572dfe542469ce6d62c3bf47826/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.696027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b281916-d1a6-4da9-a2c0-05a7f32f9af5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.697260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b281916-d1a6-4da9-a2c0-05a7f32f9af5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.697777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b281916-d1a6-4da9-a2c0-05a7f32f9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:54.713107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:54.755956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea16740e1f1a4b8292aaa8897ccbd090, user_id=b0460572dfe542469ce6d62c3bf47826, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:54.762757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57729aac-6d01-4240-81e4-433499f0c7be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:54.782089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5b281916-d1a6-4da9-a2c0-05a7f32f9af5 None None] MFA Rules not processed for user `fdafd1823228468181c2b658c4d02f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:54.784478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5b281916-d1a6-4da9-a2c0-05a7f32f9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:54.879264 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2895/5767] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:54 2022] PUT /identity/v3/projects/ea16740e1f1a4b8292aaa8897ccbd090/users/b0460572dfe542469ce6d62c3bf47826/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:54.889858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:54.890339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:54.890873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.011494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] MFA Rules not processed for user `b0460572dfe542469ce6d62c3bf47826`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:55.014451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:55.057007 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2873/5768] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:55.067440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:55.067852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:55.070661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.136365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] MFA Rules not processed for user `787c6c3a8fd442768f77735c4beff9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:55.143141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:55.223476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2896/5769] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:55.228749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:55.259340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c337ef3-92cd-4904-a855-0b380499209d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:55.267325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0460572dfe542469ce6d62c3bf47826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea16740e1f1a4b8292aaa8897ccbd090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:55.268381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:55.268875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:55.269354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.270174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:55.271615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:55.278041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2897/5770] 10.222.0.13 () {58 vars in 1143 bytes} [Mon Oct 31 14:41:55 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:55.282957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:55.307575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2874/5771] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:55.321710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:55.327698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:55.408470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:55.420913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893bd4-fe14-40e9-8af3-04dbb1aaeeaa tempest-IdentityCatalogTest-1801255770 tempest-IdentityCatalogTest-1801255770-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:55.435520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:55.436503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:55.436973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:55.437419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] PATH_INFO: `/v3/users/b0460572dfe542469ce6d62c3bf47826` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.443241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0460572dfe542469ce6d62c3bf47826)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:55.449669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:55.577028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3431f3c-0229-4fd3-a3da-c2a04ea4e14c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:55.591549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:55.596433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:55.596433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:55.596433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.601931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:55.629242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:55.630923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:55.662177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2875/5772] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:55.666005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:55.666005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:55.697592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a12a-af3b-4de4-b68d-57a2fe36b237 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:55.703176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:55.703830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:55.707509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:55.707509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] PATH_INFO: `/v3/users/20eab75e6e144c5fbe14685738b5dee3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:55.707509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20eab75e6e144c5fbe14685738b5dee3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:55.708196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:55.735819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:55.762342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0460572dfe542469ce6d62c3bf47826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:55.773204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0460572dfe542469ce6d62c3bf47826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:55.925031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0460572dfe542469ce6d62c3bf47826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:55.965596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0460572dfe542469ce6d62c3bf47826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:55.967083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51ede17b-ac2d-44a7-ae0d-fded3cd1cf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0460572dfe542469ce6d62c3bf47826'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.002014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2898/5773] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:55 2022] DELETE /identity/v3/users/b0460572dfe542469ce6d62c3bf47826 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:56.015753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:56.024009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:56.027889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:56.048228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20eab75e6e144c5fbe14685738b5dee3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.051224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20eab75e6e144c5fbe14685738b5dee3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.060149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:56.061462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:56.136212 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2899/5774] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:56.137841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20eab75e6e144c5fbe14685738b5dee3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.147708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:56.148325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:56.185845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20eab75e6e144c5fbe14685738b5dee3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.186608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9da5d7ee-7c8e-4a24-8800-8d45dfa80b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20eab75e6e144c5fbe14685738b5dee3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:56.210972 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2876/5775] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:55 2022] DELETE /identity/v3/users/20eab75e6e144c5fbe14685738b5dee3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:56.216151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:56.216442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:56.216726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:56.254190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:56.255607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:56.261562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dca0a-5611-43d1-930b-1c2e94e8a2ad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:56.332411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:56.333106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:56.333393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:56.334509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:56.337789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2877/5776] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:56.348687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:56.356503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:56.363547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:56.371173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43dbb-ec94-4a55-9cd7-0ce550469f3f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:56.381018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:56.381648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:56.384467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:56.384467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:56.384783 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2900/5777] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:56.394989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:56.397720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:56.413870 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2878/5778] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:41:56.734757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:57.215237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:57.217294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:57.239093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708430-bf1f-4ff7-86ab-4cf61388552e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:57.254842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:57.255760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:57.256607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:57.256607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] PATH_INFO: `/v3/projects/ea16740e1f1a4b8292aaa8897ccbd090` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:57.258392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea16740e1f1a4b8292aaa8897ccbd090)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:57.260454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:57.459683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:57.461536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:57.475763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea16740e1f1a4b8292aaa8897ccbd090', 'request_id': 'req-b694d9b9-b83e-4de4-b870-86463067b274'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.497621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae13be-f209-4b2e-918f-77b145c5e61b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:57.572516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea16740e1f1a4b8292aaa8897ccbd090', 'request_id': 'req-b694d9b9-b83e-4de4-b870-86463067b274'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.584111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea16740e1f1a4b8292aaa8897ccbd090', 'request_id': 'req-b694d9b9-b83e-4de4-b870-86463067b274'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.621590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] The token cache is being invalidate because project ea16740e1f1a4b8292aaa8897ccbd090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:57.622439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.624688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b694d9b9-b83e-4de4-b870-86463067b274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.630153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2901/5779] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:57 2022] DELETE /identity/v3/projects/ea16740e1f1a4b8292aaa8897ccbd090 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:57.636580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97bac-fb3d-40d9-be7e-4db6c71b07ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:57.637266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97bac-fb3d-40d9-be7e-4db6c71b07ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:57.641788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97bac-fb3d-40d9-be7e-4db6c71b07ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:57.655326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:57.657999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:57.658207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:57.658491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] PATH_INFO: `/v3/projects/e76148808051497baa2c3189ad901209` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:57.665035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76148808051497baa2c3189ad901209)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:57.666973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:57.702552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8f97bac-fb3d-40d9-be7e-4db6c71b07ef None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:57.707091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8f97bac-fb3d-40d9-be7e-4db6c71b07ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:57.729609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:57.734331 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2902/5780] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:57.741862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:57.742206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:57.742532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:57.804559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:57.805877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:57.826713 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2903/5781] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:41:57.828671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:57.850253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf97c1-2a67-4839-a381-d73a7ddf53af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:57.875228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76148808051497baa2c3189ad901209', 'request_id': 'req-7010a57d-d6e0-49a4-a72c-4457f1994594'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.947849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:57.948829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:57.949295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:57.949754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:57.950601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:41:57.951106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:57.953334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:57.955974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76148808051497baa2c3189ad901209', 'request_id': 'req-7010a57d-d6e0-49a4-a72c-4457f1994594'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.967047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76148808051497baa2c3189ad901209', 'request_id': 'req-7010a57d-d6e0-49a4-a72c-4457f1994594'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.970186 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2904/5782] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:41:57.974423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:57.993236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ffae-46af-4eef-bcd6-4d9c850cd5da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:57.993731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] The token cache is being invalidate because project e76148808051497baa2c3189ad901209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:57.994298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.995717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:57.998779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2879/5783] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:57 2022] DELETE /identity/v3/projects/e76148808051497baa2c3189ad901209 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:58.002603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.002889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:58.003268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.003654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.003943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.004735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.007032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.010070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:58.045572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a57d-d6e0-49a4-a72c-4457f1994594 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:58.052076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.052800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.053142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.053504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] PATH_INFO: `/v3/users/5cbee58f75884c36af349efe262e45a4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.056462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbee58f75884c36af349efe262e45a4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.065896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.172955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2905/5784] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:41:57 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:58.177338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:58.182109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:58.232376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:58.310376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52ea0-f522-4c4b-8e7f-b2ce80a750b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:58.320240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.321758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.322366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.322796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.323851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.326552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.333505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbee58f75884c36af349efe262e45a4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:58.333505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbee58f75884c36af349efe262e45a4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:58.441781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbee58f75884c36af349efe262e45a4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:58.457383 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2906/5785] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:41:58 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:41:58.458841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:58.462134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:58.462471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbee58f75884c36af349efe262e45a4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:58.466474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbee58f75884c36af349efe262e45a4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:58.485420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec31a2-c83b-456f-8dbc-8fd323cc2172 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:58.507836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.512051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2880/5786] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:41:58 2022] DELETE /identity/v3/users/5cbee58f75884c36af349efe262e45a4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:58.513051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.513051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.513051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.513051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.513051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.534673 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2907/5787] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:58.538863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:58.693517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54f044-e088-44a9-8844-b0295a32948a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:58.704788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.704788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.709307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.709691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.711035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.715270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859ab45-f2fe-42f1-b71b-30598e935c5c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.732913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2881/5788] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:41:58.739839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:58.757983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95f6bd-8150-4817-8620-8314c0aba869 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:58.783156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:58.784296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.784582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.784924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] PATH_INFO: `/v3/projects/3b161576d9fc48f1bd5ecf992b760489/users/74520fca384c45fe827203b87f1e68d6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.824885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b161576d9fc48f1bd5ecf992b760489, user_id=74520fca384c45fe827203b87f1e68d6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:58.827869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:58.929172 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2908/5789] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:41:58 2022] PUT /identity/v3/projects/3b161576d9fc48f1bd5ecf992b760489/users/74520fca384c45fe827203b87f1e68d6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:58.940489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:58.941123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:58.942928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:58.998422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] MFA Rules not processed for user `74520fca384c45fe827203b87f1e68d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:58.999792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:59.010900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:59.044226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.052973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:59.157833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2882/5790] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:41:59.158700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.181583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a499a-3d90-4c47-abc6-c88aa4752d62 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.197733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.198448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.198855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.199167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.199817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:59.201347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:59.257265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb821ce1-845d-4e11-a7e7-ab58b54a01d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.265904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.268574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.271275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.271837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] PATH_INFO: `/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.286912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbe85d163cd495fbf6325f410ccf9f9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:59.292567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:59.321808 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2883/5791] 10.222.0.13 () {60 vars in 1299 bytes} [Mon Oct 31 14:41:59 2022] POST /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:59.326266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.338192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836680d3-0319-46df-9945-2da17e9c93b3 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.344925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.345916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.348355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.348355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/e212e0d697c2418581f0bb62985c2c67` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.359404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=e212e0d697c2418581f0bb62985c2c67)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:59.361761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:59.507339 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2884/5792] 10.222.0.13 () {58 vars in 1380 bytes} [Mon Oct 31 14:41:59 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/e212e0d697c2418581f0bb62985c2c67 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:59.524125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.549164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3539df-2ea0-45b7-a4de-4af7349099a6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.555442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbe85d163cd495fbf6325f410ccf9f9', 'request_id': 'req-f38fffdc-a46c-4e34-9274-c370564fccb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:59.635199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.636210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.636571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.636914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.637608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:59.639291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:59.679308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbe85d163cd495fbf6325f410ccf9f9', 'request_id': 'req-f38fffdc-a46c-4e34-9274-c370564fccb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:59.698035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbe85d163cd495fbf6325f410ccf9f9', 'request_id': 'req-f38fffdc-a46c-4e34-9274-c370564fccb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:59.720048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:41:59.723271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] The token cache is being invalidate because project 1fbe85d163cd495fbf6325f410ccf9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:41:59.725300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:59.728705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f38fffdc-a46c-4e34-9274-c370564fccb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:41:59.735282 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2909/5793] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:41:59 2022] DELETE /identity/v3/projects/1fbe85d163cd495fbf6325f410ccf9f9 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:59.740177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4805-c9af-4cfe-ad63-6ed6b18db8c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.740538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4805-c9af-4cfe-ad63-6ed6b18db8c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.740893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4805-c9af-4cfe-ad63-6ed6b18db8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.743743 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2885/5794] 10.222.0.13 () {60 vars in 1299 bytes} [Mon Oct 31 14:41:59 2022] POST /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:41:59.745780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.748964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:59.765811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0881-336c-4e3d-82c4-4a3d5825ae1d tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.776208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.777559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.777559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.777559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/fe9b62573e764f16ad1bfff41349e093` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.781189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=fe9b62573e764f16ad1bfff41349e093)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:41:59.784641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:41:59.822190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-459c4805-c9af-4cfe-ad63-6ed6b18db8c7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:41:59.823494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-459c4805-c9af-4cfe-ad63-6ed6b18db8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:41:59.902639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2886/5795] 10.222.0.13 () {58 vars in 1380 bytes} [Mon Oct 31 14:41:59 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/fe9b62573e764f16ad1bfff41349e093 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:41:59.905834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:41:59.963422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec0993-acce-48b7-a90f-f5bf52f641f7 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:41:59.978802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:41:59.982508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:41:59.982979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:41:59.985574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/fe9b62573e764f16ad1bfff41349e093` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:41:59.999864 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2910/5796] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:00.001291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.001581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.002037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.036018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:00.037350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:00.051022 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2911/5797] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Could not find credential: 3903e62498917b318352fc9d9b1b5086bb193273b4736fd0f271a30c4f514749.: keystone.exception.CredentialNotFound: Could not find credential: 3903e62498917b318352fc9d9b1b5086bb193273b4736fd0f271a30c4f514749. Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 31 14:42:00.051261 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:42:00.052276 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 3903e62498917b318352fc9d9b1b5086bb193273b4736fd0f271a30c4f514749. Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:42:00.053513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2887/5798] 10.222.0.13 () {58 vars in 1377 bytes} [Mon Oct 31 14:41:59 2022] GET /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/fe9b62573e764f16ad1bfff41349e093 => generated 148 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:42:00.055896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.056311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.068728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ccf19-8874-4ee7-b194-b449ea6cfdc3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.069095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319274-d1a4-4a52-b3fa-b4bec3a48936 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.077418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.078046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.079002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.079648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.079931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.080207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.080829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.082934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.083234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.083908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:00.084216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.085899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.087066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.113009 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2912/5799] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:00.115063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.129399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7db42-181c-4cb3-a744-c5fbd018836b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.135445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.136908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.137296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.137667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.138404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.141749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.225591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2888/5800] 10.222.0.13 () {60 vars in 1299 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:00.229689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.250806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab0edc-f03c-4385-ab8f-6f5b94b4af19 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.259183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.260151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.260151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.262459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.262459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.263131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c1153-3dc0-4fb9-b173-d4b18fd671d4 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.326941 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2913/5801] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:00.330902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.381864 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2889/5802] 10.222.0.13 () {60 vars in 1299 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:00.386390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.388724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.388724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.487181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d27f-c998-4f82-a375-ed48d8c8c852 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.499218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.501793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.501793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.501793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.501793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.510012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1fea2-6d45-4068-86a0-44241bcd3324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.510206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:00.511688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:00.528475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:00.618233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2890/5803] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:00.620040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.663984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2914/5804] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/users => generated 286 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:42:00.665365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.665653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.665927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.708809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:00.710034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:00.741528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2915/5805] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:00.742490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.757842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dfa2-3700-4ac7-8aa4-c4d783d0e3e5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.771461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aad39-cec3-4b0d-938b-14a26adf048b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.781604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.782393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.787954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.787954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.788205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.788311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.788428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.788428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.788428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.788712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.788825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.789700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.803741 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2891/5806] 10.222.0.13 () {58 vars in 1278 bytes} [Mon Oct 31 14:42:00 2022] GET /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 865 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:00.803741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.805985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:00.810268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2916/5807] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:00.811480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.824479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b43c71-c963-4ff8-8557-c1340611ba88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.829803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.831151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.832279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.832759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/8a5d7850a3ef424180cc9b324add17f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.835939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=8a5d7850a3ef424180cc9b324add17f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.838086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.917825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99152b-157a-496f-a97b-3b395d515185 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.925225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.926468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.926818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.927577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.929003 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2917/5808] 10.222.0.13 () {58 vars in 1380 bytes} [Mon Oct 31 14:42:00 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/8a5d7850a3ef424180cc9b324add17f8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:00.932209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.942873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.944962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.960322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788ec1-904b-4d0b-8ba6-d9b0b1ba17e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.962274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2892/5809] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:00.965222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:00.969463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.970477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.971004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.971544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.973289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.975710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.982897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475182b-c96d-4038-8bdd-e3cdaecef9b7 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:00.991210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:00.994952 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2918/5810] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:00.995134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:00.995134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:00.995134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/e207f94feb784da18d8eab7abb8e179e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:00.995801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=e207f94feb784da18d8eab7abb8e179e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:00.997266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:00.998134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.008354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:01.021263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a439-e347-466a-9152-ab7d95434471 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.035573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.052529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.057807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.057924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] PATH_INFO: `/v3/projects/0e0a67c46c23487394aac979b570bba3/users/2f3fbfc7f1424702ace7a18873e0a06b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.087549 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2893/5811] 10.222.0.13 () {58 vars in 1380 bytes} [Mon Oct 31 14:42:00 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/e207f94feb784da18d8eab7abb8e179e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:01.089069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.095185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0a67c46c23487394aac979b570bba3, user_id=2f3fbfc7f1424702ace7a18873e0a06b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.097967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36938e-b361-41d9-b450-84c01a5a539a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.109551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67744e39-1763-4158-ab6b-335233d1693e tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.120416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.120416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.120416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.120812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.120812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.120812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.203573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2894/5812] 10.222.0.13 () {60 vars in 1299 bytes} [Mon Oct 31 14:42:01 2022] POST /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2 => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:01.209540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.211560 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2919/5813] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:00 2022] PUT /identity/v3/projects/0e0a67c46c23487394aac979b570bba3/users/2f3fbfc7f1424702ace7a18873e0a06b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:01.225144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.226199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.226678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.230755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327e19c-6255-48cf-b9a1-88e3dd6978e6 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.257837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:01.274502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] MFA Rules not processed for user `2f3fbfc7f1424702ace7a18873e0a06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:01.276141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:01.372974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.373651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.373935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.374213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/874a3be3f5be4ae9a29dfdfec496510b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.380652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=874a3be3f5be4ae9a29dfdfec496510b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.384006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.388944 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2895/5814] 10.222.0.13 () {58 vars in 1377 bytes} [Mon Oct 31 14:42:01 2022] GET /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/874a3be3f5be4ae9a29dfdfec496510b => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:42:01.393318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.416307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698579-dd43-4290-a0ac-69ba7d8b6073 tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.427268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2920/5815] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:01.428205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74520fca384c45fe827203b87f1e68d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b161576d9fc48f1bd5ecf992b760489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.429265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.430513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.430513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/874a3be3f5be4ae9a29dfdfec496510b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.433009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74520fca384c45fe827203b87f1e68d6, credential_id=874a3be3f5be4ae9a29dfdfec496510b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.436374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.438923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:01.444709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.524993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a76f-4faf-4615-8180-065b7aa90dc8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.531119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.532696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.532983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.533319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.567434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2896/5816] 10.222.0.13 () {58 vars in 1380 bytes} [Mon Oct 31 14:42:01 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6/credentials/OS-EC2/874a3be3f5be4ae9a29dfdfec496510b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:01.574719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:01.582275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:01.598534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.602034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095a4a-6764-4bc9-a17e-af3c3178db1a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.635260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2921/5817] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:01.707938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e58793-4893-4987-ac1a-fd0fdfc488bc tempest-EC2CredentialsTest-147513733 tempest-EC2CredentialsTest-147513733-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:01.713215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:01.713936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.714880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.714880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] PATH_INFO: `/v3/users/74520fca384c45fe827203b87f1e68d6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.716075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74520fca384c45fe827203b87f1e68d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:01.718461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:01.935282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7740-29b6-4061-8878-ac19e3cd5be4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:01.935845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7740-29b6-4061-8878-ac19e3cd5be4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:01.936170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7740-29b6-4061-8878-ac19e3cd5be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:01.992928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74520fca384c45fe827203b87f1e68d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:01.993649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74520fca384c45fe827203b87f1e68d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:01.999115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7abc7740-29b6-4061-8878-ac19e3cd5be4 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:02.000627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7abc7740-29b6-4061-8878-ac19e3cd5be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:02.067743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74520fca384c45fe827203b87f1e68d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:02.088757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74520fca384c45fe827203b87f1e68d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:02.092933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74520fca384c45fe827203b87f1e68d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:02.114557 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2922/5818] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:02.123414 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2897/5819] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:01 2022] DELETE /identity/v3/users/74520fca384c45fe827203b87f1e68d6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:02.137284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:02.137678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:02.137905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:02.154175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:02.155679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:02.223736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:02.251222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:02.270648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:02.317214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:02.317459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4804a23-e632-48f1-912a-54f2923ab656 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:02.330725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:02.330725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:02.331041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:02.331153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:02.483124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:02.484992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2923/5820] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:02.486887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:02.498051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2898/5821] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:42:02.531911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:02.533993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:02.665143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9b449-db66-4bd9-9cbb-42d9718f8b9a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:02.674645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:02.675329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:02.675679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:02.675991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:02.698497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:02.700208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764625e-72b6-4f3b-a8d1-bcee1c9150a8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:02.728611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2924/5822] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:04.579982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:04.581672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:04.614768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995d12-2d4c-45aa-9a3c-64f7579e87bb service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:04.620122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:04.621116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:04.621729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:04.622219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] PATH_INFO: `/v3/projects/3b161576d9fc48f1bd5ecf992b760489` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:04.623773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b161576d9fc48f1bd5ecf992b760489)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:04.626233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:04.796440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b161576d9fc48f1bd5ecf992b760489', 'request_id': 'req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:04.906188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b161576d9fc48f1bd5ecf992b760489', 'request_id': 'req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:04.931645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b161576d9fc48f1bd5ecf992b760489', 'request_id': 'req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:04.973582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] The token cache is being invalidate because project 3b161576d9fc48f1bd5ecf992b760489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:04.973947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:04.975478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:04.997118 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2899/5823] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:04 2022] DELETE /identity/v3/projects/3b161576d9fc48f1bd5ecf992b760489 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:05.003921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11026-4563-4443-8a43-09abc3ecfb41 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.004501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11026-4563-4443-8a43-09abc3ecfb41 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.004501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f11026-4563-4443-8a43-09abc3ecfb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.045198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7f11026-4563-4443-8a43-09abc3ecfb41 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:05.048596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7f11026-4563-4443-8a43-09abc3ecfb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:05.179992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:05.181971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:05.266096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2925/5824] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:05.274572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.275262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.280731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.337720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:05.337720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:05.365031 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2926/5825] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:05.369346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:05.406161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a89fb-78a5-41d2-b4af-b11c035a9d51 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:05.419548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:05.421004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.421643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.422098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.423031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:05.423796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:05.442693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:05.445742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d9fe-0358-46cc-8109-8c8bdb96b9d7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:05.460530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:05.461427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.461775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.462121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.465226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:05.482355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:05.501675 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2927/5826] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:05.505030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:05.527965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fb15-b78c-4009-854d-9d31efeef7ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:05.541503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:05.542237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.542524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.542831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.544158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:05.551833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:05.693591 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2928/5827] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:05 2022] POST /identity/v3/projects => generated 395 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:05.694955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:05.757424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:05.761089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:05.783211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:05.798003 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2900/5828] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:42:05.913925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4a01-9d17-40e6-b081-e54e257843f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:05.927907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:05.928594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:05.928935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:05.929218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:05.931088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:05.933776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:06.054074 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2929/5829] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:05 2022] POST /identity/v3/users => generated 304 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:06.058748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:06.080023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad65b5-f425-40dd-9819-d54f1f6cda19 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:06.110942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:06.111575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:06.111853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:06.112124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:06.113305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:06.132784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:06.181092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2901/5830] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:06.183111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:06.204870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65bb97-67a0-49df-ab7b-8ebd03ad95f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:06.223273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:06.225245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:06.226648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:06.226812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] PATH_INFO: `/v3/projects/6b3d843290ad497ea3624f523bebb034/users/13ceb0ad411041a786f82910638bbf82/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:06.264102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3d843290ad497ea3624f523bebb034, user_id=13ceb0ad411041a786f82910638bbf82, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:06.272973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:06.408064 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2930/5831] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:06 2022] PUT /identity/v3/projects/6b3d843290ad497ea3624f523bebb034/users/13ceb0ad411041a786f82910638bbf82/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:06.412352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:06.457037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd9bb-d706-4f89-a54d-cadb7dd84d8f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:06.718548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:06.719355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:06.719721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:06.719926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:06.725878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:06.731047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8ba9-ab90-4627-9378-bc84fbe07e15 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:06.759470 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2902/5832] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:06.761015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:06.781171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82722dc-8a88-4736-9dd6-689ce23ae947 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:06.801778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:06.813353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:06.813353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:06.813353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] PATH_INFO: `/v3/projects/6b3d843290ad497ea3624f523bebb034/users/13ceb0ad411041a786f82910638bbf82/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:06.821298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3d843290ad497ea3624f523bebb034, user_id=13ceb0ad411041a786f82910638bbf82, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:06.821298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:06.868999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2931/5833] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:06 2022] PUT /identity/v3/projects/6b3d843290ad497ea3624f523bebb034/users/13ceb0ad411041a786f82910638bbf82/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:06.879466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:06.880136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:06.880753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:06.948004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] MFA Rules not processed for user `13ceb0ad411041a786f82910638bbf82`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:06.949234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:07.096293 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2903/5834] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:07.100455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.247649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762df7-fbb8-4e35-9101-0a7bbacca07e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:07.260099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:07.260929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:07.261371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:07.261947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:07.262835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:07.266502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:07.443576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2932/5835] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:07 2022] POST /identity/v3/projects => generated 395 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:07.444528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.449810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:07.457273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add322ab-9463-4e73-9cf5-598d0be6f636 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:07.534823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:07.535219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:07.535598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:07.536533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:07.537346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:07.539430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:07.739423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2904/5836] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:07 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:42:07.742671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.753690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d267-9aad-47d3-b443-80f6844769eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:07.765941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:07.766952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:07.767395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:07.767832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:07.768703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:07.771847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:07.786866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2933/5837] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:07.791003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.809677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fdfa4-8643-4e5b-bee4-803663323994 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:07.816875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:07.817590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:07.817871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:07.818171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:07.818953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:07.820950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:07.833160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.843712 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2905/5838] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:42:07.849004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:07.902838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228cbe-bcb5-4880-ac17-1f646ad9512a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:07.923081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:07.925135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:07.925723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:07.926516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] PATH_INFO: `/v3/projects/c9e8fa6a8e004d80baa1b565ac72f004/users/4f708a3093d548238778391d1f0a1ec4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:07.965902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e8fa6a8e004d80baa1b565ac72f004, user_id=4f708a3093d548238778391d1f0a1ec4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:07.977182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d8e46-707d-4da3-95fb-b91f63f90265 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:07.990652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:08.002837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f347e-d45a-4831-a497-de1f5530562e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:08.010501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:08.011875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:08.012478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:08.013523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:08.016015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:08.068417 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2906/5839] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:07 2022] PUT /identity/v3/projects/c9e8fa6a8e004d80baa1b565ac72f004/users/4f708a3093d548238778391d1f0a1ec4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:08.175764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:08.177937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:08.179592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:08.180076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:08.180763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:08.211639 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2934/5840] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:08.222875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] MFA Rules not processed for user `4f708a3093d548238778391d1f0a1ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:08.226692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:08.341390 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2907/5841] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:08.349137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:08.351272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:08.469243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27560f4e-5a4b-45ab-a5b2-b482c949730b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:08.535674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:08.536591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:08.537108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:08.537609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:08.653887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:08.672433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:08.674516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725d1d2-4456-4d79-86d8-23eb64b02b4f service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:08.704300 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2935/5842] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:10.088533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:10.175975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:10.209413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842a1ae-5131-485a-ad9a-6b91cb982a04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:10.227156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:10.227873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:10.228385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:10.228677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] PATH_INFO: `/v3/users/13ceb0ad411041a786f82910638bbf82` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:10.229946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ceb0ad411041a786f82910638bbf82)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:10.234352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:10.518058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ceb0ad411041a786f82910638bbf82'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:10.518797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ceb0ad411041a786f82910638bbf82'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:10.663748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ceb0ad411041a786f82910638bbf82'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:10.697282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ceb0ad411041a786f82910638bbf82'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:10.697282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ceb0ad411041a786f82910638bbf82'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:10.733847 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2908/5843] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:10 2022] DELETE /identity/v3/users/13ceb0ad411041a786f82910638bbf82 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:10.735650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:10.736160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:10.736253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:10.757202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:10.758441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:10.913209 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2936/5844] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:10.944176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:10.945935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:11.042543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ae37f-276a-4912-83a9-e1f1b20bbfc2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:11.046884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:11.047677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:11.047873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:11.048037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:11.059821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:11.061213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:11.072699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2909/5845] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:13.183966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:13.183966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:13.208308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b40fa-9610-4b5f-975c-5fb23b86b14b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:13.213633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:13.214634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:13.215089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:13.215532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] PATH_INFO: `/v3/projects/6b3d843290ad497ea3624f523bebb034` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:13.217505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3d843290ad497ea3624f523bebb034)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:13.220361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:13.375695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3d843290ad497ea3624f523bebb034', 'request_id': 'req-0c99e1dd-7cfe-499a-a335-854e99097ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.466795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3d843290ad497ea3624f523bebb034', 'request_id': 'req-0c99e1dd-7cfe-499a-a335-854e99097ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.482197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3d843290ad497ea3624f523bebb034', 'request_id': 'req-0c99e1dd-7cfe-499a-a335-854e99097ef9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.514050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] The token cache is being invalidate because project 6b3d843290ad497ea3624f523bebb034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:13.516946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.521094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.523929 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2937/5846] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:13 2022] DELETE /identity/v3/projects/6b3d843290ad497ea3624f523bebb034 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:13.528019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:13.543679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b948-22be-447a-a39a-7d16df5fd097 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:13.654232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:13.654887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:13.655175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:13.655580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] PATH_INFO: `/v3/users/4f708a3093d548238778391d1f0a1ec4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:13.656868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f708a3093d548238778391d1f0a1ec4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:13.659153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:13.678076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:13.874795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f708a3093d548238778391d1f0a1ec4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.875554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f708a3093d548238778391d1f0a1ec4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.947248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f708a3093d548238778391d1f0a1ec4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.970650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f708a3093d548238778391d1f0a1ec4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:13.971420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abfe3717-75f3-4b3e-9a91-977fef338460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f708a3093d548238778391d1f0a1ec4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:14.002932 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2910/5847] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:13 2022] DELETE /identity/v3/users/4f708a3093d548238778391d1f0a1ec4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:15.325410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:15.326970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:15.357203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99e1dd-7cfe-499a-a335-854e99097ef9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:15.548234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:15.549587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:15.550855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:15.552082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] PATH_INFO: `/v3/projects/c9e8fa6a8e004d80baa1b565ac72f004` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:15.553556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e8fa6a8e004d80baa1b565ac72f004)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:15.562731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:15.584127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:15.764333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e8fa6a8e004d80baa1b565ac72f004', 'request_id': 'req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:15.895735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e8fa6a8e004d80baa1b565ac72f004', 'request_id': 'req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:15.902458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e8fa6a8e004d80baa1b565ac72f004', 'request_id': 'req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:15.927875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] The token cache is being invalidate because project c9e8fa6a8e004d80baa1b565ac72f004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:15.928502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:15.929756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a92b6931-3b5c-4f9b-98dc-ebe73e91d91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:15.932795 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2938/5848] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:15 2022] DELETE /identity/v3/projects/c9e8fa6a8e004d80baa1b565ac72f004 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:15.938504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:15.946328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:15.946328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:15.973821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:15.975946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:16.055850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2911/5849] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:16.062964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a353-c476-4552-9512-8b57b6acddba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.063648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a353-c476-4552-9512-8b57b6acddba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.063994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595a353-c476-4552-9512-8b57b6acddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.096451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b595a353-c476-4552-9512-8b57b6acddba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:16.096451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b595a353-c476-4552-9512-8b57b6acddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:16.105454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2939/5850] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:16.109574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.127139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f805e4-5115-4df6-9d34-99690a4e90ee None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.137697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.140993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.141569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.144798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.145792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:16.146276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.148185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.166076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2912/5851] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:16.166735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595a353-c476-4552-9512-8b57b6acddba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.183699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595a353-c476-4552-9512-8b57b6acddba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.189534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.190385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.191546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.191932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.192686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.195160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.318539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.329640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2940/5852] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:16 2022] POST /identity/v3/projects => generated 355 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:42:16.336079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859632f7-20d9-4784-a38f-66346e7c531e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.422914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.424833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.425424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.427026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.441471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.467926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.614979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2913/5853] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:16 2022] POST /identity/v3/users => generated 278 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:42:16.618803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.639698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bad37-36ab-42b0-b94f-e304d08ae43a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.659284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.659997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.660280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.660555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.661212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.663833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.689761 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2941/5854] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:16.694588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.701234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:16.713895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26ccca-d71d-430d-bb93-75e2e42f21d7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.728981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.729941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.730482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.731032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.731908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.734327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7391620-aa4a-4290-9920-489b4d9ce3ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.749134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2914/5855] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:16.753804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:16.765906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968179-e27e-4a0a-8f5c-bf4b2fd9bdde admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:16.770741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:16.772288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.772288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.772288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] PATH_INFO: `/v3/projects/6ec711fffe4c4a50a8b843b330654862/users/f0522bf5d7ce4e58a7349d8e23aae66b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.789579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec711fffe4c4a50a8b843b330654862, user_id=f0522bf5d7ce4e58a7349d8e23aae66b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:16.792399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:16.858893 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2942/5856] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:16 2022] PUT /identity/v3/projects/6ec711fffe4c4a50a8b843b330654862/users/f0522bf5d7ce4e58a7349d8e23aae66b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:16.872014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:16.872325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:16.872716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:16.904962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] MFA Rules not processed for user `f0522bf5d7ce4e58a7349d8e23aae66b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:16.906588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:16.998432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2915/5857] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:17.000794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.081731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024998-e0c4-416b-a723-0d7a6066be75 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.089452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.090085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.090369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.090668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.091340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.094666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.223577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2943/5858] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:16 2022] POST /identity/v3/projects => generated 355 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:17.224937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.238766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12228bb8-fe7f-4a8b-a1cc-2362e6b213ca None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.309852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.310477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.310809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.311100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.311724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.313674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.456914 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2916/5859] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:17 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:17.463656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.485799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9b2c-fe75-4f59-ab76-46f2d814c426 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.513540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.514888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.515284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.515667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.516427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.523564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.569380 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2944/5860] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:17.573406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.591987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07598-d193-4970-b000-8ee1aa90498c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.601460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.602149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.602976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.603262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] PATH_INFO: `/v3/projects/542eccc59d514e089c3b666147b6f531/users/aa40c2746f3c478485a0effe0bcace40/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.635122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=542eccc59d514e089c3b666147b6f531, user_id=aa40c2746f3c478485a0effe0bcace40, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.638102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.734670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2917/5861] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:17 2022] PUT /identity/v3/projects/542eccc59d514e089c3b666147b6f531/users/aa40c2746f3c478485a0effe0bcace40/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:17.739504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.761379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dd0d0-aaf7-407a-a136-e69c3a3e7698 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.771396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:17.885603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.886232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.886514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.886886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.887523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.889582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819517-d9ff-47ec-baa2-a4152940bc99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.903432 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2945/5862] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:17.907753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:17.919559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92c0b5-068f-4089-ac47-37d32895f34e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:17.925047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:17.926057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.926344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.926653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] PATH_INFO: `/v3/projects/542eccc59d514e089c3b666147b6f531/users/aa40c2746f3c478485a0effe0bcace40/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:17.928960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542eccc59d514e089c3b666147b6f531, user_id=aa40c2746f3c478485a0effe0bcace40, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:17.932653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:17.968103 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2918/5863] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:17 2022] PUT /identity/v3/projects/542eccc59d514e089c3b666147b6f531/users/aa40c2746f3c478485a0effe0bcace40/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:42:17.978769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:17.979002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:17.979276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:18.016971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] MFA Rules not processed for user `aa40c2746f3c478485a0effe0bcace40`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:18.018203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:18.102327 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2946/5864] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:18.107520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:18.121047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0e801-9326-4a0b-87cd-3cc25fb51ad1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:18.126888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa40c2746f3c478485a0effe0bcace40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542eccc59d514e089c3b666147b6f531', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:18.127610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:18.127960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:18.128885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:18.129640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:18.130164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:18.132530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:18.149949 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2919/5865] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:18.154216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:18.186682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c61e6-e439-416f-9726-2a9dc5f63ee1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:18.192453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa40c2746f3c478485a0effe0bcace40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542eccc59d514e089c3b666147b6f531', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:18.193144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:18.193499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:18.194064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:18.195704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:18.197771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:18.310717 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2947/5866] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:18 2022] POST /identity/v3/projects => generated 350 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:18.313587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:18.328899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e167-eb97-4712-a903-9f765c7514fd tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:18.363860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:18.431225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa40c2746f3c478485a0effe0bcace40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542eccc59d514e089c3b666147b6f531', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:18.432125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:18.432434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:18.432708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:18.433474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:18.433797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:18.437164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:18.453959 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2920/5867] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:42:18.473153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:18.475022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:18.564377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c0610-c497-4c2e-bb2a-c5b28093943b tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:18.568770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:18.572759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:18.572759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:18.572759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:18.599323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:18.600990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:18.614483 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2948/5868] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:19.129033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:19.140525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d94a-312c-45cd-97a7-7856620b55c1 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:19.146476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa40c2746f3c478485a0effe0bcace40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542eccc59d514e089c3b666147b6f531', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:19.147894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:19.148269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:19.148979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] PATH_INFO: `/v3/projects/230fbdefe8fd4b7f8644a06d2f6ffba9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:19.149905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorizing `identity:delete_project(project_id=230fbdefe8fd4b7f8644a06d2f6ffba9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:19.152159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:19.279410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230fbdefe8fd4b7f8644a06d2f6ffba9', 'request_id': 'req-b963cb69-b40f-4839-9423-40fb39f7e922'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:19.355129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230fbdefe8fd4b7f8644a06d2f6ffba9', 'request_id': 'req-b963cb69-b40f-4839-9423-40fb39f7e922'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:19.362315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230fbdefe8fd4b7f8644a06d2f6ffba9', 'request_id': 'req-b963cb69-b40f-4839-9423-40fb39f7e922'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:19.375268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] The token cache is being invalidate because project 230fbdefe8fd4b7f8644a06d2f6ffba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:19.375559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:19.376274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b963cb69-b40f-4839-9423-40fb39f7e922 tempest-QuotasTest-402103971 tempest-QuotasTest-402103971-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:19.383259 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2921/5869] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:19 2022] DELETE /identity/v3/projects/230fbdefe8fd4b7f8644a06d2f6ffba9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:20.169062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:20.184109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:20.252869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d17ec-0432-4440-8a9e-ccc7c16230db service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:20.334544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:20.334544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:20.334544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:20.335155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] PATH_INFO: `/v3/users/f0522bf5d7ce4e58a7349d8e23aae66b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:20.337412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0522bf5d7ce4e58a7349d8e23aae66b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:20.342773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:20.548595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0522bf5d7ce4e58a7349d8e23aae66b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:20.549345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0522bf5d7ce4e58a7349d8e23aae66b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:20.638958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0522bf5d7ce4e58a7349d8e23aae66b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:20.657359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0522bf5d7ce4e58a7349d8e23aae66b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:20.662103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0522bf5d7ce4e58a7349d8e23aae66b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:20.679463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2949/5870] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:20 2022] DELETE /identity/v3/users/f0522bf5d7ce4e58a7349d8e23aae66b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:20.681235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:20.682445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:20.682809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:20.704945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:20.706999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:20.791981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2922/5871] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:20.804314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:20.811052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:20.890469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:20.911748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734a0d-aa43-4ef4-80de-06cd1b8a678d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:20.915877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:20.916599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:20.917004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:20.917353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:20.929714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:20.932683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:20.952667 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2950/5872] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:21.570236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:21.572674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:21.592257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7055b-b1c0-4f12-b466-b1fa552f3d58 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:21.607821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:21.608508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:21.608852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:21.609181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] PATH_INFO: `/v3/projects/6ec711fffe4c4a50a8b843b330654862` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:21.611091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec711fffe4c4a50a8b843b330654862)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:21.613634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:21.774506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:21.797794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec711fffe4c4a50a8b843b330654862', 'request_id': 'req-75d41a07-350c-4dc8-9929-d6c6d9ce027b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:21.886258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec711fffe4c4a50a8b843b330654862', 'request_id': 'req-75d41a07-350c-4dc8-9929-d6c6d9ce027b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:21.899094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec711fffe4c4a50a8b843b330654862', 'request_id': 'req-75d41a07-350c-4dc8-9929-d6c6d9ce027b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:21.944906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] The token cache is being invalidate because project 6ec711fffe4c4a50a8b843b330654862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:21.945519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:21.946354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:21.948417 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2923/5873] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:21 2022] DELETE /identity/v3/projects/6ec711fffe4c4a50a8b843b330654862 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:21.953209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:21.969116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341260-34ba-4c2c-a77b-955fa3a9c2c5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:22.087565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:22.088905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:22.089421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:22.090452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] PATH_INFO: `/v3/users/aa40c2746f3c478485a0effe0bcace40` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:22.091856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa40c2746f3c478485a0effe0bcace40)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:22.094820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:22.373268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa40c2746f3c478485a0effe0bcace40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:22.374248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa40c2746f3c478485a0effe0bcace40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:22.437346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa40c2746f3c478485a0effe0bcace40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:22.460352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa40c2746f3c478485a0effe0bcace40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:22.461417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32087b7c-d044-46ee-a60b-abd833559332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa40c2746f3c478485a0effe0bcace40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:22.505211 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2951/5874] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:21 2022] DELETE /identity/v3/users/aa40c2746f3c478485a0effe0bcace40 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:23.345328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:23.346868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:23.374185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d41a07-350c-4dc8-9929-d6c6d9ce027b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:23.495143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:23.495835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:23.498751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:23.499243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] PATH_INFO: `/v3/projects/542eccc59d514e089c3b666147b6f531` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:23.500926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542eccc59d514e089c3b666147b6f531)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:23.514795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:23.652609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542eccc59d514e089c3b666147b6f531', 'request_id': 'req-1a9a75b6-2421-401d-a488-3a8466f777e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:23.749484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542eccc59d514e089c3b666147b6f531', 'request_id': 'req-1a9a75b6-2421-401d-a488-3a8466f777e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:23.757108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542eccc59d514e089c3b666147b6f531', 'request_id': 'req-1a9a75b6-2421-401d-a488-3a8466f777e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:23.777813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] The token cache is being invalidate because project 542eccc59d514e089c3b666147b6f531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:23.778410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:23.780386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a9a75b6-2421-401d-a488-3a8466f777e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:23.783991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2924/5875] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:23 2022] DELETE /identity/v3/projects/542eccc59d514e089c3b666147b6f531 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:23.790329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:23.793195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:23.793486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:23.818761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:23.823202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:23.909186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:23.920756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2952/5876] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:23.929441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:23.929727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:23.930004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:23.952453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:23.953671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:23.974292 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2925/5877] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:23.974876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:23.977824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866248-5f20-473f-975b-4385025ea1cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:23.982934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:23.983636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:23.983989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:23.984350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:23.985057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:23.985428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:23.987338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.001319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2953/5878] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:42:24.006131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.016021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddac8b-3c40-44ce-8fab-fde177e03f12 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.021850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.022461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.022777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.023051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.023742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:24.025715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.162106 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2926/5879] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:24 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:24.166412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.179434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dee9-5ee2-4ea4-acb8-318a7e5a413d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.249943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.250534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.250887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.251142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.252248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:24.254828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.373290 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2954/5880] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:24 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:42:24.377415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.390236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe451a8-c033-4197-82ed-7598b3f62e96 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.400090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.400090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.400090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.400090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.400485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:24.402091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.419160 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2927/5881] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:24.423236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.436058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574917-84ae-4508-ab81-253b6cb0f830 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.442150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.442976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.444004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.444354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.445070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:24.447184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021a0f-db8b-44ba-99e2-a6c717c947c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.464313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2955/5882] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:24.468272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.482641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326a1d-7728-4efa-8da7-4419f2e452ac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.497973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.498748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.499097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.499735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] PATH_INFO: `/v3/projects/038375570fda4e52919e9e63e6fa1d3e/users/4fc9a58563cb470f9406dab0775f8fa3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.517014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:24.521118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038375570fda4e52919e9e63e6fa1d3e, user_id=4fc9a58563cb470f9406dab0775f8fa3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:24.524574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:24.656453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2928/5883] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:24 2022] PUT /identity/v3/projects/038375570fda4e52919e9e63e6fa1d3e/users/4fc9a58563cb470f9406dab0775f8fa3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:24.673988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.676445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.677034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:24.732740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] MFA Rules not processed for user `4fc9a58563cb470f9406dab0775f8fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:24.734649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:24.825611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2956/5884] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:24.826512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:24.828369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:24.967766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52295-b199-4ec8-bdd4-35f4f2cd1936 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:24.978495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:24.979150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:24.979435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:24.979710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:25.004055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:25.005730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daa1d-ba0c-43bd-a6e0-7dc3a665f0bc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:25.027043 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2929/5885] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:25.072957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:25.197302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:25.207581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddbe08-f819-45f1-b0e2-d65bfdd2d9b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:25.213760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:25.214588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:25.214960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:25.215347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] PATH_INFO: `/v3/users/4fc9a58563cb470f9406dab0775f8fa3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:25.216872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc9a58563cb470f9406dab0775f8fa3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:25.219616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:25.474423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc9a58563cb470f9406dab0775f8fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:25.475493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc9a58563cb470f9406dab0775f8fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:25.583620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc9a58563cb470f9406dab0775f8fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:25.605228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc9a58563cb470f9406dab0775f8fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:25.607052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc9a58563cb470f9406dab0775f8fa3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:25.636464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2957/5886] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:25 2022] DELETE /identity/v3/users/4fc9a58563cb470f9406dab0775f8fa3 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:25.641155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:25.646847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:25.646847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:25.691607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:25.694417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:25.777601 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2930/5887] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:25.788713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:25.790401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:25.865858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b090a1f-2bf0-4833-a5c4-7d302e840eab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:25.872940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:25.873672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:25.873952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:25.874572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:25.886647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:25.888297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa696f62-c08b-4fb9-baca-e77280518a13 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:25.900628 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2958/5888] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:26.434727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:26.436202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:26.453394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3850-6085-468d-a221-ba1928df392d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:26.464408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:26.467011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:26.467011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:26.467011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] PATH_INFO: `/v3/projects/038375570fda4e52919e9e63e6fa1d3e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:26.468659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038375570fda4e52919e9e63e6fa1d3e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:26.473522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:26.627200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038375570fda4e52919e9e63e6fa1d3e', 'request_id': 'req-17042e26-f07e-474e-8c2f-0f8355ee02e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:26.795217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038375570fda4e52919e9e63e6fa1d3e', 'request_id': 'req-17042e26-f07e-474e-8c2f-0f8355ee02e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:26.819242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038375570fda4e52919e9e63e6fa1d3e', 'request_id': 'req-17042e26-f07e-474e-8c2f-0f8355ee02e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:26.841752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] The token cache is being invalidate because project 038375570fda4e52919e9e63e6fa1d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:26.842339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:26.843286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:26.845448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2931/5889] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:26 2022] DELETE /identity/v3/projects/038375570fda4e52919e9e63e6fa1d3e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:26.855665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2330ee-7d7e-4ee1-b242-823fbea73a2d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:26.861164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2330ee-7d7e-4ee1-b242-823fbea73a2d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:26.861164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2330ee-7d7e-4ee1-b242-823fbea73a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:26.911541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cd2330ee-7d7e-4ee1-b242-823fbea73a2d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:26.912770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd2330ee-7d7e-4ee1-b242-823fbea73a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:26.980909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:26.982578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.009180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2959/5890] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.009429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:27.010852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.011209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.011553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.034960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.036255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.044371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2960/5891] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:27.048807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.059143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042e26-f07e-474e-8c2f-0f8355ee02e8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.061557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509107e-3410-4759-bb7a-cb47dfe8cfad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.063075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.063709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.063967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.064242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.066662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.069342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.069609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.070189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.070939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.071494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:27.071995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.081741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.085461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:27.099812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2961/5892] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:42:27.101258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.120936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b27555-da3c-41ab-82d3-5fbbe2f9d00a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.129795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.141023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.141023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.141023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.141023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.144099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.188076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.189536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657d12f-9d3e-4a75-887e-327daf5554da service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.203202 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2932/5893] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:42:27.210604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021cfaa-c2c0-43e7-8825-d8695f92bc85 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.210604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021cfaa-c2c0-43e7-8825-d8695f92bc85 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.210604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021cfaa-c2c0-43e7-8825-d8695f92bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.257309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b021cfaa-c2c0-43e7-8825-d8695f92bc85 None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.260696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b021cfaa-c2c0-43e7-8825-d8695f92bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.270662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2962/5894] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:27.273374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.391605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2933/5895] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.450921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e22b6-0f69-4af5-bfed-1dcceab508cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.463617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.464243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.464528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.464791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.465428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.467395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.511964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb81ab-5025-4ec3-aefc-bb0803ea66c5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.516989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb81ab-5025-4ec3-aefc-bb0803ea66c5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.516989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb81ab-5025-4ec3-aefc-bb0803ea66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.561866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cbdb81ab-5025-4ec3-aefc-bb0803ea66c5 None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.565892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cbdb81ab-5025-4ec3-aefc-bb0803ea66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.579981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2934/5896] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.604604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.605446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.606325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.611607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2963/5897] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:27.616079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.634144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468960-9d6f-4fba-a921-ad13566c6c65 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.649596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.650248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.650522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.651371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.652379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.654602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.656596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1d31e-b989-456b-92d2-8291aedbd5b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.657922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.682526 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2935/5898] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.684348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2964/5899] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:42:27.688264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.718363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677aa6f-d034-4e9b-be14-5655e41b1da6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.722681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b85c-ce6a-4592-a376-8c5c04c53f9e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.723203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b85c-ce6a-4592-a376-8c5c04c53f9e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.725656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b85c-ce6a-4592-a376-8c5c04c53f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.731904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.732644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.734608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.734986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.735753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.739197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.760402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b83b85c-ce6a-4592-a376-8c5c04c53f9e None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.764445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2936/5900] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:27.766166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b83b85c-ce6a-4592-a376-8c5c04c53f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.769799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:27.791614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22549-0537-425c-9bb1-da0b9921f932 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:27.802601 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2965/5901] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.818182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:27.818182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.818182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.818182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] PATH_INFO: `/v3/projects/1fd9208c2b1a41e2973013b28141f7ba/users/8c9cad902ef04f5aa5b06829d66ceee4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.820749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f5b0-dc0a-47c8-a846-ca5b95712e71 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.820749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f5b0-dc0a-47c8-a846-ca5b95712e71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.820749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f5b0-dc0a-47c8-a846-ca5b95712e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:27.849632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd9208c2b1a41e2973013b28141f7ba, user_id=8c9cad902ef04f5aa5b06829d66ceee4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:27.852145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-91c0f5b0-dc0a-47c8-a846-ca5b95712e71 None None] MFA Rules not processed for user `7b765bef9fc541b1bc65212ca6f05f79`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:27.853542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:27.858204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91c0f5b0-dc0a-47c8-a846-ca5b95712e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:27.868691 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2966/5902] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:27.951356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2937/5903] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:27 2022] PUT /identity/v3/projects/1fd9208c2b1a41e2973013b28141f7ba/users/8c9cad902ef04f5aa5b06829d66ceee4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:27.964851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c69ad-2606-45b4-ae0d-d9e9b64ce7ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:27.965407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c69ad-2606-45b4-ae0d-d9e9b64ce7ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:27.965593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c69ad-2606-45b4-ae0d-d9e9b64ce7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:28.032516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-941c69ad-2606-45b4-ae0d-d9e9b64ce7ae None None] MFA Rules not processed for user `8c9cad902ef04f5aa5b06829d66ceee4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:28.033816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-941c69ad-2606-45b4-ae0d-d9e9b64ce7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:28.198408 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2967/5904] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:28.212947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:28.216561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:28.250514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:28.299075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a87807-4d88-47a2-bf0d-3b8a0ebde32c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:28.311793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:28.312910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:28.314925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:28.315941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:28.327299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:28.331167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:28.345121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2938/5905] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:28.933371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:28.938040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:28.938408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:28.982428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] MFA Rules not processed for user `a55fa5e6656648faaf79309f68a9f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:28.985517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:29.020933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:29.070381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2968/5906] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:30.772167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:30.773812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:30.910453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5b739-cccc-4e44-934d-bdea1786ea21 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:30.917373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:30.918864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:30.919355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:30.919812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:30.927020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:30.957392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:30.959643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:30.977862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2939/5907] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:36.465052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:36.486220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2675-394a-4cf7-96d0-7a905205285c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:36.499284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:36.499909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:36.500232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:36.500502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:36.502552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:36.521246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:36.522808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:36.535948 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2969/5908] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:40.968871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=48 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:45.374894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:45.380393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:45.558554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73808d-8b37-404b-9419-a8f1b7953c2c service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:45.568365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:45.568365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:45.568365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:45.568365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] PATH_INFO: `/v3/users/7b765bef9fc541b1bc65212ca6f05f79` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:45.571171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b765bef9fc541b1bc65212ca6f05f79)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:45.573647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:46.049822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b765bef9fc541b1bc65212ca6f05f79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:46.050521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b765bef9fc541b1bc65212ca6f05f79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:46.185822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b765bef9fc541b1bc65212ca6f05f79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:46.207370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b765bef9fc541b1bc65212ca6f05f79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:46.208453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-55048661-8a01-4de6-a70b-5b9056c390f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b765bef9fc541b1bc65212ca6f05f79'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:46.226796 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2940/5909] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:45 2022] DELETE /identity/v3/users/7b765bef9fc541b1bc65212ca6f05f79 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:46.528369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:46.672457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:46.692069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b101-4be8-4932-a182-7827908927dd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:46.829944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:46.831172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:46.831584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:46.831930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] PATH_INFO: `/v3/projects/b9a7e83286cc4dd49ea94a79b85c0ffd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:46.833225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a7e83286cc4dd49ea94a79b85c0ffd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:46.835265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:47.038690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a7e83286cc4dd49ea94a79b85c0ffd', 'request_id': 'req-d7cf4d56-122e-42ed-b1f8-8c01658d835f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:47.141524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a7e83286cc4dd49ea94a79b85c0ffd', 'request_id': 'req-d7cf4d56-122e-42ed-b1f8-8c01658d835f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:47.157036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a7e83286cc4dd49ea94a79b85c0ffd', 'request_id': 'req-d7cf4d56-122e-42ed-b1f8-8c01658d835f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:47.179111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] The token cache is being invalidate because project b9a7e83286cc4dd49ea94a79b85c0ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:47.179259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:47.180119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d7cf4d56-122e-42ed-b1f8-8c01658d835f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:47.182211 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2970/5910] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:46 2022] DELETE /identity/v3/projects/b9a7e83286cc4dd49ea94a79b85c0ffd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:47.188349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:47.188899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:47.190655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:47.225130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:47.248314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:47.362704 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2941/5911] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:47.370431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:47.370769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:47.371024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:47.397243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:47.399050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:47.438397 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2971/5912] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:47.439667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:47.460664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd49f0-9042-47b8-aab6-629e71bac3a1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:47.468828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:47.469380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:47.469666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:47.469942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:47.470610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:47.470938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:47.472643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:47.499107 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2942/5913] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:47.503307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:47.524647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607c03-5505-40b7-b155-bb7cca66897e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:47.540329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:47.541673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:47.542132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:47.542578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:47.543443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:47.545533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:47.714901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2972/5914] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:47 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:47.719447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:47.738359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a18b8-d2d1-4578-bd09-00b9aeb6f55d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:47.744132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:47.855722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:47.857515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:47.857515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:47.857515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:47.857936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:47.859917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:47.996797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2943/5915] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:47 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:48.004567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:48.017299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55922-90c2-42a1-ba5e-60d3911b0cfb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:48.025475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:48.026588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.027225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.028106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.028981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:48.030796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:48.045599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2973/5916] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:48.049320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:48.065961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a891f-914d-498e-beb5-492c6ad06fbc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:48.076000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:48.076639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.076921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.077197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.077847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:48.080421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4221e-ce4e-4476-9961-ddae7c3d276a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:48.100423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2944/5917] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:48.104337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:48.120580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eb77d-ba55-4245-8457-5529c51beca6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:48.129533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:48.130534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.131071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.131642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] PATH_INFO: `/v3/projects/1a447e7f46b9429c9d8c1e36e239caa1/users/8870d5259a8244d39b9ad22948ae98e4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.151463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a447e7f46b9429c9d8c1e36e239caa1, user_id=8870d5259a8244d39b9ad22948ae98e4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:48.155021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167e6b-8919-4120-ae8d-6d7537c4a318 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:48.266171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2974/5918] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:48 2022] PUT /identity/v3/projects/1a447e7f46b9429c9d8c1e36e239caa1/users/8870d5259a8244d39b9ad22948ae98e4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:48.276902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.277475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.283646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.358471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] MFA Rules not processed for user `8870d5259a8244d39b9ad22948ae98e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:48.361135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:48.464769 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2945/5919] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:48.480708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.480708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.481061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.515880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] MFA Rules not processed for user `8870d5259a8244d39b9ad22948ae98e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:48.517389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:48.526377 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2975/5920] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:48.542339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:48.544088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:48.642017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46f6c-16c3-4617-851d-92dc299bf716 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:48.648501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:48.649204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:48.649562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:48.649910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:48.666520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:48.666520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959283f5-d545-441d-90f3-c5772d0a8d64 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:48.673810 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2946/5921] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:49.526790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:53.902598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:53.907416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:53.938582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:53.991882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32292-395d-459a-a4bf-cac85f907d87 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:53.996546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:53.997251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:53.997605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:53.998135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] PATH_INFO: `/v3/users/8c9cad902ef04f5aa5b06829d66ceee4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:53.999365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9cad902ef04f5aa5b06829d66ceee4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:54.001502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:54.301021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9cad902ef04f5aa5b06829d66ceee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:54.301750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9cad902ef04f5aa5b06829d66ceee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:54.375800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9cad902ef04f5aa5b06829d66ceee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:54.402743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9cad902ef04f5aa5b06829d66ceee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:54.407803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9cad902ef04f5aa5b06829d66ceee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:54.421859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2976/5922] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:53 2022] DELETE /identity/v3/users/8c9cad902ef04f5aa5b06829d66ceee4 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:54.423520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:54.424086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:54.424086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:54.446487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:54.448012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:54.519253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2947/5923] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:54.531707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:54.533352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:54.697994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2c20-2b05-43e7-aec2-8d43210c93cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:54.704886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:54.705733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:54.706232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:54.706859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:54.725676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:54.727393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eb9cd-7079-4989-b9e7-b170ca39354e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:54.742085 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2977/5924] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:55.074119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:55.076484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:55.099219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8da6a-990a-47a3-8a9d-7ec6ca8ec0a4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:55.105272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:55.105964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.106248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.106859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] PATH_INFO: `/v3/projects/1fd9208c2b1a41e2973013b28141f7ba` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.108570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd9208c2b1a41e2973013b28141f7ba)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:55.114683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:55.255529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd9208c2b1a41e2973013b28141f7ba', 'request_id': 'req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:55.320946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd9208c2b1a41e2973013b28141f7ba', 'request_id': 'req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:55.328858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd9208c2b1a41e2973013b28141f7ba', 'request_id': 'req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:55.347721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] The token cache is being invalidate because project 1fd9208c2b1a41e2973013b28141f7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:55.348192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:55.353126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-32a1863e-f60b-4d1f-b60c-0e7884e8b16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:55.354523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2948/5925] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:55 2022] DELETE /identity/v3/projects/1fd9208c2b1a41e2973013b28141f7ba => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:55.357037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.357520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.357929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.389839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:55.392349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:55.461174 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2978/5926] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:55.470215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.470799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.470799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.481822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:55.491441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:55.492628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:55.501318 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2949/5927] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:55.506589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:55.516347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d16ea-901e-48f3-b8f5-48537e76e945 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:55.521912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989420d4-875e-4957-8774-aee93957801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:55.522528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420d4-875e-4957-8774-aee93957801c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.523018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420d4-875e-4957-8774-aee93957801c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.523150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420d4-875e-4957-8774-aee93957801c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.523740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989420d4-875e-4957-8774-aee93957801c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:55.524296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989420d4-875e-4957-8774-aee93957801c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:55.525684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989420d4-875e-4957-8774-aee93957801c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:55.537772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2979/5928] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:55.542353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:55.552279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331561aa-498e-43f7-abca-bb29552f8669 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:55.557237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:55.558095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.558372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.558693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.559323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:55.561235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:55.740448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989420d4-875e-4957-8774-aee93957801c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:55.745094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2950/5929] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:55 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:55.751639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989420d4-875e-4957-8774-aee93957801c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:55.816212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:55.816853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:55.817195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:55.817475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:55.818425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:55.820078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:55.996727 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2980/5930] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:55 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:56.000162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:56.014902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f0d5e-d487-40af-9d87-0e6bed7c31cd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:56.015897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:56.016507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.016976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.017371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.018025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:56.019761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:56.033162 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2951/5931] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:56.035203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:56.045564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700e532-11cd-4f99-9e63-8eaa51a34c00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:56.050962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:56.058450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.058450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.058450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.058450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:56.058450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:56.071501 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2981/5932] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:56.075894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:56.088432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bc8a-4a5d-49f9-8476-0835ecc75acd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:56.094035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:56.094828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.095220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.095603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] PATH_INFO: `/v3/projects/3f27cb750a284566b307f0f83683a907/users/7c3353e36e3949aa8c89c369c66d14a0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.114113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f27cb750a284566b307f0f83683a907, user_id=7c3353e36e3949aa8c89c369c66d14a0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:56.117038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d75d8-ca6b-4ade-8c54-b2aafc74fe07 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:56.247860 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2952/5933] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:56 2022] PUT /identity/v3/projects/3f27cb750a284566b307f0f83683a907/users/7c3353e36e3949aa8c89c369c66d14a0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:42:56.257958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:56.259653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:56.261114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.261489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.261857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.308076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] MFA Rules not processed for user `7c3353e36e3949aa8c89c369c66d14a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:56.308277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:56.333141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:56.366752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188ff8-b40d-4ef1-a78a-608b4f4ab42d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:56.420023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2953/5934] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:56.430134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:56.430794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.431079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.431931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.433765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:56.434502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:56.437004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:56.447924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:56.449435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:56.453156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2346b6d-50c5-4238-90dc-9726300e3df8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:56.457714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:56.458329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:56.458632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:56.458912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:56.461225 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2982/5935] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:56.468507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:56.470028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c5387-1a8f-4cf6-a3f9-d4548b684979 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:56.481725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2954/5936] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:42:57.330242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:57.351536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:57.474687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a5db3-b071-4176-953d-2ef4e25f7334 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:57.481659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:57.483099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:57.483629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:57.484168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] PATH_INFO: `/v3/users/7c3353e36e3949aa8c89c369c66d14a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:57.485561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3353e36e3949aa8c89c369c66d14a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:57.489168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:57.800590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3353e36e3949aa8c89c369c66d14a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:57.801497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3353e36e3949aa8c89c369c66d14a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:57.952638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3353e36e3949aa8c89c369c66d14a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:57.967776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3353e36e3949aa8c89c369c66d14a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:57.968804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3353e36e3949aa8c89c369c66d14a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:57.983442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2983/5937] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:42:57 2022] DELETE /identity/v3/users/7c3353e36e3949aa8c89c369c66d14a0 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:57.987748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:57.988670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:57.989183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:58.010633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:58.011857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:58.086782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2955/5938] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:58.097722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:58.099624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:58.186206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b3d2e-eda2-407e-99a3-cf0c3bfecaf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:58.191827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:58.192443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:58.192724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:58.193004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:58.203915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:58.211804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393704-406f-406b-a617-d9e9f3c21929 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:58.219322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2984/5939] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:42:58.773983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:58.775707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:58.822293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74263bf-0157-4a0a-bd1b-f3242c8d6c15 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:58.847765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:58.847765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:58.847765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:58.847765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] PATH_INFO: `/v3/projects/3f27cb750a284566b307f0f83683a907` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:58.849834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f27cb750a284566b307f0f83683a907)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:58.852815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.018388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f27cb750a284566b307f0f83683a907', 'request_id': 'req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:59.120821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f27cb750a284566b307f0f83683a907', 'request_id': 'req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:59.133185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f27cb750a284566b307f0f83683a907', 'request_id': 'req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:59.148684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] The token cache is being invalidate because project 3f27cb750a284566b307f0f83683a907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:42:59.149057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:59.149802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4604dbc4-bcf2-4ef7-8b37-b2664b1bdc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:42:59.155239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2956/5940] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:42:58 2022] DELETE /identity/v3/projects/3f27cb750a284566b307f0f83683a907 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:42:59.156967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.157467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.157659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.186220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:59.187914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:59.222784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:59.272830 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2985/5941] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:42:59.278912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.279145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.279473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.313713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:42:59.313713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:42:59.322870 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2957/5942] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:42:59.329712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.343863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e367-5270-4aa2-9d7e-74f41d4f279a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.350095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.351093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.351375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.351844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.352492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:42:59.352795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.355106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.369042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2986/5943] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:42:59.373751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.384416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee77bc-98b9-4d2e-9779-246015e27742 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.389264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.389879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.390157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.390439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.391167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.394181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.411141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:42:59.525546 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2958/5944] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:42:59 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:59.529891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.541505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b860a0-b42f-4ac5-8b00-f251e4572bfb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.605153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.605768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.606053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.606380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.607044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.609130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.766752 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2987/5945] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:42:59 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:42:59.771425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.786597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e211f9-11fc-45b2-9609-2abe8200b4c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.790725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.791350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.791632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.791974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.792632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.794804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.808766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2959/5946] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:42:59.812422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.823597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87078c-4396-4457-874f-38e9d63aa69a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.829986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.829986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.829986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.829986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.831967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.833584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314ba8-b6b1-4e72-b3e7-5033cee2b83b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:42:59.850372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2988/5947] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:42:59.851128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:42:59.900823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71a4cf-8079-48a8-aa59-8b498e0a4e90 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:42:59.922536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:42:59.923320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:42:59.923606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:42:59.923881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] PATH_INFO: `/v3/projects/16136ab450e040a1bd3b322e9520ec93/users/2fffb19980c2401084dd1efdff5929af/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:42:59.945594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16136ab450e040a1bd3b322e9520ec93, user_id=2fffb19980c2401084dd1efdff5929af, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:42:59.948479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:00.057990 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2960/5948] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:42:59 2022] PUT /identity/v3/projects/16136ab450e040a1bd3b322e9520ec93/users/2fffb19980c2401084dd1efdff5929af/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:43:00.070276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:00.073475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:00.073475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:00.127001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] MFA Rules not processed for user `2fffb19980c2401084dd1efdff5929af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:00.133886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:00.207326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2989/5949] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:00.214442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:00.216730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:00.291823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e08774-476b-41ce-830f-0a18ba069015 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:00.296573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:00.297288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:00.297691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:00.298181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:00.309755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:00.311747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f3de1-de0c-4966-851b-eb692f9d5006 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:00.325147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2961/5950] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:10.200346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:10.318739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:12.493246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:12.697392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586968fb-38ac-42af-82bf-0de61bd4de66 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:12.708770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:12.709435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:12.709835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:12.711292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] PATH_INFO: `/v3/users/2fffb19980c2401084dd1efdff5929af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:12.715112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fffb19980c2401084dd1efdff5929af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:12.717582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:13.038919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fffb19980c2401084dd1efdff5929af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:13.039664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fffb19980c2401084dd1efdff5929af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:13.192875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fffb19980c2401084dd1efdff5929af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:13.219753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fffb19980c2401084dd1efdff5929af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:13.219753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fffb19980c2401084dd1efdff5929af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:13.249934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2990/5951] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:43:12 2022] DELETE /identity/v3/users/2fffb19980c2401084dd1efdff5929af => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:13.255244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:13.255781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:13.257131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:13.313141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:13.320329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:13.541247 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2962/5952] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:13.556392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:13.558289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:13.719932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046ef5-356d-4fbb-ae16-a06a0ea5c65a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:13.731881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:13.732904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:13.733414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:13.733915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:13.758458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:13.760974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc64a-dd1c-40e9-a7f2-4f4d439d5a20 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:13.780361 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2991/5953] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:14.376205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:14.377923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:14.400623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3112-efe5-4a94-aaa4-09372b3ceadc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:14.408867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:14.409633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:14.410019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:14.410563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] PATH_INFO: `/v3/projects/16136ab450e040a1bd3b322e9520ec93` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:14.412586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16136ab450e040a1bd3b322e9520ec93)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:14.414824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:14.596077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16136ab450e040a1bd3b322e9520ec93', 'request_id': 'req-f7cb55ed-54ef-49f0-9874-cc3df19807e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:14.650054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16136ab450e040a1bd3b322e9520ec93', 'request_id': 'req-f7cb55ed-54ef-49f0-9874-cc3df19807e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:14.657433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16136ab450e040a1bd3b322e9520ec93', 'request_id': 'req-f7cb55ed-54ef-49f0-9874-cc3df19807e6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:14.671472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] The token cache is being invalidate because project 16136ab450e040a1bd3b322e9520ec93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:43:14.671882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:14.672728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f7cb55ed-54ef-49f0-9874-cc3df19807e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:14.678433 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2963/5954] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:43:14 2022] DELETE /identity/v3/projects/16136ab450e040a1bd3b322e9520ec93 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:14.680092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:14.681041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:14.681267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:14.739877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:14.741400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:14.768833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:14.833667 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2992/5955] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:14.839416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:14.839942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:14.840458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:14.867735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:14.869619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:14.884636 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2964/5956] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:14.889061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:14.921720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc474-e352-4565-aa61-e29ffab6bcbb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:14.934704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:14.937554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:14.939064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:14.950759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:14.950759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:43:14.950759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:14.952320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:14.971820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:14.974714 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2993/5957] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:43:14.982294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28877-395d-4cc2-97a7-f5115a6cfbae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:14.987622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:14.988441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:14.988821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:14.989195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:14.989939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:14.992162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:15.143404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2965/5958] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:43:14 2022] POST /identity/v3/projects => generated 357 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:43:15.147869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:15.159985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5e636-c280-44bb-9364-5a2944f4727b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:15.284533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:15.285250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.285892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.285999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.288521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:15.290896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:15.405501 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2994/5959] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:43:15 2022] POST /identity/v3/users => generated 279 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:43:15.406797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:15.421399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc73a1-e48b-4e8a-85b9-73dc00035952 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:15.431784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:15.432663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.433376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.433868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.434812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:15.436760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:15.459820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:15.460283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2966/5960] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:15.477786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5afc0-71ae-40e9-a78c-34123358d08c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:15.489552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:15.490287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.490666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.491018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.491752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:15.493450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceea5e-dd4b-45ec-b0ee-29d96bcd2d45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:15.520386 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2995/5961] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:43:15.521965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:15.535428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a9ba-d9dd-4caf-9ef2-3552d1e3e5be admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:15.541137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:15.542800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.543423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.543864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] PATH_INFO: `/v3/projects/f16f9db4892d42c5b278d1b4c58e4581/users/642316255c4940488e7f15a72e27bfd6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.564430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16f9db4892d42c5b278d1b4c58e4581, user_id=642316255c4940488e7f15a72e27bfd6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:15.569067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:15.653460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2967/5962] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:43:15 2022] PUT /identity/v3/projects/f16f9db4892d42c5b278d1b4c58e4581/users/642316255c4940488e7f15a72e27bfd6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:15.664657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.664896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.665113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.752907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] MFA Rules not processed for user `642316255c4940488e7f15a72e27bfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:15.754132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:15.841254 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2996/5963] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:15.853822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:15.859557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:15.905626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:15.953542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886e7b0-396d-4fff-9fa9-9a430319180f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:15.958209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:15.958868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:15.959166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:15.959441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:15.969894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:15.972276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:16.000018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2968/5964] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:16.366243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:16.368031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:16.409482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:16.544963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aa7d0-119a-44ce-b443-4cb2596f46f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:16.571410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:16.572045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:16.572328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:16.572751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:16.583805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:16.668704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:16.670468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:16.707590 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2997/5965] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:26.016729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:26.018341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:26.116932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72cf3-fdfe-4f8b-9bfb-af1bae036fbd service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:26.125317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:26.126406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:26.127484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:26.127995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] PATH_INFO: `/v3/users/787c6c3a8fd442768f77735c4beff9f5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:26.129600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=787c6c3a8fd442768f77735c4beff9f5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:26.132391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:26.405062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787c6c3a8fd442768f77735c4beff9f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:26.406243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787c6c3a8fd442768f77735c4beff9f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:26.480900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787c6c3a8fd442768f77735c4beff9f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:26.531960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787c6c3a8fd442768f77735c4beff9f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:26.533811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787c6c3a8fd442768f77735c4beff9f5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:26.574569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2969/5966] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:43:26 2022] DELETE /identity/v3/users/787c6c3a8fd442768f77735c4beff9f5 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:27.090926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=52 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:27.458707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:27.480372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5f0b-5d2b-4c2a-9444-e00e7c44d078 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:27.659610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:27.660435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:27.660827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:27.661541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] PATH_INFO: `/v3/projects/4097d9e16c8d481e951d47a79c0f685f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:27.663543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4097d9e16c8d481e951d47a79c0f685f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:27.668370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:27.834803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4097d9e16c8d481e951d47a79c0f685f', 'request_id': 'req-6ae265b1-649d-4303-8517-4041090f1fb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:27.930510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4097d9e16c8d481e951d47a79c0f685f', 'request_id': 'req-6ae265b1-649d-4303-8517-4041090f1fb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:27.938301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4097d9e16c8d481e951d47a79c0f685f', 'request_id': 'req-6ae265b1-649d-4303-8517-4041090f1fb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:27.982179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] The token cache is being invalidate because project 4097d9e16c8d481e951d47a79c0f685f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:43:27.984002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:27.985705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:27.992193 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2998/5967] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:43:27 2022] DELETE /identity/v3/projects/4097d9e16c8d481e951d47a79c0f685f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:27.996164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:28.000022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:28.022692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ca6d3-9ca9-459f-a2c3-c590c5831fbd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:28.079555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:28.105004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:28.105774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:28.106129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:28.106468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] PATH_INFO: `/v3/users/fdafd1823228468181c2b658c4d02f0f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:28.108471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdafd1823228468181c2b658c4d02f0f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:28.110756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:28.351575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdafd1823228468181c2b658c4d02f0f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:28.352443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdafd1823228468181c2b658c4d02f0f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:28.465150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdafd1823228468181c2b658c4d02f0f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:28.493846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdafd1823228468181c2b658c4d02f0f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:28.493846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d28e55fa-a970-4eec-b019-79ac9d440897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdafd1823228468181c2b658c4d02f0f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:28.531123 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2970/5968] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:43:27 2022] DELETE /identity/v3/users/fdafd1823228468181c2b658c4d02f0f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:29.410592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:29.411078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:29.425906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae265b1-649d-4303-8517-4041090f1fb5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:29.578992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:29.580716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:29.581206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:29.581680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] PATH_INFO: `/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:29.585196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c08b5982d44ad5a4ceb9c18f7e64d4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:29.633884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:29.812718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:29.831083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c08b5982d44ad5a4ceb9c18f7e64d4', 'request_id': 'req-49f9cebe-82ad-45b1-b3a9-2666c30a5017'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:29.960917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c08b5982d44ad5a4ceb9c18f7e64d4', 'request_id': 'req-49f9cebe-82ad-45b1-b3a9-2666c30a5017'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:29.971893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c08b5982d44ad5a4ceb9c18f7e64d4', 'request_id': 'req-49f9cebe-82ad-45b1-b3a9-2666c30a5017'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:29.991883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] The token cache is being invalidate because project 83c08b5982d44ad5a4ceb9c18f7e64d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:43:29.992280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:29.993414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-49f9cebe-82ad-45b1-b3a9-2666c30a5017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:29.999069 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2999/5969] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:43:29 2022] DELETE /identity/v3/projects/83c08b5982d44ad5a4ceb9c18f7e64d4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:30.001586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.002601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.002927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.043735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:30.045776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:30.215274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2971/5970] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:43:30.217534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.217534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.218477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.255011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:30.256319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:30.295932 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3000/5971] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:30.297486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:30.316514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bde467-b158-4e19-a63b-f5fd3d9feacf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:30.343931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:30.344573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.344853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.345124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.345870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:43:30.346925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:30.351215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:30.382259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:30.386259 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2972/5972] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:43:30.404906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497d344-b62e-41a4-b115-894d39a978c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:30.416048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:30.416809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.417189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.417557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.418298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:30.430824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:30.605860 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3001/5973] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:43:30 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:43:30.607322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:30.621034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01676-59b2-4e08-9b83-c5205f9402b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:30.737920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:30.751474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:30.752883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.753247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.753621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.754425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:30.756550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:30.868839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2973/5974] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:43:30 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:43:30.872697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:30.889291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee608-169b-4bb9-9763-22ae698318fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:30.895227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:30.895845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.896127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.896413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.897118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:30.899012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:30.914155 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3002/5975] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:30.927458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:30.939706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccd650-3b99-4f81-8ca1-3158d25a9d83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:30.945529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:30.946259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:30.946654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:30.947035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:30.947787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:30.949510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cf8b1-0a7c-4b0a-b95e-83199d70b678 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:30.984352 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2974/5976] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:30.986761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:31.001199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526456bd-827b-433d-bd61-f27267faa416 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:31.008006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:31.008671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:31.009562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:31.009562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] PATH_INFO: `/v3/projects/d82318e328a24319a37950fe236a87f5/users/72de694183464b51875ad1f7fc0d1b43/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:31.030147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82318e328a24319a37950fe236a87f5, user_id=72de694183464b51875ad1f7fc0d1b43, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:31.034381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:31.145733 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3003/5977] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:43:30 2022] PUT /identity/v3/projects/d82318e328a24319a37950fe236a87f5/users/72de694183464b51875ad1f7fc0d1b43/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:31.156285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e791-92b4-4666-83f3-434e6f8022c4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:31.157161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e791-92b4-4666-83f3-434e6f8022c4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:31.157636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e791-92b4-4666-83f3-434e6f8022c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:31.188545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e73e791-92b4-4666-83f3-434e6f8022c4 None None] MFA Rules not processed for user `72de694183464b51875ad1f7fc0d1b43`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:31.190889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e73e791-92b4-4666-83f3-434e6f8022c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:31.269815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2975/5978] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:31.277480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:31.281324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:31.352973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87983d1-c6e9-4aa1-a56d-79204182f6b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:31.357040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:31.357761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:31.358164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:31.358495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:31.375386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:31.378075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:31.414409 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3004/5979] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:32.472748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:32.474981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7204-4849-4bfb-8ffd-4ab7e548126b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:32.475415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7204-4849-4bfb-8ffd-4ab7e548126b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:32.476484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:32.477414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7204-4849-4bfb-8ffd-4ab7e548126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:32.563405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b3ad7204-4849-4bfb-8ffd-4ab7e548126b None None] MFA Rules not processed for user `2dac64cc9d10438c802bcd594e6bda86`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:32.563405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3ad7204-4849-4bfb-8ffd-4ab7e548126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:32.640571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2f5c7-0bd2-4bac-b5d6-fc672d6218ca service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:32.649013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:32.650081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:32.650732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:32.651264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] PATH_INFO: `/v3/users/2f3fbfc7f1424702ace7a18873e0a06b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:32.652792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3fbfc7f1424702ace7a18873e0a06b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:32.656119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:32.659453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:32.694674 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2976/5980] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:32.929611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3fbfc7f1424702ace7a18873e0a06b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:32.930537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3fbfc7f1424702ace7a18873e0a06b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:33.018377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3fbfc7f1424702ace7a18873e0a06b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:33.046918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3fbfc7f1424702ace7a18873e0a06b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:33.047720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3fbfc7f1424702ace7a18873e0a06b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:33.074201 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3005/5981] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:43:32 2022] DELETE /identity/v3/users/2f3fbfc7f1424702ace7a18873e0a06b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:33.078505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:33.079130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:33.079567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:33.106341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:33.107739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:33.226909 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2977/5982] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:33.239950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:33.241435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:33.354595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123948e3-54b4-4f1a-9796-62ec2c5f4ca2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:33.366051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:33.367726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:33.367726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:33.367726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:33.403968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:33.406117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:33.455321 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3006/5983] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:33.604383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:33.607358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:33.616877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:33.626458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b9c-ca1f-4716-ad33-fb34087b0f22 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:33.641175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:33.641175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:33.641175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:33.641175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:33.641569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:33.654546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:33.656331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdcde9-35d7-434e-a3b8-7ea56320f700 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:33.691952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2978/5984] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:33.820566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:33.824649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:33.867916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020661-bb26-4bf8-993e-ac7c0dc49d79 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:33.875333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:33.876428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:33.876802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:33.877078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] PATH_INFO: `/v3/projects/0e0a67c46c23487394aac979b570bba3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:33.879214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0a67c46c23487394aac979b570bba3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:33.897178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:34.019667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0a67c46c23487394aac979b570bba3', 'request_id': 'req-c70b554c-07f4-4c58-a9f9-8295b738a58a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:34.119495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0a67c46c23487394aac979b570bba3', 'request_id': 'req-c70b554c-07f4-4c58-a9f9-8295b738a58a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:34.128407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0a67c46c23487394aac979b570bba3', 'request_id': 'req-c70b554c-07f4-4c58-a9f9-8295b738a58a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:34.143271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] The token cache is being invalidate because project 0e0a67c46c23487394aac979b570bba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:43:34.143706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:34.144835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c70b554c-07f4-4c58-a9f9-8295b738a58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:34.159256 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3007/5985] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:43:33 2022] DELETE /identity/v3/projects/0e0a67c46c23487394aac979b570bba3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:34.164134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.164388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.164676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.190301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:34.195194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:34.289750 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2979/5986] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:43:34.291741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.292092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.292633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.312191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:34.327901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:34.329130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:34.343880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:34.344127 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3008/5987] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:34.355036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc67810-44f8-4258-bdba-235dd5005198 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:34.364081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:34.364081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.364081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.364081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.364516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:43:34.364516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:34.366689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:34.394669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2980/5988] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:43:34.400437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:34.411371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54094ab-b94a-49e6-9030-ccf123e560f4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:34.417099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:34.417723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.418005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.418283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.419013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:34.421782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:34.540316 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3009/5989] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:43:34 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:43:34.544100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:34.573321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e664-a16b-4681-9a7e-e407b0e8861c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:34.745295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:34.746696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.746979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.747247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.748038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:34.749962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:34.888799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2981/5990] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:43:34 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:43:34.892620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:34.906911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dbb6b-5f90-4b77-bc83-ffc4be05b433 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:34.920650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:34.921569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:34.925586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:34.926003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:34.927189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:34.929014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:34.962703 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3010/5991] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:34.965670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:34.981378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda20a3c-28c1-4f34-8452-de2251fc3a8f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:35.035626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:35.037114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:35.038299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:35.041439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:35.042251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:35.050096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d2e02-b30f-4c51-a5ec-36c40a47087d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:35.084833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2982/5992] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:35.087384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:35.100145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e92a1a-5e39-4f09-bad7-468965fc2a17 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:35.108829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:35.109853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:35.110256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:35.112905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] PATH_INFO: `/v3/projects/6672c55c92024a93a26e594a8ee5bb86/users/85ae2b75ac0a4e9e90055869d3d5840a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:35.155207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6672c55c92024a93a26e594a8ee5bb86, user_id=85ae2b75ac0a4e9e90055869d3d5840a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:35.159107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:35.241445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3011/5993] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:43:35 2022] PUT /identity/v3/projects/6672c55c92024a93a26e594a8ee5bb86/users/85ae2b75ac0a4e9e90055869d3d5840a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:35.253434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:35.254329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:35.254607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:35.318551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] MFA Rules not processed for user `85ae2b75ac0a4e9e90055869d3d5840a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:35.319825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:35.402293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:35.455739 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2983/5994] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:35.467330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:35.469117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:35.598913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d34e0b-494f-40d7-be0b-33574525336c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:35.610821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:35.615278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:35.615278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:35.615278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:35.639469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:35.641003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5f772-95ee-4eea-ab2f-f5773e96f993 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:35.689858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3012/5995] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:37.707987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:37.716456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:37.899631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e83f-e3aa-4d6f-b7f6-2755293f1d1a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:37.905923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:37.906611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:37.909663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:37.910191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] PATH_INFO: `/v3/users/8870d5259a8244d39b9ad22948ae98e4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:37.924944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8870d5259a8244d39b9ad22948ae98e4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:37.924944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:38.208759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8870d5259a8244d39b9ad22948ae98e4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:38.210150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8870d5259a8244d39b9ad22948ae98e4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:38.380370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8870d5259a8244d39b9ad22948ae98e4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:38.401097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8870d5259a8244d39b9ad22948ae98e4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:38.402642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8870d5259a8244d39b9ad22948ae98e4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:38.433049 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2984/5996] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:43:37 2022] DELETE /identity/v3/users/8870d5259a8244d39b9ad22948ae98e4 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:38.434864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:38.435682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:38.436177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:38.484801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:38.488582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:38.697848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3013/5997] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:38.752138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:38.753820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:38.896712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036e82-a830-40d8-bdeb-a5935a9b815b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:38.906515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:38.907480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:38.908495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:38.908937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:38.930499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:38.932558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ba098-0290-4864-a2c0-eb5f77da3f5e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:38.960788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2985/5998] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:40.334952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:40.340190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:40.364755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b689a-68d5-4804-9fc9-b4f2be16327e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:40.377763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:40.380521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:40.380989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:40.384640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] PATH_INFO: `/v3/projects/1a447e7f46b9429c9d8c1e36e239caa1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:40.384640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a447e7f46b9429c9d8c1e36e239caa1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:40.390042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:40.676736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:40.700477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a447e7f46b9429c9d8c1e36e239caa1', 'request_id': 'req-eca674c4-9a5e-4a90-98e5-85601c957abe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:40.864440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a447e7f46b9429c9d8c1e36e239caa1', 'request_id': 'req-eca674c4-9a5e-4a90-98e5-85601c957abe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:40.872065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a447e7f46b9429c9d8c1e36e239caa1', 'request_id': 'req-eca674c4-9a5e-4a90-98e5-85601c957abe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:40.895921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] The token cache is being invalidate because project 1a447e7f46b9429c9d8c1e36e239caa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:43:40.896216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:40.907543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eca674c4-9a5e-4a90-98e5-85601c957abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:43:40.916619 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3014/5999] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:43:40 2022] DELETE /identity/v3/projects/1a447e7f46b9429c9d8c1e36e239caa1 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:40.918493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:40.919077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:40.919270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:40.943315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:40.959228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:40.963297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:41.110274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2986/6000] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:41.113210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:41.113334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:41.113513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:41.193661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:41.198656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:41.238767 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3015/6001] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:41.240389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:41.259595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93befac4-9c5a-4f32-b8c9-90353b63aecb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:41.283026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:41.283652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:41.290320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:41.290320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:41.290320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:43:41.291126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:41.293499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:41.332855 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2987/6002] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:43:41.334691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:41.349401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517d9dd-14be-4e50-839d-4b30ea272cb7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:41.365904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:41.367166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:41.367609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:41.368011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:41.370559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:41.373311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:41.520484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3016/6003] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:43:41 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:43:41.524317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:41.550724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c617-13c2-4270-b16f-73aa45787f68 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:41.742429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:41.749319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:41.749319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:41.749319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:41.749319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:41.756798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:41.959829 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2988/6004] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:43:41 2022] POST /identity/v3/users => generated 293 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:43:41.964077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:41.985236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964853-f244-4be1-9917-d2439d6ad29d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:41.999315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:42.000230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:42.002315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:42.002774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:42.004415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:42.009079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:42.038464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3017/6005] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:42.043680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:42.069019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fbe41-889d-441a-9b51-394a93788a24 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:42.078895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:42.080890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:42.081512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:42.081994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:42.082825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:42.087384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a84dd0-dff3-4d9f-9d79-05cad07d4511 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:42.119526 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2989/6006] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:43:42.121765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:42.136619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5d7b-4bf1-4384-937f-469e86fadfbf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:42.150239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:42.151783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:42.152406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:42.152856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] PATH_INFO: `/v3/projects/5bc31d316ae84fa3bec83fb814acc08c/users/501e2ac3eb6a49a390d0a2eed38300ca/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:42.192827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc31d316ae84fa3bec83fb814acc08c, user_id=501e2ac3eb6a49a390d0a2eed38300ca, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:42.207858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:42.300010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3018/6007] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:43:42 2022] PUT /identity/v3/projects/5bc31d316ae84fa3bec83fb814acc08c/users/501e2ac3eb6a49a390d0a2eed38300ca/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:43:42.305773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:42.308678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:42.308678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:42.352998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:42.354484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:42.467415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2990/6008] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:43:42.478411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:42.483877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:42.634857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b146-174c-4e5c-891b-4c8c31bf49fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:42.642740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:42.643567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:42.644019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:42.644435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:42.659596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:42.661515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:42.673428 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3019/6009] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:44.514460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:44.528889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:44.572713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:44.791968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd89d-28a5-4f9c-8c74-ce734e1fbda7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:44.818293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:44.821687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:44.822449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:44.822853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:44.829023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:44.865629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:44.867464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d4d0-0daf-48a8-8512-b8d3b743ff24 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:44.968043 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2991/6010] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:52.668946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:55.335802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=28 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:43:56.572737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:43:56.574777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:56.624093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311f24-ec0e-46f1-af9e-01531f906c25 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:43:56.638006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:43:56.639213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:56.641979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:56.642397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:56.651660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:56.688077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:43:56.689824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92cb2-c307-440c-bb0d-63665fa9eaa2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:43:56.759989 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3020/6011] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:43:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:43:58.247051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644a5e-38a4-48d9-9fb1-e03e3ae14cb6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:43:58.247599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644a5e-38a4-48d9-9fb1-e03e3ae14cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:43:58.247820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644a5e-38a4-48d9-9fb1-e03e3ae14cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:43:58.338448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ec644a5e-38a4-48d9-9fb1-e03e3ae14cb6 None None] MFA Rules not processed for user `501e2ac3eb6a49a390d0a2eed38300ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:43:58.342207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec644a5e-38a4-48d9-9fb1-e03e3ae14cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:43:58.535670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2992/6012] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:01.511955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d5f4-1a40-434a-85e0-286b591d9fb0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:01.512853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d5f4-1a40-434a-85e0-286b591d9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:01.513271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d5f4-1a40-434a-85e0-286b591d9fb0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:01.515344 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3021/6013] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 14:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:44:01.521924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:01.522876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:01.529224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:01.552506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:01.553988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:01.569802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2993/6014] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:01.589133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d5f4-1a40-434a-85e0-286b591d9fb0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:01.615984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d5f4-1a40-434a-85e0-286b591d9fb0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:01.628137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:01.629914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:01.630544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:01.632843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:01.655391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:01.661087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:01.686508 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3022/6015] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:10.188998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:10.207206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6c37-216d-4810-aeed-ec046e119cdc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:10.219408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:10.221262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:10.221643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:10.222168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] PATH_INFO: `/v3/users/501e2ac3eb6a49a390d0a2eed38300ca` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:10.224675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=501e2ac3eb6a49a390d0a2eed38300ca)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:10.229665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:10.540591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501e2ac3eb6a49a390d0a2eed38300ca'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:10.542260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501e2ac3eb6a49a390d0a2eed38300ca'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:10.675117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501e2ac3eb6a49a390d0a2eed38300ca'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:10.705321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501e2ac3eb6a49a390d0a2eed38300ca'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:10.717172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501e2ac3eb6a49a390d0a2eed38300ca'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:10.761631 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2994/6016] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:10 2022] DELETE /identity/v3/users/501e2ac3eb6a49a390d0a2eed38300ca => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:11.182095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:11.201885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d4b9c-2a39-4d83-bdd8-9ae9f55d25e5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:11.422382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:11.423231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:11.423610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:11.424129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:11.427649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:11.494379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:11.496143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:11.520649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:11.522733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c8c4-f788-4417-b59d-d33ee7eb8867 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:11.567594 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3023/6017] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:11.644919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:11.655820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b43400-383e-48d8-8540-27739d12ad2e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:11.673703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:11.674474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:11.674852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:11.675252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] PATH_INFO: `/v3/projects/5bc31d316ae84fa3bec83fb814acc08c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:11.676593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc31d316ae84fa3bec83fb814acc08c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:11.678683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:11.906674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc31d316ae84fa3bec83fb814acc08c', 'request_id': 'req-40d84c74-0cef-45d3-810f-16ae007a0732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:12.000584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc31d316ae84fa3bec83fb814acc08c', 'request_id': 'req-40d84c74-0cef-45d3-810f-16ae007a0732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:12.012610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc31d316ae84fa3bec83fb814acc08c', 'request_id': 'req-40d84c74-0cef-45d3-810f-16ae007a0732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:12.041878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] The token cache is being invalidate because project 5bc31d316ae84fa3bec83fb814acc08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:12.042809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:12.044932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-40d84c74-0cef-45d3-810f-16ae007a0732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:12.049477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2995/6018] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:11 2022] DELETE /identity/v3/projects/5bc31d316ae84fa3bec83fb814acc08c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:12.056075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.056663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.057189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.085824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:12.088136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:12.233002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3024/6019] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:12.233657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.234956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.235338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.274475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:12.274475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:12.297325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2996/6020] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:12.302348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:12.314139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10a5f-6d3f-4225-9672-fe65ad8aa4f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:12.319258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:12.319971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.320310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.320664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.321492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:12.321854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:12.323647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:12.331557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:12.347095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:12.356018 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3025/6021] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:12.361170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec7735-c886-482a-9b30-bf6348c71bb1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:12.367369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:12.368192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.368769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.369291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.369924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:12.372082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:12.524918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2997/6022] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:12 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:12.525987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:12.551334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a261-af2d-44f1-96bb-4cc700fa2fc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:12.700490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:12.701173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.701400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.701761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.702307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:12.723465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:12.941917 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3026/6023] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:12 2022] POST /identity/v3/users => generated 283 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:12.942699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:12.953566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415b11e-08d5-4c84-8d06-876d6e9be4ff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:12.959376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:12.960302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:12.960754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:12.961193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:12.962472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:12.965389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:12.981657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2998/6024] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:12.984095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:13.005991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371005-4f72-4c46-9a04-123fb74494ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:13.012498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:13.013571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:13.014012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:13.014947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:13.015857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:13.019354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe56a-732f-4a30-836a-a43fe72d59e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:13.056774 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3027/6025] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:13.059470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:13.069700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779bfc7-e59e-4447-9487-878dcb9862dd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:13.074897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:13.075901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:13.076354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:13.076772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] PATH_INFO: `/v3/projects/adcbc6a0d0594bf5aaf3b5d90747aa1f/users/ac82b56294324f6897516eafeade45eb/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:13.111631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcbc6a0d0594bf5aaf3b5d90747aa1f, user_id=ac82b56294324f6897516eafeade45eb, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:13.121726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:13.271591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 2999/6026] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:13 2022] PUT /identity/v3/projects/adcbc6a0d0594bf5aaf3b5d90747aa1f/users/ac82b56294324f6897516eafeade45eb/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:13.283224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:13.284197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:13.284614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:13.326967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] MFA Rules not processed for user `ac82b56294324f6897516eafeade45eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:13.328293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:13.455037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3028/6027] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:13.467867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:13.470313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:13.608987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961936-855f-4407-bda0-0665ee3703b5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:13.616815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:13.617450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:13.617731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:13.618006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:13.627973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:13.629624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1ddee-dff7-4061-aceb-6390877f2133 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:13.640193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3000/6028] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:13.694846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:13.809939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230e1cb-9e1b-4d45-8a32-501983c7fa9c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:13.842652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:13.843433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:13.843719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:13.843991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] PATH_INFO: `/v3/users/ac82b56294324f6897516eafeade45eb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:13.846138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac82b56294324f6897516eafeade45eb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:13.848233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:13.863996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:14.180917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac82b56294324f6897516eafeade45eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:14.183251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac82b56294324f6897516eafeade45eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:14.292334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac82b56294324f6897516eafeade45eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:14.325248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac82b56294324f6897516eafeade45eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:14.325741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac82b56294324f6897516eafeade45eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:14.352780 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3029/6029] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:13 2022] DELETE /identity/v3/users/ac82b56294324f6897516eafeade45eb => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:14.354381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:14.354703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:14.355011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:14.381741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:14.395016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:14.397393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:14.479618 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3001/6030] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:14.490021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:14.491876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:14.562365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8dd3-5806-463c-98f1-887ab193ce62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:14.566807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:14.567627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:14.567734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:14.568013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:14.589283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:14.589283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f45841-0f73-4e2d-84b5-2262eff5e9f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:14.591293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3030/6031] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:16.042593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:16.044162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:16.067781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7eaf6-3278-4c52-bf7f-df296812a14a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:16.108314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:16.108999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:16.109287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:16.109566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] PATH_INFO: `/v3/projects/adcbc6a0d0594bf5aaf3b5d90747aa1f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:16.118559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcbc6a0d0594bf5aaf3b5d90747aa1f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:16.133220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:16.421121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcbc6a0d0594bf5aaf3b5d90747aa1f', 'request_id': 'req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:16.556288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcbc6a0d0594bf5aaf3b5d90747aa1f', 'request_id': 'req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:16.571090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcbc6a0d0594bf5aaf3b5d90747aa1f', 'request_id': 'req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:16.602026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] The token cache is being invalidate because project adcbc6a0d0594bf5aaf3b5d90747aa1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:16.602321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:16.603028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-be1bf1df-0e82-49ca-8bc9-0d7283803e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:16.604911 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3002/6032] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:16 2022] DELETE /identity/v3/projects/adcbc6a0d0594bf5aaf3b5d90747aa1f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:16.611586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:16.617718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:16.617718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:16.640839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:16.649552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:16.774483 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3031/6033] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:16.879155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:16.880073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:16.880073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:16.924236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:16.925481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:16.943392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3003/6034] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:16.959964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:16.986571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7080-d5b1-4bb6-bd01-8804d848d18a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:16.996945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:16.997583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:16.997905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:16.998146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:16.998882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:17.009702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.009702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.019821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3032/6035] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:17.023915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:17.035005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5375f5-59da-425b-b348-ff93121498f0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:17.044781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:17.046205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.046817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.047331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.048764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.051173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.209906 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3004/6036] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:17 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:17.210147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:17.223590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac9db-0b84-4ae7-b802-075a09210fd2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:17.256513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:17.358251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:17.382366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.382879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.383916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.399247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.404835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.556556 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3033/6037] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:17 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:17.560642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:17.583502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201cba-0b61-407f-bdd3-b7e00412667e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:17.591718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:17.592587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.593016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.593432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.594233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.600234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.626023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3005/6038] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:17.629306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:17.648201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123663dd-f62d-4110-9e33-a9db3c54605b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:17.655075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:17.655906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.656292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.656683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.662575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.664723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3827fd-a597-4da0-9832-cf573102e04c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.704113 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3034/6039] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:17.704706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:17.735562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b213c4-9470-4b42-a66e-60c18505c509 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:17.759572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:17.760281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.761191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.762096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] PATH_INFO: `/v3/projects/c9f3249454bb4741aba675bf8fcdbcf9/users/71a179a7789045efb56d0a403271186d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.816152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f3249454bb4741aba675bf8fcdbcf9, user_id=71a179a7789045efb56d0a403271186d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:17.827782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:17.962400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:17.962918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:17.963306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:17.966281 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3006/6040] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:17 2022] PUT /identity/v3/projects/c9f3249454bb4741aba675bf8fcdbcf9/users/71a179a7789045efb56d0a403271186d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:18.016042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] MFA Rules not processed for user `71a179a7789045efb56d0a403271186d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:18.017746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:18.171766 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3035/6041] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:18.177155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:18.263493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:18.328187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80f208-a8b9-433d-b722-fb2f7734a8df admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:18.336398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:18.337377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:18.337882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:18.338336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:18.339248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:18.344020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:18.524159 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3007/6042] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:18 2022] POST /identity/v3/projects => generated 371 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:18.526789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:18.543155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c651e9-95c9-4adf-9ecb-3f44fd48e147 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:18.646746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:18.647681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:18.648066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:18.648413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:18.649849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:18.653773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:18.770193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:18.778819 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3036/6043] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:18 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:18.784296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93693085-e48a-4fcf-bd72-8b23a915c6c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:18.796658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:18.796658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:18.796658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:18.796658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:18.796940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:18.796940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:18.822223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3008/6044] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:18.827208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:18.849015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec567fa-0fbc-4108-ae07-db20c42793c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:18.867721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:18.868793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:18.869263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:18.869724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] PATH_INFO: `/v3/projects/d5554fa7b6224be5b953a262607ab250/users/782ca155f41c4ba6be8f89904d30cc09/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:18.906876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5554fa7b6224be5b953a262607ab250, user_id=782ca155f41c4ba6be8f89904d30cc09, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:18.910318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:19.020788 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3037/6045] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:18 2022] PUT /identity/v3/projects/d5554fa7b6224be5b953a262607ab250/users/782ca155f41c4ba6be8f89904d30cc09/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:19.024607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:19.056851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc3ca-b9be-4a84-a62c-e339ab707fc7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:19.158260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:19.159056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:19.159274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:19.160304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:19.160985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:19.162702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48070706-a141-4ac0-b1df-8741a4ab3735 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:19.186426 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3009/6046] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:19.197853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:19.204761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9403e4-893b-4a5b-b07c-e92c9dd8a178 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:19.221067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:19.221860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:19.222289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:19.222578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] PATH_INFO: `/v3/projects/d5554fa7b6224be5b953a262607ab250/users/782ca155f41c4ba6be8f89904d30cc09/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:19.224864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5554fa7b6224be5b953a262607ab250, user_id=782ca155f41c4ba6be8f89904d30cc09, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:19.229611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:19.255861 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3038/6047] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:19 2022] PUT /identity/v3/projects/d5554fa7b6224be5b953a262607ab250/users/782ca155f41c4ba6be8f89904d30cc09/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:19.266364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:19.266929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:19.270732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:19.314179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] MFA Rules not processed for user `782ca155f41c4ba6be8f89904d30cc09`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:19.315439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:19.339043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:19.477820 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3010/6048] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:19.486246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:19.500029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760eb82-cb66-4e7e-9fa4-1ac40fcc4234 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:19.530015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:19.530929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:19.531423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:19.532568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:19.535462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:19.540058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:19.769146 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3039/6049] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:44:19 2022] POST /identity/v3/projects => generated 349 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:19.770070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:19.794653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74877-7c7a-416e-b1a1-8d28f60130ec None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:19.896605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:19.897372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:19.897702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:19.897924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:19.898850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:19.901040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.015788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3011/6050] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:19 2022] POST /identity/v3/projects => generated 350 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:20.020013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.022396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:20.048512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71adab-d610-4de3-b179-cdfead23eb6e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.209217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.210094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.210683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.211125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/users/71a179a7789045efb56d0a403271186d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.212634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:get_user(user_id=71a179a7789045efb56d0a403271186d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.215318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.220176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3040/6051] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:44:20 2022] GET /identity/v3/users/71a179a7789045efb56d0a403271186d => generated 288 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:44:20.224690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.241880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a5fc-c683-43cb-9bfb-fcc7af48f27a tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.257338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.258062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.259156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.262506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.262506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.262506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.357730 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3012/6052] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Oct 31 14:44:20 2022] POST /identity/v3/credentials => generated 429 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:20.360223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.384656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd428df6-844a-456a-b7db-55b7c0e2e6e6 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.406527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.407922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.408205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.408480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.411602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.420690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.426223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.427920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.586575 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3041/6053] 10.222.0.13 () {60 vars in 1358 bytes} [Mon Oct 31 14:44:20 2022] PATCH /identity/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0 => generated 436 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:20.589588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.602261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296cc2-7c5a-492d-ba5e-b7d725589d91 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.609980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.610725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.611305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.611415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.614168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.616225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0924c-df60-44f9-ae2e-6387822c35f0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.622454 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3013/6054] 10.222.0.13 () {58 vars in 1335 bytes} [Mon Oct 31 14:44:20 2022] GET /identity/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0 => generated 436 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:20.626801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.638447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312e08e-79d8-4be7-b981-3e2ee3492ba0 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.654111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.654111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.654111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.654583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.654583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.656296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.659063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.659341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.659618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.689751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] MFA Rules not processed for user `a55fa5e6656648faaf79309f68a9f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:20.691435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:20.780161 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3014/6055] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:20.808040 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3042/6056] 10.222.0.13 () {58 vars in 1338 bytes} [Mon Oct 31 14:44:20 2022] DELETE /identity/v3/credentials/91eaa55bac48d1bc77233cea8021e2bc77a665b6c0a420378593c8cc9f3cb3a0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:20.814817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.835132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5efa5-68c0-4576-8e9a-3c3bf73604dc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.841956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.842423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.842735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.843021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.843680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:20.847893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:20.953443 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3015/6057] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Oct 31 14:44:20 2022] POST /identity/v3/credentials => generated 430 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:20.958388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:20.978842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07e71-9157-4b80-a817-7a44e3936dfb tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:20.989802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:20.991524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:20.991979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:20.992422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:20.994138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.006605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.108252 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3043/6058] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Oct 31 14:44:20 2022] POST /identity/v3/credentials => generated 431 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:21.112882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:21.133781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ae5f4-cbd3-4711-b04f-2548dab7c52e tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:21.142368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:21.143091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:21.143672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:21.143790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:21.144368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.146516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.183394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.190965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.212284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.214807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.233805 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3016/6059] 10.222.0.13 () {58 vars in 1140 bytes} [Mon Oct 31 14:44:21 2022] GET /identity/v3/credentials => generated 946 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:21.236307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:21.251121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795fe18-ad70-44f9-8a58-a0ba0be37400 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:21.263468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:21.264130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:21.264414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:21.264693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials/9d5ef2f3f1bf50d517108205801405dd5f939f8812aa53220fcb90304315d84c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:21.268914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=9d5ef2f3f1bf50d517108205801405dd5f939f8812aa53220fcb90304315d84c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.277925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.374511 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3044/6060] 10.222.0.13 () {58 vars in 1338 bytes} [Mon Oct 31 14:44:21 2022] DELETE /identity/v3/credentials/9d5ef2f3f1bf50d517108205801405dd5f939f8812aa53220fcb90304315d84c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:21.379543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:21.393878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cc77-e4bb-436c-8055-6209117faae4 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:21.418961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:21.419631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:21.419919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:21.420194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/credentials/156df6b4c1f1719d6af8953f184433a6dbcc9ea456e6882ab3d80d26fc0f2fe9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:21.427941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=156df6b4c1f1719d6af8953f184433a6dbcc9ea456e6882ab3d80d26fc0f2fe9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.433510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.588623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3017/6061] 10.222.0.13 () {58 vars in 1338 bytes} [Mon Oct 31 14:44:21 2022] DELETE /identity/v3/credentials/156df6b4c1f1719d6af8953f184433a6dbcc9ea456e6882ab3d80d26fc0f2fe9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:21.589309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:21.602153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cbfa-a5a3-4325-a25b-8e445e797ec1 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:21.615474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:21.616127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:21.616464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:21.616843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/projects/6c56b5b5b0af4814a95398dad2436806` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:21.618945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c56b5b5b0af4814a95398dad2436806)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:21.621045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:21.768218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c56b5b5b0af4814a95398dad2436806', 'request_id': 'req-687e5957-a965-43a1-b9d7-39383b4078c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:21.855507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c56b5b5b0af4814a95398dad2436806', 'request_id': 'req-687e5957-a965-43a1-b9d7-39383b4078c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:21.857971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:21.864081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c56b5b5b0af4814a95398dad2436806', 'request_id': 'req-687e5957-a965-43a1-b9d7-39383b4078c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:21.890595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] The token cache is being invalidate because project 6c56b5b5b0af4814a95398dad2436806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:21.891763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:21.892733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:21.897227 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3045/6062] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:21 2022] DELETE /identity/v3/projects/6c56b5b5b0af4814a95398dad2436806 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:21.900937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:21.903018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:21.925670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dcacc-7fcf-4115-9007-dce060edcbaa tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:22.041578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:22.051128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ca155f41c4ba6be8f89904d30cc09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5554fa7b6224be5b953a262607ab250', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:22.051775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:22.052061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:22.052785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] PATH_INFO: `/v3/projects/070bbb8229fd4a5da14e2072c0ed26f7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:22.053835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorizing `identity:delete_project(project_id=070bbb8229fd4a5da14e2072c0ed26f7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:22.055966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:22.194761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070bbb8229fd4a5da14e2072c0ed26f7', 'request_id': 'req-615e18ad-f0d2-4c68-a38d-c17f95240732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.286547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070bbb8229fd4a5da14e2072c0ed26f7', 'request_id': 'req-615e18ad-f0d2-4c68-a38d-c17f95240732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.294223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070bbb8229fd4a5da14e2072c0ed26f7', 'request_id': 'req-615e18ad-f0d2-4c68-a38d-c17f95240732'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.320090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] The token cache is being invalidate because project 070bbb8229fd4a5da14e2072c0ed26f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:22.320394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.323526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-615e18ad-f0d2-4c68-a38d-c17f95240732 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.330205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3018/6063] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:21 2022] DELETE /identity/v3/projects/070bbb8229fd4a5da14e2072c0ed26f7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:22.331148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:22.332729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:22.467204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5957-a965-43a1-b9d7-39383b4078c7 tempest-CredentialsTestJSON-22476838 tempest-CredentialsTestJSON-22476838-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:22.618406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:22.620265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:22.620742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:22.621186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] PATH_INFO: `/v3/users/71a179a7789045efb56d0a403271186d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:22.626896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a179a7789045efb56d0a403271186d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:22.631588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:22.895846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a179a7789045efb56d0a403271186d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.897244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a179a7789045efb56d0a403271186d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.966867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a179a7789045efb56d0a403271186d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.983183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a179a7789045efb56d0a403271186d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:22.984097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a179a7789045efb56d0a403271186d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:23.001274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3046/6064] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:22 2022] DELETE /identity/v3/users/71a179a7789045efb56d0a403271186d => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:23.005752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:23.006252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:23.006778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:23.028460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:23.029950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:23.101234 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3019/6065] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:23.108950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:23.110814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:23.230454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf909a0-da73-4487-90dc-22989823a0dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:23.241620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:23.242312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:23.242592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:23.242884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:23.263128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:23.264865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:23.285847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3047/6066] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:23.445302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:23.921717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:23.923944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:23.947026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb165287-cfdc-4abf-820e-275de49df547 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:23.959375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:23.960043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:23.960330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:23.960607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] PATH_INFO: `/v3/projects/c9f3249454bb4741aba675bf8fcdbcf9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:23.963466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f3249454bb4741aba675bf8fcdbcf9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:23.965423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:24.015976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:24.018677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:24.040097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c16854-6c46-4879-8db6-1a20e89b4fc7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:24.046295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:24.046494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:24.046825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:24.047098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] PATH_INFO: `/v3/users/85ae2b75ac0a4e9e90055869d3d5840a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:24.049936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ae2b75ac0a4e9e90055869d3d5840a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:24.052235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:24.124339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f3249454bb4741aba675bf8fcdbcf9', 'request_id': 'req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.253816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f3249454bb4741aba675bf8fcdbcf9', 'request_id': 'req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.263166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f3249454bb4741aba675bf8fcdbcf9', 'request_id': 'req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.275623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ae2b75ac0a4e9e90055869d3d5840a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.277571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ae2b75ac0a4e9e90055869d3d5840a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.281541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] The token cache is being invalidate because project c9f3249454bb4741aba675bf8fcdbcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:24.281845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.282734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.284840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3020/6067] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:23 2022] DELETE /identity/v3/projects/c9f3249454bb4741aba675bf8fcdbcf9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:24.290023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:24.291905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:24.308931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:24.373404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeff93-ebf2-4be8-a705-c8f49ec6374a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:24.384482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:24.385406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:24.386480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:24.387148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] PATH_INFO: `/v3/users/782ca155f41c4ba6be8f89904d30cc09` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:24.388936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] RBAC: Authorizing `identity:delete_user(user_id=782ca155f41c4ba6be8f89904d30cc09)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:24.392683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:24.416500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ae2b75ac0a4e9e90055869d3d5840a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.448016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ae2b75ac0a4e9e90055869d3d5840a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.450408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf8cf200-ec86-4a4f-a0a3-11341c0d583f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ae2b75ac0a4e9e90055869d3d5840a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.468969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3048/6068] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:24 2022] DELETE /identity/v3/users/85ae2b75ac0a4e9e90055869d3d5840a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:24.473811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:24.474148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:24.474570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:24.511843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:24.513058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:24.613584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3049/6069] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:24.629187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:24.631823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:24.701750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782ca155f41c4ba6be8f89904d30cc09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.702438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782ca155f41c4ba6be8f89904d30cc09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.717667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5884e6e-1f91-47c4-a532-49599e0eba7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:24.723306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:24.724224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:24.724224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:24.724475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:24.726480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:24.740691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:24.742065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:24.758010 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3050/6070] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:24.832733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782ca155f41c4ba6be8f89904d30cc09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.852681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782ca155f41c4ba6be8f89904d30cc09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.853645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47e8dbc0-d2ab-4828-8be8-5de3022f962f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782ca155f41c4ba6be8f89904d30cc09'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:24.878021 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3021/6071] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:24 2022] DELETE /identity/v3/users/782ca155f41c4ba6be8f89904d30cc09 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:25.210985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:25.215391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:25.216851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:25.233586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53f19-5c3a-42bf-bcf2-c9f6f8cab9d2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:25.342611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:25.343428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.343781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.344121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] PATH_INFO: `/v3/projects/6672c55c92024a93a26e594a8ee5bb86` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.346397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6672c55c92024a93a26e594a8ee5bb86)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:25.349502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:25.498110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6672c55c92024a93a26e594a8ee5bb86', 'request_id': 'req-e8441032-661d-49a6-b735-b668c7794409'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:25.581848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6672c55c92024a93a26e594a8ee5bb86', 'request_id': 'req-e8441032-661d-49a6-b735-b668c7794409'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:25.589097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6672c55c92024a93a26e594a8ee5bb86', 'request_id': 'req-e8441032-661d-49a6-b735-b668c7794409'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:25.628927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] The token cache is being invalidate because project 6672c55c92024a93a26e594a8ee5bb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:25.629248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:25.629939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:25.636298 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3051/6072] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:25 2022] DELETE /identity/v3/projects/6672c55c92024a93a26e594a8ee5bb86 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:25.638061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0720b-8a08-4322-aa06-2224347634aa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.638648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0720b-8a08-4322-aa06-2224347634aa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.638648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0720b-8a08-4322-aa06-2224347634aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.681131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b1c0720b-8a08-4322-aa06-2224347634aa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:25.682474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b1c0720b-8a08-4322-aa06-2224347634aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:25.854021 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3022/6073] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:25.861180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:25.862503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.862678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:25.863250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.863632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.887979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:25.890041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:25.890406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8441032-661d-49a6-b735-b668c7794409 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:25.911275 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3023/6074] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:25.911404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:25.911660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:25.912221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.912510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.912790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] PATH_INFO: `/v3/users/72de694183464b51875ad1f7fc0d1b43` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.918204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72de694183464b51875ad1f7fc0d1b43)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:25.920374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:25.924679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65963c32-9d98-46d1-ac99-95847580f38b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:25.931108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:25.932486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.933080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.933574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.934444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:25.934953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:25.937072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:25.954466 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3024/6075] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:25.958549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:25.983059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478221a4-e571-40cc-aa5a-df0cc0f12532 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:25.989094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:25.990044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:25.990876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:25.991604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:25.992812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:25.995427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:26.053004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:26.136510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3025/6076] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:25 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:26.137372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:26.142248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.243552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72de694183464b51875ad1f7fc0d1b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.245257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72de694183464b51875ad1f7fc0d1b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.291252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec53b-9232-4d84-b3c3-2639c9387986 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:26.315751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:26.316916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.317381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.318033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] PATH_INFO: `/v3/projects/d5554fa7b6224be5b953a262607ab250` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.319924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5554fa7b6224be5b953a262607ab250)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:26.323179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:26.362188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72de694183464b51875ad1f7fc0d1b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.392809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72de694183464b51875ad1f7fc0d1b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.394664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72de694183464b51875ad1f7fc0d1b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.416059 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3052/6077] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:25 2022] DELETE /identity/v3/users/72de694183464b51875ad1f7fc0d1b43 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:26.417851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:26.419926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.540565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5554fa7b6224be5b953a262607ab250', 'request_id': 'req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.558862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d49ff9-8d90-4276-ad79-e73455868adb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:26.654902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:26.655597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.655944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.656221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.657642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:26.660117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f1608-c972-4530-9d1b-c6765188f6c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:26.715930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5554fa7b6224be5b953a262607ab250', 'request_id': 'req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.725695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5554fa7b6224be5b953a262607ab250', 'request_id': 'req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.747997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] The token cache is being invalidate because project d5554fa7b6224be5b953a262607ab250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:26.748294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.749745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0f400c75-8ac6-498c-86eb-ad8ac61a34e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:26.755709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3026/6078] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:26 2022] DELETE /identity/v3/projects/d5554fa7b6224be5b953a262607ab250 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:26.757360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.758270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.758568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.788922 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3053/6079] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:26 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:26.793800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.794033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.794305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.802939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:26.804804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.813793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:26.839682 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3027/6080] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:26.840555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:26.842430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.851006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:26.861476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.878099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5d43a-9b77-4f4a-95cb-e6ef06a16893 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:26.883849 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3054/6081] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:26.884835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:26.886454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.888168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:26.888795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.889761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.889761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.890006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:26.891714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc071b-12b1-466f-9f3e-da290d098498 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:26.914950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3028/6082] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:26.918488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.918488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.918488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.944963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:26.946171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:26.966559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3029/6083] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:26.967890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:26.982357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4e986-4580-43e7-82d5-acaaa536c964 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:26.990218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:26.990868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:26.991151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:26.991424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:26.992064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:26.993678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.014446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3030/6084] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:27.015602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.019989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebf909-e581-48d4-933f-b6adb0c1aa8c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.031408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5d471-af01-4dbb-bbf3-be4bce264e1c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.033326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.033955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.034234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.034506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.046906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.047728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.048013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.048288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.048945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:27.049248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.050900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.053269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.054795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.073772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3055/6085] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:27.075594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.083878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3031/6086] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:27.088342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.095633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c591-1254-4ac4-a603-85da69a0a09a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.102442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.102967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.103272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.103501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] PATH_INFO: `/v3/projects/1f7a7c89548e48f3ad1715595e7a2a39/users/a9f65822df7d4f2cb366f3eb1b35066c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.118877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3215e35-d1dd-46f3-b30c-975f62dae23d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.132531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.133978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.135188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.136999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.138704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.145019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7a7c89548e48f3ad1715595e7a2a39, user_id=a9f65822df7d4f2cb366f3eb1b35066c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.145469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.145571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebf35a-2a3a-4ec9-9496-4a968ccccec5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.247108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3056/6087] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:27 2022] PUT /identity/v3/projects/1f7a7c89548e48f3ad1715595e7a2a39/users/a9f65822df7d4f2cb366f3eb1b35066c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:27.268665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.273739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.282585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.314280 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3032/6088] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:27 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:27.316758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.335925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] MFA Rules not processed for user `a9f65822df7d4f2cb366f3eb1b35066c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:27.337181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:27.440650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:27.459384 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3057/6089] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:27.475825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.482279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730bb5-218d-4b04-866e-77ddf1f245f8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.496152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.499382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.500076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.501816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.507921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.510886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.590251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c9150-8f57-4775-9268-0ba397b906fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.594817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.595598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.595979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.596403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.606847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.608651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.620758 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3058/6090] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:27.650723 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3033/6091] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:27 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:27.655469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.667362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4aeed-9664-47c6-b6c6-95475edd1d55 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.672509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.673546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.673834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.674115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.674811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.676464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.690189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3059/6092] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:27.694502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.706405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5307567-70cb-4c0a-8686-e7b314109d7a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.711891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.712850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.713170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.713507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.714355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.716086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef4d12-67cd-44ea-865c-9944ab116cc9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.734672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3034/6093] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:27.739300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:27.754100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844cec8-e16e-46ec-b9d3-74ce92d8133d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:27.762352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:27.763238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.763621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.764504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] PATH_INFO: `/v3/projects/4ae7a56160204d72900f71a89598ee4f/users/fc94cc44313d4b4f9cf8f7e8cf1b2114/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.788513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae7a56160204d72900f71a89598ee4f, user_id=fc94cc44313d4b4f9cf8f7e8cf1b2114, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:27.793149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:27.901024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3060/6094] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:27 2022] PUT /identity/v3/projects/4ae7a56160204d72900f71a89598ee4f/users/fc94cc44313d4b4f9cf8f7e8cf1b2114/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:27.911273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:27.911565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:27.911841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:27.969954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] MFA Rules not processed for user `fc94cc44313d4b4f9cf8f7e8cf1b2114`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:27.971963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:28.108675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3035/6095] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:28.115213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.159162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:28.212802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2346-17f6-47e3-82f1-11ae198f4993 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.215836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.217646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:28.224309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.225449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.225970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.226438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.227246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.229506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.252761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e6f1-dec0-4dd9-a900-ca501a2155dc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.289054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.289693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.291572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.291754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] PATH_INFO: `/v3/projects/d82318e328a24319a37950fe236a87f5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.295268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82318e328a24319a37950fe236a87f5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.299579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.379292 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3061/6096] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:28.382358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.455063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82318e328a24319a37950fe236a87f5', 'request_id': 'req-cc53ea97-267a-44c4-ab84-30d9104c73c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:28.461441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44efe-bb9a-4973-a71b-366d3b0d3b98 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.527908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.528695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.529098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.529499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.530139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.532723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.541139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82318e328a24319a37950fe236a87f5', 'request_id': 'req-cc53ea97-267a-44c4-ab84-30d9104c73c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:28.550642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82318e328a24319a37950fe236a87f5', 'request_id': 'req-cc53ea97-267a-44c4-ab84-30d9104c73c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:28.563243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] The token cache is being invalidate because project d82318e328a24319a37950fe236a87f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:28.563893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:28.564809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc53ea97-267a-44c4-ab84-30d9104c73c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:28.566726 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3036/6097] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:28 2022] DELETE /identity/v3/projects/d82318e328a24319a37950fe236a87f5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:28.571611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c8b4-23c3-42d7-9c7b-97cc8ac4c9c4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.572050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c8b4-23c3-42d7-9c7b-97cc8ac4c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.572427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c8b4-23c3-42d7-9c7b-97cc8ac4c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.595982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8d23c8b4-23c3-42d7-9c7b-97cc8ac4c9c4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:28.597257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8d23c8b4-23c3-42d7-9c7b-97cc8ac4c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:28.613049 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3037/6098] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:28.616187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.616328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.616525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.656381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:28.658858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:28.665467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3062/6099] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:28.666451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.668156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:28.680223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3038/6100] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:28.681064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.692127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f802f3a-2bcb-4f4d-8794-a24046c8c100 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.694660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37508273-2709-4601-a0b8-7375f66881fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.697540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.698479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.698950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.699396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.700335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:28.700784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.701448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.702745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.702919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.703159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.703521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.706671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.706833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.725173 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3063/6101] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:28.726002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.733575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3039/6102] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:28.738551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.738793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2263ea-ded4-4d80-b1f9-4a059456f1f5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.745694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.746438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.746876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.747186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] PATH_INFO: `/v3/projects/5db691eef0e144e297eb0f6ecfcc1117/users/472e8d1ca5ed4b67bf5db61bf1964284/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.755973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49411b2-ce46-4bbc-a7c3-a319fe9eba93 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:28.762589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:28.763238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:28.763521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:28.763881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:28.764517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.766585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.767282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db691eef0e144e297eb0f6ecfcc1117, user_id=472e8d1ca5ed4b67bf5db61bf1964284, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:28.770533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:28.852765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3064/6103] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:28 2022] PUT /identity/v3/projects/5db691eef0e144e297eb0f6ecfcc1117/users/472e8d1ca5ed4b67bf5db61bf1964284/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:28.856760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.918228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3040/6104] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:28.923286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:28.964923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830df47-f068-44f4-b906-97b60d84b97a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.041519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea92e-8f78-4a27-82b1-0172dc7382a5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.049097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:29.051875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.052505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.053128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.053583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.054223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.055341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.056139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.056349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.056470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.056684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.057335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.059729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.076640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3065/6105] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:29.077720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.088817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9dbf4-0f55-4506-a358-b5a124fa6df1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.098144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.099045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.099910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.100196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] PATH_INFO: `/v3/projects/5db691eef0e144e297eb0f6ecfcc1117/users/472e8d1ca5ed4b67bf5db61bf1964284/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.102150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db691eef0e144e297eb0f6ecfcc1117, user_id=472e8d1ca5ed4b67bf5db61bf1964284, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.104976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6c649-75c7-43be-8795-19ff429d2f08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.117384 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3066/6106] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:29 2022] PUT /identity/v3/projects/5db691eef0e144e297eb0f6ecfcc1117/users/472e8d1ca5ed4b67bf5db61bf1964284/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:29.129213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.129513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.129775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.169835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] MFA Rules not processed for user `472e8d1ca5ed4b67bf5db61bf1964284`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:29.171091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:29.171982 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3041/6107] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:28 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:29.178877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.208650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab9f35-d869-461c-a956-7f9c313c8922 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.290655 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3067/6108] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:29.293926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.307235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c655e-d30c-4c6c-b8a5-6f533908448c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.313311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.314481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.314962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.315414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.316217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.316482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.317102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.317378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.317647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.318284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.319639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.320030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.337961 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3042/6109] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:29.346814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.360945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc187-30a2-4a52-a82b-d7b9e008bb05 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.366248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.367055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.367192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.367436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.368083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.369791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.382740 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3043/6110] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:29.387049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.398835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d851-2054-4e05-97db-9406f4d48da6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.405077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.405944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.406056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.406315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] PATH_INFO: `/v3/projects/aa3a33246fdf43b19b714b30fe88754e/users/daf5210d56f14f459af7d9d6b30ee5c5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.425391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3a33246fdf43b19b714b30fe88754e, user_id=daf5210d56f14f459af7d9d6b30ee5c5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.428174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c59218-fbd7-4caa-a86a-726ed108ea43 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.435606 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3068/6111] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:29 2022] POST /identity/v3/projects => generated 333 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:29.436063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.499462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d7c4-924d-4fda-9737-aeaa440ef3af tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.504416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.505054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.505330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.505600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.506257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.511101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.529917 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3044/6112] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:29 2022] PUT /identity/v3/projects/aa3a33246fdf43b19b714b30fe88754e/users/daf5210d56f14f459af7d9d6b30ee5c5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:29.540995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.541282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.544485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.579415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] MFA Rules not processed for user `daf5210d56f14f459af7d9d6b30ee5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:29.583587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:29.653241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3069/6113] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:44:29 2022] POST /identity/v3/projects => generated 333 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:29.657986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.671573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3045/6114] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:29.684831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.686927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:29.761329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae6761-b5cf-421b-9777-e292dc009b10 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.764101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:29.769797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.770903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.771028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.771317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.772078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.774381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.779113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32713e-4ee9-4960-9103-a033f9093fa8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.842600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.843581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.843865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.844820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.891576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3070/6115] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:29 2022] POST /identity/v3/projects => generated 357 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:29.893164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:29.924264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.925811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:29.936539 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3046/6116] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:29.974705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffb0b-4657-4482-ae27-eb99b7ee8a1c tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:29.979936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:29.980685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:29.980983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:29.981257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:29.981906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:29.984257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:30.011834 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3071/6117] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:44:29 2022] GET /identity/v3/projects => generated 7569 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:30.017448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:30.035578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe17c1-9d86-478f-8e39-b01738231bf2 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:30.055930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:30.060695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:30.060695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:30.060695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:30.060695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:30.060695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:30.061216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:30.086172 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3047/6118] 10.222.0.13 () {58 vars in 1158 bytes} [Mon Oct 31 14:44:30 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:30.092220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:30.098192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19a21b-7a0b-4757-84cc-4e239e81b44b tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:30.104793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:30.105614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:30.105907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:30.106186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:30.106939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Adding query filter params (parent_id=bd47899663c7487b99e7f1747b36f496) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:30.107235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:30.110520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:30.133076 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3072/6119] 10.222.0.13 () {58 vars in 1216 bytes} [Mon Oct 31 14:44:30 2022] GET /identity/v3/projects?parent_id=bd47899663c7487b99e7f1747b36f496 => generated 497 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:30.138241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:30.151804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca894ba-923f-460a-8b56-c84900456d71 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:30.162708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:30.162708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:30.162708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:30.162949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects/74a6d03e37144a08b20cf2d47f82e8ef` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:30.162949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74a6d03e37144a08b20cf2d47f82e8ef)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:30.162949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:30.311990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a6d03e37144a08b20cf2d47f82e8ef', 'request_id': 'req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.408531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:30.410173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a6d03e37144a08b20cf2d47f82e8ef', 'request_id': 'req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.416460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a6d03e37144a08b20cf2d47f82e8ef', 'request_id': 'req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.428686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] The token cache is being invalidate because project 74a6d03e37144a08b20cf2d47f82e8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:30.428995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.430305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.433254 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3048/6120] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:30 2022] DELETE /identity/v3/projects/74a6d03e37144a08b20cf2d47f82e8ef => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:30.437700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:30.440767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:30.454767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4022-427c-4571-a4d6-6d7dd7a1dbac tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:30.558024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:30.558371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:30.558680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:30.559747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects/bd47899663c7487b99e7f1747b36f496` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:30.560095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd47899663c7487b99e7f1747b36f496)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:30.562299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:30.695944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd47899663c7487b99e7f1747b36f496', 'request_id': 'req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.758248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd47899663c7487b99e7f1747b36f496', 'request_id': 'req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.767143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd47899663c7487b99e7f1747b36f496', 'request_id': 'req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.780404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] The token cache is being invalidate because project bd47899663c7487b99e7f1747b36f496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:30.780700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.781524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:30.784214 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3073/6121] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:30 2022] DELETE /identity/v3/projects/bd47899663c7487b99e7f1747b36f496 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:30.788205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:30.800462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1f22-de4c-41a0-a24e-8f9c762f6345 tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:30.878176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '472e8d1ca5ed4b67bf5db61bf1964284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5db691eef0e144e297eb0f6ecfcc1117', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:30.878777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:30.878894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:30.879108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:30.879324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] PATH_INFO: `/v3/projects/df00783ddb264d2a98f8f7231163b4ac` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:30.880481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df00783ddb264d2a98f8f7231163b4ac)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:30.882437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:31.000577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df00783ddb264d2a98f8f7231163b4ac', 'request_id': 'req-d8905e4c-ff01-46f7-b97a-7406fdeb731f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.087744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df00783ddb264d2a98f8f7231163b4ac', 'request_id': 'req-d8905e4c-ff01-46f7-b97a-7406fdeb731f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.096613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df00783ddb264d2a98f8f7231163b4ac', 'request_id': 'req-d8905e4c-ff01-46f7-b97a-7406fdeb731f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.117008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] The token cache is being invalidate because project df00783ddb264d2a98f8f7231163b4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:31.117362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.118051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d8905e4c-ff01-46f7-b97a-7406fdeb731f tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.120836 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3049/6122] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:30 2022] DELETE /identity/v3/projects/df00783ddb264d2a98f8f7231163b4ac => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:31.139762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:31.141542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:31.221730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cbc2e-d4b5-49a7-ba21-8eae3cf00ead tempest-ListProjectsTestJSON-69005375 tempest-ListProjectsTestJSON-69005375-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:31.284416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:31.285234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:31.285509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:31.285783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] PATH_INFO: `/v3/users/fc94cc44313d4b4f9cf8f7e8cf1b2114` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:31.287737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc94cc44313d4b4f9cf8f7e8cf1b2114)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:31.289644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:31.548301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc94cc44313d4b4f9cf8f7e8cf1b2114'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.549690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc94cc44313d4b4f9cf8f7e8cf1b2114'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.644101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc94cc44313d4b4f9cf8f7e8cf1b2114'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.657136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc94cc44313d4b4f9cf8f7e8cf1b2114'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.657819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc94cc44313d4b4f9cf8f7e8cf1b2114'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:31.669906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3074/6123] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:31 2022] DELETE /identity/v3/users/fc94cc44313d4b4f9cf8f7e8cf1b2114 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:31.674909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef6da-72c2-4fc0-a51f-f6d559596872 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:31.675195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef6da-72c2-4fc0-a51f-f6d559596872 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:31.675469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef6da-72c2-4fc0-a51f-f6d559596872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:31.695512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4fdef6da-72c2-4fc0-a51f-f6d559596872 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:31.696774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4fdef6da-72c2-4fc0-a51f-f6d559596872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:31.849795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3050/6124] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:31.858597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:31.860925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:31.986092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae463a-c295-4136-9105-c95f2158c1ae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:31.990456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:31.991209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:31.991639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:31.992259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:32.002607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:32.004074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:32.015138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3075/6125] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:32.040978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:32.395315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:32.395707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:32.395981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:32.422792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] MFA Rules not processed for user `2857f070fe4f4625bf6a1e866863ea0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:32.424255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:32.519729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3051/6126] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:32.544318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:32.545949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:32.566256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14acd-b154-42c6-bca0-d8bccedae648 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:32.599438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:32.600121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:32.600385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:32.600654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] PATH_INFO: `/v3/projects/4ae7a56160204d72900f71a89598ee4f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:32.605796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae7a56160204d72900f71a89598ee4f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:32.610937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:32.614820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:32.808182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae7a56160204d72900f71a89598ee4f', 'request_id': 'req-1629097f-c039-4a80-aa69-249597a465a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:32.843723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:32.892306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae7a56160204d72900f71a89598ee4f', 'request_id': 'req-1629097f-c039-4a80-aa69-249597a465a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:32.899946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae7a56160204d72900f71a89598ee4f', 'request_id': 'req-1629097f-c039-4a80-aa69-249597a465a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:32.941239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] The token cache is being invalidate because project 4ae7a56160204d72900f71a89598ee4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:32.942399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:32.944475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:32.946708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3076/6127] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:32 2022] DELETE /identity/v3/projects/4ae7a56160204d72900f71a89598ee4f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:32.950980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:32.967949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2102f-ec5e-48eb-8193-b9f37b5ad0a8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:33.076309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:33.077016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:33.077297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:33.077775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] PATH_INFO: `/v3/users/472e8d1ca5ed4b67bf5db61bf1964284` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:33.079775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472e8d1ca5ed4b67bf5db61bf1964284)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:33.081756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:33.391804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472e8d1ca5ed4b67bf5db61bf1964284'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:33.392501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472e8d1ca5ed4b67bf5db61bf1964284'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:33.492675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472e8d1ca5ed4b67bf5db61bf1964284'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:33.509755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472e8d1ca5ed4b67bf5db61bf1964284'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:33.511055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-14bb5639-0dfc-4664-aa0b-a37bca522bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472e8d1ca5ed4b67bf5db61bf1964284'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:33.527415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3052/6128] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:32 2022] DELETE /identity/v3/users/472e8d1ca5ed4b67bf5db61bf1964284 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:34.125952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:34.333195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:34.335835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:34.359696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629097f-c039-4a80-aa69-249597a465a4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:34.459321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:34.460134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:34.460511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:34.460898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] PATH_INFO: `/v3/projects/5db691eef0e144e297eb0f6ecfcc1117` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:34.462334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db691eef0e144e297eb0f6ecfcc1117)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:34.464648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:34.698552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db691eef0e144e297eb0f6ecfcc1117', 'request_id': 'req-98803b13-66ab-41a6-b693-73d72aac557d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:34.831097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db691eef0e144e297eb0f6ecfcc1117', 'request_id': 'req-98803b13-66ab-41a6-b693-73d72aac557d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:34.839078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db691eef0e144e297eb0f6ecfcc1117', 'request_id': 'req-98803b13-66ab-41a6-b693-73d72aac557d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:34.860496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] The token cache is being invalidate because project 5db691eef0e144e297eb0f6ecfcc1117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:34.860753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:34.863558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98803b13-66ab-41a6-b693-73d72aac557d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:34.868816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3077/6129] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:34 2022] DELETE /identity/v3/projects/5db691eef0e144e297eb0f6ecfcc1117 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:34.874810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:34.875314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:34.875483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:34.919386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:34.920804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:34.993327 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3053/6130] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:35.001544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.001847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.002105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.037951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:35.039248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:35.060664 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3078/6131] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:35.065469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.099841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc91c4-a65c-454e-a37d-894e69c60f90 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.124233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.125962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.126494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.127257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.128191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:35.129494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.133319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.152051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3054/6132] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:35.157334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.176742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d982-f72e-4839-bd87-a5b7b160e0c0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.195734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.196460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.196739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.197013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.201361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.208278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.401382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3079/6133] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:35 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:35.403895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.421078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cbfbc-96e1-47ce-8450-77d5edc824fe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.555715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.561298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.561298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.561298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.561298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.561298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.639801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:35.694727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3055/6134] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:35 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:35.698852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.712302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733863f4-0705-4d35-916a-042b7287551f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.738566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.740179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.740560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.740970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.741763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.749347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.775712 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3080/6135] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:35.776234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.792315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73cf1-30d5-4d4a-b7e8-a072491a999c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.803137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.803137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.803137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.804084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.804811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.810644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862b617-5d81-4943-9a04-5513369321c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.850742 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3056/6136] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:35.854165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:35.864561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4587-132d-4889-a72b-9da865b73055 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:35.871348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:35.872041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.872323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.872600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] PATH_INFO: `/v3/projects/2b6ed88c802247c5946ed7ca6a7f3ade/users/1bb157a17d644b0fb5a752f140270127/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:35.889634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6ed88c802247c5946ed7ca6a7f3ade, user_id=1bb157a17d644b0fb5a752f140270127, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:35.892541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:35.986229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3081/6137] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:35 2022] PUT /identity/v3/projects/2b6ed88c802247c5946ed7ca6a7f3ade/users/1bb157a17d644b0fb5a752f140270127/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:35.997623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:35.998131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:35.998241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.049736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] MFA Rules not processed for user `1bb157a17d644b0fb5a752f140270127`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:36.051214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:36.155422 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3057/6138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:36.160263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:36.289961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cd6a-c99a-43c1-840d-f67c016b88a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:36.297948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:36.298752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:36.299286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:36.299569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.300220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:36.302194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:36.358006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:36.434577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:36.441793 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3082/6139] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:36.446455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae777b4-e1b8-4a8a-b83c-f06f841763bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:36.517993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:36.518679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:36.518964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:36.519243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.521619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:36.527445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:36.622553 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3058/6140] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:36 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:36.628690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:36.640474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aaab1-2d46-4073-ab1b-5dde8997565d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:36.646255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:36.647319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:36.647800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:36.648387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.649200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:36.651035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:36.665517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3083/6141] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:36.669612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:36.681748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f12f2-e997-4009-bda8-9580509d68b8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:36.687503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:36.688637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:36.689062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:36.689502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] PATH_INFO: `/v3/projects/056aa495e2694c42bf4d8ef0d214f08b/users/2795f8f7070c4fdb8efb20293e607ecf/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.709085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056aa495e2694c42bf4d8ef0d214f08b, user_id=2795f8f7070c4fdb8efb20293e607ecf, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:36.712407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:36.815042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:36.822701 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3059/6142] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:36 2022] PUT /identity/v3/projects/056aa495e2694c42bf4d8ef0d214f08b/users/2795f8f7070c4fdb8efb20293e607ecf/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:36.843310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246cc3-ee98-49aa-a058-a97282de1c60 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:36.956333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:36.957061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:36.957439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:36.958327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:36.959125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:36.960836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6fbb8-a261-45bd-8fe7-2862e3f9eb01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:36.972696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3084/6143] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:36.976677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:37.000950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93e213-7ccb-4c0f-9bfe-9c7b265491d1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:37.021428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:37.021952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:37.022227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:37.022499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] PATH_INFO: `/v3/projects/056aa495e2694c42bf4d8ef0d214f08b/users/2795f8f7070c4fdb8efb20293e607ecf/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:37.027406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056aa495e2694c42bf4d8ef0d214f08b, user_id=2795f8f7070c4fdb8efb20293e607ecf, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:37.036911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:37.057125 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3060/6144] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:36 2022] PUT /identity/v3/projects/056aa495e2694c42bf4d8ef0d214f08b/users/2795f8f7070c4fdb8efb20293e607ecf/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:37.069115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:37.069535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:37.069921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:37.121283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] MFA Rules not processed for user `2795f8f7070c4fdb8efb20293e607ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:37.121283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:37.184821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:37.215048 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3085/6145] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:37.220772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:37.234825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a74fa-3de7-4eff-8590-760b9238a520 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:37.239821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2795f8f7070c4fdb8efb20293e607ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '056aa495e2694c42bf4d8ef0d214f08b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:37.240565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:37.240941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:37.241360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:37.242144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:37.244661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:37.387557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:37.388999 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3061/6146] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:37 2022] POST /identity/v3/projects => generated 359 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:37.482889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d53aa-e5a8-45e7-b9da-885ab8d8abf1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:37.570911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb157a17d644b0fb5a752f140270127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6ed88c802247c5946ed7ca6a7f3ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:37.571776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:37.572159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:37.572533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] PATH_INFO: `/v3/projects/65ad9d6ebe804dea8042e7b92994cab8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:37.574333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] RBAC: Authorizing `identity:delete_project(project_id=65ad9d6ebe804dea8042e7b92994cab8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 31 14:44:37.583319 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 31 14:44:37.584361 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:44:37.586466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3086/6147] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:37 2022] DELETE /identity/v3/projects/65ad9d6ebe804dea8042e7b92994cab8 => generated 136 bytes in 199 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:44:37.590477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:37.727051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef164f-c7d0-4679-8153-3c51cfb47f06 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:37.741343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2795f8f7070c4fdb8efb20293e607ecf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '056aa495e2694c42bf4d8ef0d214f08b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:37.742479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:37.742787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:37.743059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] PATH_INFO: `/v3/projects/65ad9d6ebe804dea8042e7b92994cab8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:37.747103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65ad9d6ebe804dea8042e7b92994cab8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:37.749225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:37.913144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ad9d6ebe804dea8042e7b92994cab8', 'request_id': 'req-067f1338-382b-4338-8fa9-25363ac6f3b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.006201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ad9d6ebe804dea8042e7b92994cab8', 'request_id': 'req-067f1338-382b-4338-8fa9-25363ac6f3b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.020562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ad9d6ebe804dea8042e7b92994cab8', 'request_id': 'req-067f1338-382b-4338-8fa9-25363ac6f3b8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.064238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] The token cache is being invalidate because project 65ad9d6ebe804dea8042e7b92994cab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:38.064438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.065310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-067f1338-382b-4338-8fa9-25363ac6f3b8 tempest-ProjectsNegativeTestJSON-1881663911 tempest-ProjectsNegativeTestJSON-1881663911-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.068452 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3062/6148] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:37 2022] DELETE /identity/v3/projects/65ad9d6ebe804dea8042e7b92994cab8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:38.073357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:38.076788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:38.195807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bffd9-3716-4bbb-9326-377de1390e47 tempest-ProjectsNegativeTestJSON-369210820 tempest-ProjectsNegativeTestJSON-369210820-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:38.287661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:38.289689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:38.299198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:38.299511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] PATH_INFO: `/v3/users/1bb157a17d644b0fb5a752f140270127` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:38.300959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb157a17d644b0fb5a752f140270127)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:38.303240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:38.311657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:38.580806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb157a17d644b0fb5a752f140270127'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.581514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb157a17d644b0fb5a752f140270127'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.693954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb157a17d644b0fb5a752f140270127'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.711272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb157a17d644b0fb5a752f140270127'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.712545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb157a17d644b0fb5a752f140270127'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:38.730847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3087/6149] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:38 2022] DELETE /identity/v3/users/1bb157a17d644b0fb5a752f140270127 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:38.735498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:38.735780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:38.736056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:38.762395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:38.763957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:38.865818 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3063/6150] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:38.876041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:38.877924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:38.976961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0f2c-a574-47c5-a443-7b910332492b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:38.989026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:38.990182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:38.990791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:38.991503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:39.004476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:39.006674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:39.010308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:39.026876 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3088/6151] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:39.856060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:40.617014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:40.617493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:40.645397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5300b-eee9-4d1b-8b02-fa1ebec252c7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:40.657522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:40.664137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:40.664137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:40.664137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] PATH_INFO: `/v3/projects/2b6ed88c802247c5946ed7ca6a7f3ade` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:40.664137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6ed88c802247c5946ed7ca6a7f3ade)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:40.664137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:40.858561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6ed88c802247c5946ed7ca6a7f3ade', 'request_id': 'req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:40.860755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:40.862329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:40.942462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6ed88c802247c5946ed7ca6a7f3ade', 'request_id': 'req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:40.954031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6ed88c802247c5946ed7ca6a7f3ade', 'request_id': 'req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:40.969778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:40.982295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] The token cache is being invalidate because project 2b6ed88c802247c5946ed7ca6a7f3ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:40.982588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:40.986548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:40.989943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3064/6152] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:40 2022] DELETE /identity/v3/projects/2b6ed88c802247c5946ed7ca6a7f3ade => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:40.993149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7969d-2ce0-474f-ac32-aa1bd31d0803 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:40.995731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:40.997137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:41.143114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:41.144158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:41.156328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:41.156837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:41.160962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:41.182201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:41.186450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:41.190711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe090cb-b4cd-4dd2-bd4c-e71d2fdacde2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:41.208120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:41.208693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:41.208969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:41.209086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3089/6153] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:41.209819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] PATH_INFO: `/v3/users/2795f8f7070c4fdb8efb20293e607ecf` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:41.212888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2795f8f7070c4fdb8efb20293e607ecf)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:41.216032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:41.405896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:41.528780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2795f8f7070c4fdb8efb20293e607ecf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:41.530445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2795f8f7070c4fdb8efb20293e607ecf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:41.621722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2795f8f7070c4fdb8efb20293e607ecf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:41.643786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2795f8f7070c4fdb8efb20293e607ecf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:41.645760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16798764-d8f4-4c45-89cd-644979aec682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2795f8f7070c4fdb8efb20293e607ecf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:41.689634 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3065/6154] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:40 2022] DELETE /identity/v3/users/2795f8f7070c4fdb8efb20293e607ecf => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:42.213093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:43.005297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:43.693009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:43.728047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bf023-b477-498a-8e68-21faa518151b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:43.822496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:43.823620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:43.824784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:43.841152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] PATH_INFO: `/v3/projects/056aa495e2694c42bf4d8ef0d214f08b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:43.846415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056aa495e2694c42bf4d8ef0d214f08b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:43.855154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.045564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056aa495e2694c42bf4d8ef0d214f08b', 'request_id': 'req-d8fc1ca3-8146-45c0-9d93-66cc08e04710'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:44.116713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056aa495e2694c42bf4d8ef0d214f08b', 'request_id': 'req-d8fc1ca3-8146-45c0-9d93-66cc08e04710'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:44.126285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056aa495e2694c42bf4d8ef0d214f08b', 'request_id': 'req-d8fc1ca3-8146-45c0-9d93-66cc08e04710'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:44.143126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] The token cache is being invalidate because project 056aa495e2694c42bf4d8ef0d214f08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:44.143558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:44.148641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d8fc1ca3-8146-45c0-9d93-66cc08e04710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:44.148641 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3090/6155] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:43 2022] DELETE /identity/v3/projects/056aa495e2694c42bf4d8ef0d214f08b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:44.152734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.153537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.153976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.176282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:44.177491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:44.270051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3066/6156] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:44.280382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca491-f072-40a4-bf8a-90612805431e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.280382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca491-f072-40a4-bf8a-90612805431e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.280382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca491-f072-40a4-bf8a-90612805431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.305537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51fca491-f072-40a4-bf8a-90612805431e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:44.306964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51fca491-f072-40a4-bf8a-90612805431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:44.321717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.322716 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3091/6157] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:44.337181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f95fa-0cc3-4309-8f8a-b17634bc0c39 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.341951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.342511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.342830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.343107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.343759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:44.344627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.346235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.362411 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3067/6158] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:44.365800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca491-f072-40a4-bf8a-90612805431e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.376715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca491-f072-40a4-bf8a-90612805431e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.381900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.382562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.382877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.383150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.384035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.386114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.552777 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3092/6159] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:44 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:44.554437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.562273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:44.568294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236511d2-a689-4162-bcab-edbe693a8655 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.672564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.673308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.673666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.674029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.674862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.679317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.767321 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3068/6160] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:44 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:44.771311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.783245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a54f8-ccc7-4093-b5f4-34606f3e81cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.793524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.794912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.795348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.795725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.796506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.799353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.818654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3093/6161] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:44.820258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.831565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89354b26-4c12-43e9-b643-cd53198cf6d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.837914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.838716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.839363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.839759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.840710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.842527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c1398-caa1-4de6-babb-c0f62d29628d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:44.872416 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3069/6162] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:44.881893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:44.893566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a7cc-2fb8-466c-b62b-fbd8f77cf54f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:44.899926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:44.900676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:44.900972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:44.901239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] PATH_INFO: `/v3/projects/a13df01041f74b3bba76649fdca03ab9/users/f5c1db748da34cf7a4f803f41ccd32b2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:44.905631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:44.927911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13df01041f74b3bba76649fdca03ab9, user_id=f5c1db748da34cf7a4f803f41ccd32b2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:44.931190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:45.051550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3094/6163] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:44 2022] PUT /identity/v3/projects/a13df01041f74b3bba76649fdca03ab9/users/f5c1db748da34cf7a4f803f41ccd32b2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:45.062565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.062930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.063273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.108042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] MFA Rules not processed for user `f5c1db748da34cf7a4f803f41ccd32b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:45.109281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:45.209223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3070/6164] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:45.213900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:45.291571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686503e8-7db7-4118-87bc-3da58c277e94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:45.297591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:45.298944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.299226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.299503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.300387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:45.303362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:45.436168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3095/6165] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:45 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:45.440058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:45.453538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0809b-1b19-4ab9-9b1f-e669c85cfafb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:45.538896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:45.540349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.540885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.546467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.546467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:45.547398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:45.648018 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3071/6166] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:45 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:45.650931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:45.662453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d18c-ddb5-422b-862b-3360f7eae762 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:45.667876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:45.668485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.668769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.669040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.669674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:45.671419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:45.685988 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3096/6167] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:45.696970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:45.725516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa561b8-5db9-4d80-9c86-202227b8e8f5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:45.730514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:45.731203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.731489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.731831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] PATH_INFO: `/v3/projects/fd03b898a6ca4a55a86cddf089f9515c/users/ad48300e46a3473c84ba4fb34e7f3bc4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.748322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd03b898a6ca4a55a86cddf089f9515c, user_id=ad48300e46a3473c84ba4fb34e7f3bc4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:45.751898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:45.845879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3072/6168] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:45 2022] PUT /identity/v3/projects/fd03b898a6ca4a55a86cddf089f9515c/users/ad48300e46a3473c84ba4fb34e7f3bc4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:45.855365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:45.879174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3621e3-39ea-4c96-8aa1-9d2bf51cd183 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:45.991184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:45.992170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:45.992637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:45.993280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:45.994499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:45.996498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f63c-6294-48f4-b397-9913d42a9f29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.010662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3097/6169] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:46.013290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.025262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b310d-cc39-4c58-9cdf-b560c068123a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.031088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.032661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.033188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.033664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] PATH_INFO: `/v3/projects/fd03b898a6ca4a55a86cddf089f9515c/users/ad48300e46a3473c84ba4fb34e7f3bc4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.036257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd03b898a6ca4a55a86cddf089f9515c, user_id=ad48300e46a3473c84ba4fb34e7f3bc4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:46.039170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.051569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3073/6170] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:46 2022] PUT /identity/v3/projects/fd03b898a6ca4a55a86cddf089f9515c/users/ad48300e46a3473c84ba4fb34e7f3bc4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:46.063506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9cf-5859-4306-8047-943dac557886 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.063786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9cf-5859-4306-8047-943dac557886 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.064065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ab9cf-5859-4306-8047-943dac557886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.127898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-527ab9cf-5859-4306-8047-943dac557886 None None] MFA Rules not processed for user `ad48300e46a3473c84ba4fb34e7f3bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:46.130795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-527ab9cf-5859-4306-8047-943dac557886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:46.190373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:46.239800 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3098/6171] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:46.241212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.264439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ac56-009c-4c37-863d-d20ffce82417 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.299231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.300204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.301999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.306375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.309930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:46.311984 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:44:46.311984 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:44:46.311984 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:44:46.316128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.427159 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3074/6172] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:44:46 2022] POST /identity/v3/regions => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:46.431131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab9cf-5859-4306-8047-943dac557886 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.452722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ab9cf-5859-4306-8047-943dac557886 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.507969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.508596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.508878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.509156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.513911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:46.518066 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:44:46.518066 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:44:46.518066 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:44:46.519238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.643991 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3099/6173] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:44:46 2022] POST /identity/v3/regions => generated 224 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:46.645324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.663493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fefe-1f8e-44c5-8fd8-e9f82ec71a8b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.713732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.716264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.717163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.718772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/bf6ca557-86a8-4a68-bed1-f33c7a93bb51` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.721900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:create_region(region_id=bf6ca557-86a8-4a68-bed1-f33c7a93bb51)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:46.725743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.756454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:46.768847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.770969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:46.820821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3075/6174] 10.222.0.13 () {60 vars in 1259 bytes} [Mon Oct 31 14:44:46 2022] PUT /identity/v3/regions/bf6ca557-86a8-4a68-bed1-f33c7a93bb51 => generated 231 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:46.824636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:46.874762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fb2fb-118c-46c5-84fe-60fb10e905b4 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.887443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.888043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.888327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.888601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/bf6ca557-86a8-4a68-bed1-f33c7a93bb51` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.889197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bf6ca557-86a8-4a68-bed1-f33c7a93bb51)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:46.896808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:46.902323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ecf1-8599-451b-9e6d-ca4339401b2c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:46.926090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:46.927195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:46.927427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:46.927786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:46.940612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:47.022857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.024724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.037529 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3100/6175] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:44:47.037840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3076/6176] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 14:44:46 2022] DELETE /identity/v3/regions/bf6ca557-86a8-4a68-bed1-f33c7a93bb51 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:47.043331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.060171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432d64b-d6c5-4c14-af45-8a7a6e826705 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.079563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.080938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.080938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.080938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.083069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.093692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.181622 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3101/6177] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:44:47 2022] POST /identity/v3/regions => generated 253 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:47.198556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.212680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be1e63-998d-41be-b7b8-3d70c53af2ea tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.237753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.238425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.238820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.239863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/d87f66ff4d454751ac730c2330ef14e6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.240111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:update_region(region_id=d87f66ff4d454751ac730c2330ef14e6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.241128 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:44:47.241128 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:44:47.241128 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:44:47.242011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.324535 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3077/6178] 10.222.0.13 () {60 vars in 1250 bytes} [Mon Oct 31 14:44:47 2022] PATCH /identity/v3/regions/d87f66ff4d454751ac730c2330ef14e6 => generated 252 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:47.328956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.344721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701ae4-0a0a-4352-91df-6f8a3ce1c6fb tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.383617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.383617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.383617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.383908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/d87f66ff4d454751ac730c2330ef14e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.383908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:get_region(region_id=d87f66ff4d454751ac730c2330ef14e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.383908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.387148 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3102/6179] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:44:47 2022] GET /identity/v3/regions/d87f66ff4d454751ac730c2330ef14e6 => generated 252 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:47.392512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.404460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b15fd-dee8-4178-afb8-179e96af1b7b tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.415080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.415786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.416285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.422723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/d87f66ff4d454751ac730c2330ef14e6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.422723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d87f66ff4d454751ac730c2330ef14e6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.423799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.534366 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3078/6180] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:47 2022] DELETE /identity/v3/regions/d87f66ff4d454751ac730c2330ef14e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:47.538595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.556476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0882c-d1cf-46eb-9600-1736d453c53c tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.584564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.588490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.588490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.588490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.588490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.588490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.600404 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3103/6181] 10.222.0.13 () {58 vars in 1128 bytes} [Mon Oct 31 14:44:47 2022] GET /identity/v3/regions => generated 669 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:44:47.604601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.633916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539379-f1a7-4f35-bc46-62c73224693e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.639688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.640438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.640788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.641093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/d87f66ff4d454751ac730c2330ef14e6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.641687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d87f66ff4d454751ac730c2330ef14e6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.644266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Could not find region: d87f66ff4d454751ac730c2330ef14e6.: keystone.exception.RegionNotFound: Could not find region: d87f66ff4d454751ac730c2330ef14e6. Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d87f66ff4d454751ac730c2330ef14e6. Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:44:47.665999 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d87f66ff4d454751ac730c2330ef14e6. Oct 31 14:44:47.667298 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:44:47.669955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3079/6182] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:47 2022] DELETE /identity/v3/regions/d87f66ff4d454751ac730c2330ef14e6 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:44:47.675408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.693758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09847-dce4-4212-8ee4-dbef7b2134cf tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.700042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.700589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.700875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.701151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.701750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.702917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:47.714753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3104/6183] 10.222.0.13 () {58 vars in 1128 bytes} [Mon Oct 31 14:44:47 2022] GET /identity/v3/regions => generated 669 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:47.721654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:47.752566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec436-9618-48f0-9b89-2719900fbce7 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:47.770436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:47.771350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:47.771786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:47.772278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:47.773926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:47.775839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.001528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3080/6184] 10.222.0.13 () {60 vars in 1150 bytes} [Mon Oct 31 14:44:47 2022] POST /identity/v3/regions => generated 252 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:48.007501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:48.019375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908ffb-f8f9-437c-9b44-e8cc753957e9 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:48.037619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:48.038041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:48.038331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:48.038658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:48.039270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Adding query filter params (parent_region_id=fd19e913af09449d896775fc22343612) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:48.039591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:48.040613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.045876 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3105/6185] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:44:48 2022] GET /identity/v3/regions?parent_region_id=fd19e913af09449d896775fc22343612 => generated 398 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:44:48.050794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:48.062110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b835e-4013-4205-84a9-b6943c68e9dc tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:48.066875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:48.067464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:48.067752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:48.068031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/f2fe53508cc84712b1d89bed75a8ccd9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:48.068622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f2fe53508cc84712b1d89bed75a8ccd9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:48.070232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.107663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:48.161375 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3081/6186] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:48 2022] DELETE /identity/v3/regions/f2fe53508cc84712b1d89bed75a8ccd9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:48.167015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:48.181519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad4226-1f59-455b-a40e-7d9e569f4cdd tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:48.201580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:48.202410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:48.204172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:48.205341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/58e35ec2e143413088f765072df105df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:48.206105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=58e35ec2e143413088f765072df105df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:48.210874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.314236 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3106/6187] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:48 2022] DELETE /identity/v3/regions/58e35ec2e143413088f765072df105df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:48.315559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:48.327686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda3f7-fccb-4a39-91c0-f23d49d0114e tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:48.336303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:48.348533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad48300e46a3473c84ba4fb34e7f3bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd03b898a6ca4a55a86cddf089f9515c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:48.362119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:48.362657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:48.363112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] PATH_INFO: `/v3/regions/fd19e913af09449d896775fc22343612` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:48.366579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fd19e913af09449d896775fc22343612)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:48.368402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7cc08-03d6-4cb6-9b2a-38d2504daf0a tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.525885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:48.526779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3082/6188] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:48 2022] DELETE /identity/v3/regions/fd19e913af09449d896775fc22343612 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:48.694116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ce9c-c415-4ed9-8a1e-d85be1651478 tempest-RegionsTestJSON-299008458 tempest-RegionsTestJSON-299008458-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:48.713113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:48.714063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:48.714447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:48.714855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] PATH_INFO: `/v3/users/f5c1db748da34cf7a4f803f41ccd32b2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:48.716155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c1db748da34cf7a4f803f41ccd32b2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:48.718361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:48.960050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c1db748da34cf7a4f803f41ccd32b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:48.960740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c1db748da34cf7a4f803f41ccd32b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:49.055995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c1db748da34cf7a4f803f41ccd32b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:49.075554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c1db748da34cf7a4f803f41ccd32b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:49.076818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c1db748da34cf7a4f803f41ccd32b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:49.100035 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3107/6189] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:48 2022] DELETE /identity/v3/users/f5c1db748da34cf7a4f803f41ccd32b2 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:49.105397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:49.106710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:49.107079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:49.140847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:49.142234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:49.275202 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3083/6190] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:49.282259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:49.668323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:49.669460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:49.859013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5937b8-a2be-451c-aeb2-7958196d150d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:49.873830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:49.874384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:49.874700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:49.875026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:49.893536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:49.897237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:49.914944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3108/6191] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:44:50.777643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:50.779263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:50.793317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1a85-60df-4ee7-86b9-41084eed298a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:50.798252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:50.798929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:50.799208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:50.799480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] PATH_INFO: `/v3/projects/a13df01041f74b3bba76649fdca03ab9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:50.800786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13df01041f74b3bba76649fdca03ab9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:50.803020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:50.962851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13df01041f74b3bba76649fdca03ab9', 'request_id': 'req-03882514-8ef9-4023-ad6a-88789eb89d48'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.074034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13df01041f74b3bba76649fdca03ab9', 'request_id': 'req-03882514-8ef9-4023-ad6a-88789eb89d48'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.091593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13df01041f74b3bba76649fdca03ab9', 'request_id': 'req-03882514-8ef9-4023-ad6a-88789eb89d48'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.105934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] The token cache is being invalidate because project a13df01041f74b3bba76649fdca03ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:51.106236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.107090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.108942 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3084/6192] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:50 2022] DELETE /identity/v3/projects/a13df01041f74b3bba76649fdca03ab9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:51.113396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:51.130208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d36e-10cc-419c-98ef-7cd73937ce29 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:51.295577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:51.296222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:51.296500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:51.296772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] PATH_INFO: `/v3/users/ad48300e46a3473c84ba4fb34e7f3bc4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:51.298811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad48300e46a3473c84ba4fb34e7f3bc4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:51.300739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:51.337365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:51.338913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:51.359335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03882514-8ef9-4023-ad6a-88789eb89d48 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:51.372689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:51.372689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:51.372689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:51.372689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] PATH_INFO: `/v3/users/a9f65822df7d4f2cb366f3eb1b35066c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:51.373032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f65822df7d4f2cb366f3eb1b35066c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:51.373681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:51.552546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad48300e46a3473c84ba4fb34e7f3bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.553221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad48300e46a3473c84ba4fb34e7f3bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.629461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f65822df7d4f2cb366f3eb1b35066c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.630348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f65822df7d4f2cb366f3eb1b35066c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.733149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad48300e46a3473c84ba4fb34e7f3bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.744329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad48300e46a3473c84ba4fb34e7f3bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.745107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a034bdcb-e03f-4b59-917e-8e249fc2b40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad48300e46a3473c84ba4fb34e7f3bc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.747703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:51.763240 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3109/6193] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:51 2022] DELETE /identity/v3/users/ad48300e46a3473c84ba4fb34e7f3bc4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:51.826890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f65822df7d4f2cb366f3eb1b35066c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.829805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:51.849889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f65822df7d4f2cb366f3eb1b35066c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.850928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f65822df7d4f2cb366f3eb1b35066c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:51.879292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:51.879762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:51.879874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:51.882731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3085/6194] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:51 2022] DELETE /identity/v3/users/a9f65822df7d4f2cb366f3eb1b35066c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:51.902388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:51.903672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:51.969708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3110/6195] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:51.980102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:51.981972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:52.079746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59194adf-6018-4c36-95ab-42ded768689c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:52.084664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:52.085580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:52.086205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:52.086712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:52.100188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:52.102269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:52.128301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3086/6196] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:52.608582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:52.611805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:52.636966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dfd7c-8f30-4993-ad68-04997a10e5a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:52.650252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:52.650645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:52.650943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:52.651621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] PATH_INFO: `/v3/projects/fd03b898a6ca4a55a86cddf089f9515c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:52.652526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd03b898a6ca4a55a86cddf089f9515c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:52.654447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:52.862097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd03b898a6ca4a55a86cddf089f9515c', 'request_id': 'req-5f6a767f-8e0b-475f-b973-cb6ca6020dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:52.932020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:52.935132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:52.967145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0975ff-b06e-4f82-9cd3-b1bf16097564 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:52.985949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd03b898a6ca4a55a86cddf089f9515c', 'request_id': 'req-5f6a767f-8e0b-475f-b973-cb6ca6020dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.020187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd03b898a6ca4a55a86cddf089f9515c', 'request_id': 'req-5f6a767f-8e0b-475f-b973-cb6ca6020dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.060587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] The token cache is being invalidate because project fd03b898a6ca4a55a86cddf089f9515c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:53.060587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.062012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f6a767f-8e0b-475f-b973-cb6ca6020dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.065239 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3111/6197] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:52 2022] DELETE /identity/v3/projects/fd03b898a6ca4a55a86cddf089f9515c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:53.070168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e124-e67d-4cee-9aa2-051fbb0a537f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.070862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e124-e67d-4cee-9aa2-051fbb0a537f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.071367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598e124-e67d-4cee-9aa2-051fbb0a537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.108579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.109236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.109572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.109900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] PATH_INFO: `/v3/projects/1f7a7c89548e48f3ad1715595e7a2a39` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.111967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5598e124-e67d-4cee-9aa2-051fbb0a537f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:53.113464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5598e124-e67d-4cee-9aa2-051fbb0a537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:53.115675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7a7c89548e48f3ad1715595e7a2a39)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.117645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.126329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3112/6198] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:53.133882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.134402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.134923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.172955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:53.174179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:53.190967 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3113/6199] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:53.191968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.214857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8047-ed38-4716-81ad-94facecc2c5d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.221848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.222566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.222945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.223340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.224044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:53.224397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.226071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.259268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3114/6200] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:53.263792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.269008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7a7c89548e48f3ad1715595e7a2a39', 'request_id': 'req-768bbc64-e02c-45a0-9ee5-7b825c042425'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.281211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f67eba-cedc-4109-8b56-33275ae1aee2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.361657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:53.378074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.379209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.379775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.380215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.381214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.384959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7a7c89548e48f3ad1715595e7a2a39', 'request_id': 'req-768bbc64-e02c-45a0-9ee5-7b825c042425'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.392462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7a7c89548e48f3ad1715595e7a2a39', 'request_id': 'req-768bbc64-e02c-45a0-9ee5-7b825c042425'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.395617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.410752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] The token cache is being invalidate because project 1f7a7c89548e48f3ad1715595e7a2a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:53.410959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.414661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-768bbc64-e02c-45a0-9ee5-7b825c042425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:53.421528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3087/6201] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:52 2022] DELETE /identity/v3/projects/1f7a7c89548e48f3ad1715595e7a2a39 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:53.428225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccc63-e637-44c1-846d-59495ddc0356 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.428225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccc63-e637-44c1-846d-59495ddc0356 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.428225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccc63-e637-44c1-846d-59495ddc0356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.462036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0e1ccc63-e637-44c1-846d-59495ddc0356 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:53.463351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e1ccc63-e637-44c1-846d-59495ddc0356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:53.480443 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3088/6202] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:53.482144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.485661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.486117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.547600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:53.548863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:53.556534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3115/6203] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/projects => generated 365 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:53.558203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3089/6204] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:53.562319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:53.563834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.564734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.565976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:53.579760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db346-0489-46ec-8035-1db843854ec9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.678163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.679256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.679758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.680244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.681146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:44:53.681764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.683986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.699690 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3090/6205] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:53.703637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.707018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59e93-ebbb-4d70-8d2a-34ccae61369a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.721328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.721328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.721328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.721328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.722151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.725498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.736378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2127b0-6d88-4776-936e-5ae4188485c9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.751103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.755057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.755421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.756522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.759789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.762157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.883710 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3116/6206] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/users => generated 283 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:53.884529 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3091/6207] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:53.891364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.892412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.905790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bdfea-c1e9-47ad-8da4-362da1d3a05a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.955147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c540282-bbe6-4f10-b13c-2310983ff646 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:53.960292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.961146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.961592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.962018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.962867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.964365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:53.965626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.965735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:53.965735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:53.966111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:53.966927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:53.968736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:53.980133 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3117/6208] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:53.984261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:53.994323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617c4-c491-437a-be36-c2c80f960809 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.005843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.005843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.006972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.007268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.007931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.009542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.024489 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3118/6209] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:54.028364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.041588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc789749-0dae-4624-928d-b0b6d882d226 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.049271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.051871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.051871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.051871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] PATH_INFO: `/v3/projects/826ae4cd24ba49469f1301bad23ae64e/users/1265fdd143684f60bd26e87f112e840c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.071360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3092/6210] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:53 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:54.074096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.096324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d69e-4ede-48a6-a6fb-a7ccab3e5b6c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.105514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=826ae4cd24ba49469f1301bad23ae64e, user_id=1265fdd143684f60bd26e87f112e840c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.106142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0dbcb-72d1-4367-91f9-86b9435442bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.106335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.106975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.107260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.107530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.110139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.112078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.127467 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3093/6211] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:54.128430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.143569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aeaf2-9a03-41b2-948d-3b7d7a0e72d4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.152644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.153744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.155418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.155942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.157650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.160446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.196188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3094/6212] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:54.197723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.210512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5367f-2c9b-47f3-ab15-e58bae777541 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.221715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.223787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.223787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.223984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3119/6213] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:54 2022] PUT /identity/v3/projects/826ae4cd24ba49469f1301bad23ae64e/users/1265fdd143684f60bd26e87f112e840c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:44:54.232980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] PATH_INFO: `/v3/projects/35f73da3f15b43a0a9c9de25112abfdf/users/5b25d79c19d44c07b59b47ea88d2a609/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.236395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.236950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.237621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.251323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f73da3f15b43a0a9c9de25112abfdf, user_id=5b25d79c19d44c07b59b47ea88d2a609, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.254403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9285bb-0754-450f-bc8d-754b3666f5e7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.291033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] MFA Rules not processed for user `1265fdd143684f60bd26e87f112e840c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:54.293976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:54.338675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3095/6214] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:54 2022] PUT /identity/v3/projects/35f73da3f15b43a0a9c9de25112abfdf/users/5b25d79c19d44c07b59b47ea88d2a609/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:54.342162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.342695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.342822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.409534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] MFA Rules not processed for user `5b25d79c19d44c07b59b47ea88d2a609`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:54.410787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:54.450132 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3120/6215] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:54.455623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.527599 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3096/6216] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:54.534696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.547113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7026dc-b155-4877-9fe9-e697b2c0386e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.660444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.661241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.661728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.662100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.662866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.664939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.669768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc153-c818-4624-9caf-6e2f29a0cfc1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.691160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.691946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.692366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.692761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.693534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.695630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.789795 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3121/6217] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/projects => generated 365 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:54.794580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.825645 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3097/6218] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/projects => generated 365 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:54.834642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:54.913124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa0cb0-09ab-4e55-aea0-1e61ed78d6a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.969134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3783-e3ed-4d59-81fc-0d51cca12784 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:54.976374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.977321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.977709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.978129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.978927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:54.981149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:54.997021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:54.997697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:54.998517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:54.998876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:54.999520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.003481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.111872 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3098/6219] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:55.113388 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3122/6220] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:54 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:44:55.116289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.116981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.137898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc85b3-0ccb-436b-9c36-b172d9979a52 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.141097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fd7d-c61a-4a22-8b13-6a7107ddc024 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.148033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.148854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.149138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.149410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.150079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.150758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.150863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.151057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.151327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.151974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.161195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.186352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.200136 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3123/6221] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:55.205578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.208795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3099/6222] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:55.224704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.234154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8961a-92ac-4e82-aeef-14aba04b197c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.249754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.252584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.252872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.253153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] PATH_INFO: `/v3/projects/2971df3c0a3a449cb3bc675774c3c983/users/5696b820582740bb93e29d47cd654dec/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.259394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c99e-4ef8-4c5b-a6ed-7c6dc0f1ffc0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.271174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.271174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.271174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.271174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] PATH_INFO: `/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf/users/36222e2d592f44b49dc8c7128705fe78/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.277000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2971df3c0a3a449cb3bc675774c3c983, user_id=5696b820582740bb93e29d47cd654dec, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.280613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.295506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=355b42e36e6b4a08971b2cfe6d1669cf, user_id=36222e2d592f44b49dc8c7128705fe78, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.303547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.354100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:55.366153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3124/6223] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:55 2022] PUT /identity/v3/projects/2971df3c0a3a449cb3bc675774c3c983/users/5696b820582740bb93e29d47cd654dec/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:55.370411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.440326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3100/6224] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:55 2022] PUT /identity/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf/users/36222e2d592f44b49dc8c7128705fe78/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:55.444162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.622398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb452c-a90d-4854-9795-d65ed08964af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.677495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9d967-b7dc-4e60-852e-dcd3abe2a09f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.694608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.695254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.695533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.695805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.696455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.698072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.727528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3101/6225] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:44:55.732794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.735542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:55.748887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54720d16-378a-4952-8926-71dbd5eb6cd5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.766155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.766870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.767147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.767415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] PATH_INFO: `/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf/users/36222e2d592f44b49dc8c7128705fe78/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.774362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355b42e36e6b4a08971b2cfe6d1669cf, user_id=36222e2d592f44b49dc8c7128705fe78, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.777127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e5966-13d1-410f-b232-2e3b87c57c67 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.777953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.778577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.778880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.779141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.779788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.781462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:55.808937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3125/6226] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:44:55.809580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3102/6227] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:55 2022] PUT /identity/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf/users/36222e2d592f44b49dc8c7128705fe78/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:55.813088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:55.820921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.821197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.821469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.825796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec2769-ad01-4bad-a061-9ed9ec3e0c14 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:55.929757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] MFA Rules not processed for user `36222e2d592f44b49dc8c7128705fe78`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:55.934053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:55.977468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:55.981865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:55.982407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:55.982858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] PATH_INFO: `/v3/projects/2971df3c0a3a449cb3bc675774c3c983/users/5696b820582740bb93e29d47cd654dec/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:55.990488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2971df3c0a3a449cb3bc675774c3c983, user_id=5696b820582740bb93e29d47cd654dec, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:55.998437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f043664-ee1c-4ed0-8aed-8ce35e21f143 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:56.034665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3126/6228] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:55 2022] PUT /identity/v3/projects/2971df3c0a3a449cb3bc675774c3c983/users/5696b820582740bb93e29d47cd654dec/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:56.049048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.049576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.050044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.121724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3103/6229] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:56.140120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] MFA Rules not processed for user `5696b820582740bb93e29d47cd654dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:56.141878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:56.146385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:56.148584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:56.295701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811c829-4df3-4496-8304-458c7dfc4a2a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:56.318420 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3127/6230] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:44:56.323119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:56.334329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e06f4-6e71-4a25-bda1-6222a6a9556a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:56.341330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:56.342119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.342546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.342983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.343797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:56.346589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:56.373891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:56.374567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.374885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.375199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.472422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:56.473965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:56.495892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3128/6231] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:56 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:56.497658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:56.505053 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3104/6232] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:56.678489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805f419-852e-4738-a4dc-c1aa47fa4706 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:56.694578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:56.698251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.713730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.713730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.713730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:56.713730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:56.734540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:56.842981 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3129/6233] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:56 2022] POST /identity/v3/users => generated 369 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:56.849040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:56.869516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc4739-88e5-49ca-89b7-110183e1c08d service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:56.878089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:56.878778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.879066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.879345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/d5f4bcba6d4c4a5fadc066c6cc195284` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.899266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_user(user_id=d5f4bcba6d4c4a5fadc066c6cc195284)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:56.902173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:56.907848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3105/6234] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:44:56 2022] GET /identity/v3/users/d5f4bcba6d4c4a5fadc066c6cc195284 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:56.909715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:56.926190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6698-113b-4004-8d10-4a371c1f2587 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:56.952946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:56.956688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:56.958053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:56.962503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/d5f4bcba6d4c4a5fadc066c6cc195284` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:56.966035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d5f4bcba6d4c4a5fadc066c6cc195284)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:56.971488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:57.047971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:57.216467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f4bcba6d4c4a5fadc066c6cc195284'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.221499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f4bcba6d4c4a5fadc066c6cc195284'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.308213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f4bcba6d4c4a5fadc066c6cc195284'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.343367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f4bcba6d4c4a5fadc066c6cc195284'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.349119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-24c7674c-3620-462b-a363-08e372533cfa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f4bcba6d4c4a5fadc066c6cc195284'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.386056 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3130/6235] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:56 2022] DELETE /identity/v3/users/d5f4bcba6d4c4a5fadc066c6cc195284 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:57.399269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:57.401339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:57.450018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8aa1b-03fb-4e38-aee2-1b6560b12410 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:57.584981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:57.585699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:57.586117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:57.586563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/94de0f822c9a46ffaf86bdba7a7d1e25` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:57.587956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94de0f822c9a46ffaf86bdba7a7d1e25)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:57.590033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:57.713628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:57.713911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:57.714185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:57.783281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94de0f822c9a46ffaf86bdba7a7d1e25', 'request_id': 'req-cc283a7d-39f6-4711-9c78-66011a6032c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.813078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:57.816971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:57.862342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94de0f822c9a46ffaf86bdba7a7d1e25', 'request_id': 'req-cc283a7d-39f6-4711-9c78-66011a6032c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.872055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94de0f822c9a46ffaf86bdba7a7d1e25', 'request_id': 'req-cc283a7d-39f6-4711-9c78-66011a6032c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.909287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] The token cache is being invalidate because project 94de0f822c9a46ffaf86bdba7a7d1e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:44:57.910076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.912143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:57.916955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3106/6236] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:44:57 2022] DELETE /identity/v3/projects/94de0f822c9a46ffaf86bdba7a7d1e25 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:57.923196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:57.924860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:57.972028 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3131/6237] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:58.033212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:58.040640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:58.129643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc283a7d-39f6-4711-9c78-66011a6032c3 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:58.137555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:58.139230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:58.139897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:58.141280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:58.142027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:58.145704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:58.234733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:58.241127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22846f-40f8-40cb-aeac-518a8f6ebc3c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:58.258222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:58.259495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:58.259977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:58.260472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] PATH_INFO: `/v3/users/5b25d79c19d44c07b59b47ea88d2a609` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:58.263451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b25d79c19d44c07b59b47ea88d2a609)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:58.266092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:58.352765 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3107/6238] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:57 2022] POST /identity/v3/projects => generated 360 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:58.353386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:58.355941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:58.409847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:58.611777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d73e2b-ba2c-48ff-810f-9e553f78f725 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:58.626596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:58.630153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:58.630552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:58.630924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:58.631901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b25d79c19d44c07b59b47ea88d2a609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:58.634246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b25d79c19d44c07b59b47ea88d2a609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:58.638325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:58.726868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b25d79c19d44c07b59b47ea88d2a609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:58.754726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b25d79c19d44c07b59b47ea88d2a609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:58.755839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b25d79c19d44c07b59b47ea88d2a609'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:44:58.779223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3132/6239] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:44:58 2022] DELETE /identity/v3/users/5b25d79c19d44c07b59b47ea88d2a609 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:44:58.783984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:58.789815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:58.791884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383525e-80e4-447b-a640-e2ebb2606e02 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:58.792431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:58.816487 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3108/6240] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:44:58.818017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:58.818273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:58.818579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:58.862781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:44:58.864108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:59.007693 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3109/6241] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:44:59.021243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.025800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb650023-ff56-4ef4-80ce-247489feccbd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.027284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:44:59.044155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.044792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.047980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.048271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.049790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.056226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.135572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe3db8-0770-49cb-8e5d-e66a431947ed None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.141979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.143556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.143838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.144629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.165966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.165966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.201004 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3110/6242] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:44:59.207679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3133/6243] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:44:58 2022] POST /identity/v3/users => generated 417 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:59.212764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.246051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2aeb5-b401-4d82-87a1-6325b95f626f service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.256143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.257936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.258221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.258499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.260165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.264933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.395658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3111/6244] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:44:59 2022] POST /identity/v3/roles => generated 239 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:59.400066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.417100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe205fd-0496-4fad-9cba-eec12e0e1647 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.425828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.426865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.428022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.428494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/2316feeec3634d5a9cd44ce684e03998` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.458038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_user(user_id=2316feeec3634d5a9cd44ce684e03998)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.461435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.465865 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3134/6245] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:44:59 2022] GET /identity/v3/users/2316feeec3634d5a9cd44ce684e03998 => generated 417 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:44:59.469605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.489680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc72be-6dfb-4f85-bc01-817f8b0ea947 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.497860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.498796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.499691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.500171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/roles/c453706b95994421b9b8c46d01d78164` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.501931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_role(role_id=c453706b95994421b9b8c46d01d78164)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.504433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.506253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3112/6246] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:44:59 2022] GET /identity/v3/roles/c453706b95994421b9b8c46d01d78164 => generated 239 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:44:59.510472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.522647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d320a-c60e-41fd-a937-1ac1a6ccc24f tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.528354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.529134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.529523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.530126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.530936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.533174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.663749 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3135/6247] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:44:59 2022] POST /identity/v3/projects => generated 360 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:44:59.667925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.685544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5c47-d514-434a-a07f-8a1e95274161 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.769435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:59.828236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:44:59.829179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.830915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.831300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.831636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/2327221798474d5ab73260f673e76d95` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.832979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_project(project_id=2327221798474d5ab73260f673e76d95)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.835592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:44:59.841568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3113/6248] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:44:59 2022] GET /identity/v3/projects/2327221798474d5ab73260f673e76d95 => generated 360 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:44:59.846448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:44:59.867690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92d8d-a52c-4e3b-9b3e-02c6cdb85192 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:44:59.878266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:44:59.879148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:44:59.879521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:44:59.879901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/2327221798474d5ab73260f673e76d95/users/2316feeec3634d5a9cd44ce684e03998/roles/c453706b95994421b9b8c46d01d78164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:44:59.886715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2327221798474d5ab73260f673e76d95, user_id=2316feeec3634d5a9cd44ce684e03998, role_id=c453706b95994421b9b8c46d01d78164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:44:59.891894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:00.030679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3136/6249] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:44:59 2022] PUT /identity/v3/projects/2327221798474d5ab73260f673e76d95/users/2316feeec3634d5a9cd44ce684e03998/roles/c453706b95994421b9b8c46d01d78164 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:00.035219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.051999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c77d2-b2b9-4274-8471-bd88624a2a85 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:00.138543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:00.139216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:00.139513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:00.140388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:00.141677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:00.143665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:00.252676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.255535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:00.291861 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3114/6250] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:00 2022] POST /identity/v3/projects => generated 359 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:00.303521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.395905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a8be0-a752-4302-95fc-acc6f3c0c8c5 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:00.455108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2004-e89b-41e8-a502-1ffd1f20c21b tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:00.475458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:00.476141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:00.476663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:00.477006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/a2ed665df68e42019d37484062bce61b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:00.482141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ed665df68e42019d37484062bce61b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:00.487541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:00.489324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:00.494666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3115/6251] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:45:00 2022] GET /identity/v3/projects/a2ed665df68e42019d37484062bce61b => generated 359 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:00.496500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.504849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:00.507419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:00.510260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] PATH_INFO: `/v3/projects/35f73da3f15b43a0a9c9de25112abfdf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:00.512328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f73da3f15b43a0a9c9de25112abfdf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:00.520118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:00.532118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369473f-d487-40fb-a5ed-f15ee477dc94 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:00.552110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:00.552382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:00.552708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:00.552940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/a2ed665df68e42019d37484062bce61b/users/2316feeec3634d5a9cd44ce684e03998/roles/c453706b95994421b9b8c46d01d78164` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:00.559527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a2ed665df68e42019d37484062bce61b, user_id=2316feeec3634d5a9cd44ce684e03998, role_id=c453706b95994421b9b8c46d01d78164)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:00.563715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:00.733702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3116/6252] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:00 2022] PUT /identity/v3/projects/a2ed665df68e42019d37484062bce61b/users/2316feeec3634d5a9cd44ce684e03998/roles/c453706b95994421b9b8c46d01d78164 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:00.740233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.769765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f73da3f15b43a0a9c9de25112abfdf', 'request_id': 'req-481eb246-b26a-4b9c-9115-d34d89b4f3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:00.860979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f73da3f15b43a0a9c9de25112abfdf', 'request_id': 'req-481eb246-b26a-4b9c-9115-d34d89b4f3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:00.870241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175c13-1350-45d8-b3d2-e16d1df1887a tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:00.874941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f73da3f15b43a0a9c9de25112abfdf', 'request_id': 'req-481eb246-b26a-4b9c-9115-d34d89b4f3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:00.927921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] The token cache is being invalidate because project 35f73da3f15b43a0a9c9de25112abfdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:00.928223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:00.932881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:00.939152 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3137/6253] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:00 2022] DELETE /identity/v3/projects/35f73da3f15b43a0a9c9de25112abfdf => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:00.940190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:00.943043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:00.946482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:00.974391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:01.055168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:01.057519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:01.057829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:01.058102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/2316feeec3634d5a9cd44ce684e03998/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:01.063389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=2316feeec3634d5a9cd44ce684e03998)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:01.065563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:01.180461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eb246-b26a-4b9c-9115-d34d89b4f3aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:01.198463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:01.199385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:01.199902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:01.200396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] PATH_INFO: `/v3/users/36222e2d592f44b49dc8c7128705fe78` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:01.202483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36222e2d592f44b49dc8c7128705fe78)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:01.204072 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3117/6254] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 14:45:00 2022] GET /identity/v3/users/2316feeec3634d5a9cd44ce684e03998/projects => generated 843 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:45:01.207335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:01.207453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:01.213550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:01.273808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8ffc-786e-4845-ac07-09ae35140682 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:01.289967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:01.290858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:01.291249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:01.291631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/a2ed665df68e42019d37484062bce61b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:01.297476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2ed665df68e42019d37484062bce61b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:01.299629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:01.511806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36222e2d592f44b49dc8c7128705fe78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.514968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36222e2d592f44b49dc8c7128705fe78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.598462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36222e2d592f44b49dc8c7128705fe78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.628702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36222e2d592f44b49dc8c7128705fe78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.629761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ed665df68e42019d37484062bce61b', 'request_id': 'req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.630822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36222e2d592f44b49dc8c7128705fe78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.688210 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3138/6255] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:00 2022] DELETE /identity/v3/users/36222e2d592f44b49dc8c7128705fe78 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:01.712714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ed665df68e42019d37484062bce61b', 'request_id': 'req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.722127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ed665df68e42019d37484062bce61b', 'request_id': 'req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.748546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] The token cache is being invalidate because project a2ed665df68e42019d37484062bce61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:01.750307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.751369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:01.756521 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3118/6256] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:01 2022] DELETE /identity/v3/projects/a2ed665df68e42019d37484062bce61b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:01.760472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:01.762272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:01.960611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b826-d324-4638-a15a-550418e002b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:01.976262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:01.977147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:01.978014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:01.978014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/2327221798474d5ab73260f673e76d95` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:01.983048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2327221798474d5ab73260f673e76d95)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:01.986857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:02.179775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:02.238782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:02.295373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2327221798474d5ab73260f673e76d95', 'request_id': 'req-ccec8767-c586-4f78-a8b4-ab7d42204c50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:02.421218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2327221798474d5ab73260f673e76d95', 'request_id': 'req-ccec8767-c586-4f78-a8b4-ab7d42204c50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:02.433525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2327221798474d5ab73260f673e76d95', 'request_id': 'req-ccec8767-c586-4f78-a8b4-ab7d42204c50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:02.456247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] The token cache is being invalidate because project 2327221798474d5ab73260f673e76d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:02.456550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:02.461027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:02.465232 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3139/6257] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:01 2022] DELETE /identity/v3/projects/2327221798474d5ab73260f673e76d95 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:02.470176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:02.473260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:02.693682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dada8-b6dd-40e4-a51d-d5cae20ab3d6 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:02.794487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:02.795349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:02.795641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:02.795975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/roles/c453706b95994421b9b8c46d01d78164` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:02.803081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c453706b95994421b9b8c46d01d78164)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:02.806656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:02.888374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:02.889776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:03.033443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invalidating the token cache because role c453706b95994421b9b8c46d01d78164 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:03.033752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.034512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8767-c586-4f78-a8b4-ab7d42204c50 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:03.035506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.037742 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3119/6258] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:02 2022] DELETE /identity/v3/roles/c453706b95994421b9b8c46d01d78164 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:03.040595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:03.044566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.045220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.047465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] PATH_INFO: `/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.049009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355b42e36e6b4a08971b2cfe6d1669cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:03.050462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:03.052939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:03.058225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:03.233694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ec13-956e-442e-beb7-493bfd2a9e43 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:03.262248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355b42e36e6b4a08971b2cfe6d1669cf', 'request_id': 'req-ad8acb83-b0a1-440a-9292-02bb109e9037'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.362276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355b42e36e6b4a08971b2cfe6d1669cf', 'request_id': 'req-ad8acb83-b0a1-440a-9292-02bb109e9037'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.403033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355b42e36e6b4a08971b2cfe6d1669cf', 'request_id': 'req-ad8acb83-b0a1-440a-9292-02bb109e9037'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.456695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] The token cache is being invalidate because project 355b42e36e6b4a08971b2cfe6d1669cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:03.457458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.459026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad8acb83-b0a1-440a-9292-02bb109e9037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.467891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3140/6259] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:02 2022] DELETE /identity/v3/projects/355b42e36e6b4a08971b2cfe6d1669cf => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:03.468314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:03.482282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456abcd-1250-4a9f-8cce-b48a61877c77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.484488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456abcd-1250-4a9f-8cce-b48a61877c77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.486219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456abcd-1250-4a9f-8cce-b48a61877c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.491023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:03.496601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.497455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.499144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/2316feeec3634d5a9cd44ce684e03998` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.503460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2316feeec3634d5a9cd44ce684e03998)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:03.505753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:03.537394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5456abcd-1250-4a9f-8cce-b48a61877c77 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:03.543118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5456abcd-1250-4a9f-8cce-b48a61877c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:03.672993 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3141/6260] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:03.682702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.686021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.689073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.733378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2316feeec3634d5a9cd44ce684e03998'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.735331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2316feeec3634d5a9cd44ce684e03998'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.742636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:03.745685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:03.768770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3142/6261] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:03.770050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:03.783082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2453c5-84e2-456b-bb86-b4cfe3c67684 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:03.790573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:03.791562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.792145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.792566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.793432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:03.793887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:03.795875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:03.809778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2316feeec3634d5a9cd44ce684e03998'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.842378 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3143/6262] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:03.845586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:03.847676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:03.854806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2316feeec3634d5a9cd44ce684e03998'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.857746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2316feeec3634d5a9cd44ce684e03998'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:03.874640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197b48e-e71a-43ae-adc2-afcfa20bee5c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:03.907938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:03.912085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:03.912378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:03.912657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:03.915336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:03.923525 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3120/6263] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:03 2022] DELETE /identity/v3/users/2316feeec3634d5a9cd44ce684e03998 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:03.929628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:03.930211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:03.932477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:04.081646 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3144/6264] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:03 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:04.083233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:04.101887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835ac7-fedc-4a1e-a24f-044bb155dc9d tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.260189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:04.260920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:04.261205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:04.261486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/56f780e0bb9047f18aea46fbe5415d5b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:04.263555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56f780e0bb9047f18aea46fbe5415d5b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:04.265682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:04.308343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ead5f-5a0d-4b39-b7b0-07dbfd34ba6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.315668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:04.316660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:04.317102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:04.317450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:04.318354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:04.320835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:04.443934 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3145/6265] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:04 2022] POST /identity/v3/users => generated 288 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:04.446922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:04.523768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733df16-9a4d-432d-88dc-6f579d4b5245 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.530944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f780e0bb9047f18aea46fbe5415d5b', 'request_id': 'req-2491804a-d62e-4540-b8aa-9895e1390b11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:04.654462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f780e0bb9047f18aea46fbe5415d5b', 'request_id': 'req-2491804a-d62e-4540-b8aa-9895e1390b11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:04.663897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f780e0bb9047f18aea46fbe5415d5b', 'request_id': 'req-2491804a-d62e-4540-b8aa-9895e1390b11'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:04.700470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] The token cache is being invalidate because project 56f780e0bb9047f18aea46fbe5415d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:04.700767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:04.701939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:04.715593 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3121/6266] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:03 2022] DELETE /identity/v3/projects/56f780e0bb9047f18aea46fbe5415d5b => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:04.716806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:04.721418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:04.744480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:04.744480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:04.744480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:04.744480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:04.744844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:04.746181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:04.764291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:04.785825 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3146/6267] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:04.789494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:04.792460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:04.827289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ca657-a299-41b2-9992-3ea5aacfefc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.865812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:04.873054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:04.873466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:04.877625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:04.878446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:04.883235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:04.924827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3147/6268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:04.929775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:04.971817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d62d6a-2f77-4086-9a68-2758f0ab622a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.985551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491804a-d62e-4540-b8aa-9895e1390b11 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:04.988591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:04.989274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:04.996803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:04.997130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] PATH_INFO: `/v3/projects/2d29e8890a4e4cf8b07fac0d7a2caa25/users/ad661eceb09d4e14a9696aee73f3be54/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.005008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:05.017275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:05.017275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:05.017275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/1265fdd143684f60bd26e87f112e840c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.020782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:update_user(user_id=1265fdd143684f60bd26e87f112e840c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:05.021860 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:45:05.021860 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:45:05.021860 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:45:05.030381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:05.059346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d29e8890a4e4cf8b07fac0d7a2caa25, user_id=ad661eceb09d4e14a9696aee73f3be54, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:05.065320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219ed4a-6311-4433-9d4c-3a778763878b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:05.177251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3148/6269] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:04 2022] PUT /identity/v3/projects/2d29e8890a4e4cf8b07fac0d7a2caa25/users/ad661eceb09d4e14a9696aee73f3be54/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:05.180848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:05.181137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:05.181410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.213212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.260015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] MFA Rules not processed for user `ad661eceb09d4e14a9696aee73f3be54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:05.261258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:05.311692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invalidating the token cache because user 1265fdd143684f60bd26e87f112e840c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:05.312097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.312725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9b69e9-9f2b-466f-8d17-0641b697e975 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.325528 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3122/6270] 10.222.0.13 () {60 vars in 1243 bytes} [Mon Oct 31 14:45:04 2022] PATCH /identity/v3/users/1265fdd143684f60bd26e87f112e840c => generated 296 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:05.327102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:05.327388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:05.327805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.389862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:05.466156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] MFA Rules not processed for user `1265fdd143684f60bd26e87f112e840c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:05.467408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:05.483217 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3123/6271] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:05 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:05.486984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:05.492087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:05.500628 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3149/6272] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:05.502462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:05.507005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:05.711523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b908c-958e-4ca7-a772-a97b8215704a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:05.725512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:05.726446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:05.726958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:05.727854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/1265fdd143684f60bd26e87f112e840c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.729402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:update_user(user_id=1265fdd143684f60bd26e87f112e840c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:05.732069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:05.768764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd9ed7-9f57-4930-b376-ab9b3bc77fc9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:05.773955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:05.774495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:05.774792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:05.775163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:05.775821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:05.777731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:05.830737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.948825 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3150/6273] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:05 2022] POST /identity/v3/projects => generated 375 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:05.951616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:05.961470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invalidating the token cache because user 1265fdd143684f60bd26e87f112e840c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:05.961470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.961470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:05.968308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3124/6274] 10.222.0.13 () {60 vars in 1243 bytes} [Mon Oct 31 14:45:05 2022] PATCH /identity/v3/users/1265fdd143684f60bd26e87f112e840c => generated 296 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:05.970838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:05.972723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:05.991884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77257-b780-4dbc-9033-b8d5565dcf68 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.225612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491dfe4-85cd-4ad8-abd0-1cdffa498b9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.233646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:06.254013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.254775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.255153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.255375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/1265fdd143684f60bd26e87f112e840c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.279930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.281057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.282245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.282797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.287160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.295181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.322778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:update_user(user_id=1265fdd143684f60bd26e87f112e840c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.341639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.510386 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3151/6275] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:05 2022] POST /identity/v3/users => generated 294 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:06.510386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:06.512664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:06.521832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.652675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invalidating the token cache because user 1265fdd143684f60bd26e87f112e840c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:06.653129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:06.654121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:06.666966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3125/6276] 10.222.0.13 () {60 vars in 1243 bytes} [Mon Oct 31 14:45:05 2022] PATCH /identity/v3/users/1265fdd143684f60bd26e87f112e840c => generated 296 bytes in 697 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:06.681967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:06.691540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.733846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f3095-3b9f-4ede-aa60-ba8800c06758 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.742720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.743287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b2b-0063-4918-9f26-1c93e927e71e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.743433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.743622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.743897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.746422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.755892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.756521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.756802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.757077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.757790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.759381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fb1b6-710b-412f-8522-45c46c4feb2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.774902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.776842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.782697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3126/6277] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:06.786655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.786985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.787270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.803436 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3152/6278] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:06.804658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:06.832641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd7cbb-ce92-4f3c-adfa-d1e9de7630c2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.848054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.848758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.849036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.849317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] PATH_INFO: `/v3/projects/46bad970a29142a48aefbf293f69de3b/users/5b056fab27f84ff5b7a11c2651c59f80/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.856242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:06.867891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] MFA Rules not processed for user `1265fdd143684f60bd26e87f112e840c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:06.869401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.873847 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3127/6279] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:06 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:06.874964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:06.876162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.885288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bad970a29142a48aefbf293f69de3b, user_id=5b056fab27f84ff5b7a11c2651c59f80, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.887712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.906464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105620-b0d2-4ad4-a224-54ec48b275fe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.913605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.913797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.913992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.914262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.916119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.933186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.935825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:06.952173 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3128/6280] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:06.953869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:06.955316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:06.972048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385add-c3c3-42c0-8571-32fcd481562e service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:06.977998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:06.980472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:06.980472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:06.980472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/1265fdd143684f60bd26e87f112e840c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:06.980696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:update_user(user_id=1265fdd143684f60bd26e87f112e840c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:06.982712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:07.006688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3153/6281] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:06 2022] PUT /identity/v3/projects/46bad970a29142a48aefbf293f69de3b/users/5b056fab27f84ff5b7a11c2651c59f80/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:07.009488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:07.155795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:07.158885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba9-2ee7-4a82-8748-72a2d99aadd7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:07.169520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:07.170430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.174105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.174105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:07.174105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:07.177966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:07.198494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3154/6282] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:07.202680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:07.223420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33404e71-4b98-48cd-88ae-9cba117e15c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:07.232119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:07.233370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.234720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.235316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] PATH_INFO: `/v3/projects/46bad970a29142a48aefbf293f69de3b/users/5b056fab27f84ff5b7a11c2651c59f80/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:07.243161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bad970a29142a48aefbf293f69de3b, user_id=5b056fab27f84ff5b7a11c2651c59f80, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:07.246426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba12a-d521-42b8-a8f8-01b3ef46f528 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:07.252843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invalidating the token cache because user 1265fdd143684f60bd26e87f112e840c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:07.253147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:07.253948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:07.266062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3129/6283] 10.222.0.13 () {60 vars in 1243 bytes} [Mon Oct 31 14:45:06 2022] PATCH /identity/v3/users/1265fdd143684f60bd26e87f112e840c => generated 296 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:07.267124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:07.268761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:07.278660 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3155/6284] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:07 2022] PUT /identity/v3/projects/46bad970a29142a48aefbf293f69de3b/users/5b056fab27f84ff5b7a11c2651c59f80/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:07.295449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.295840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.296085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:07.315929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884d51-687b-4b4d-856b-e87fd4cd1b40 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:07.428809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] MFA Rules not processed for user `5b056fab27f84ff5b7a11c2651c59f80`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:07.434127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:07.465900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:07.585489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:07.590343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.590649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.594645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:07.599431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:07.611472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:07.653422 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3156/6285] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:07.667728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:07.669548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:07.815892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cde98-308d-42d2-9ec1-a94c38082a19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:07.837697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3130/6286] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:45:07 2022] POST /identity/v3/users => generated 265 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:07.839473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:07.841830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:07.842610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.842917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.843188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:07.847889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:07.866407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae46d56-d0a6-4dc1-8376-3865502efa3c tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:07.881728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d768f28-a232-4125-a621-4e5151dc6806 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:07.883800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d768f28-a232-4125-a621-4e5151dc6806 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:07.884089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d768f28-a232-4125-a621-4e5151dc6806 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:07.884361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d768f28-a232-4125-a621-4e5151dc6806 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/6e07cef288a94771ac8ea39df578ace3/password` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:08.052868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:08.052868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:08.162775 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3157/6287] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:08.246951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6d768f28-a232-4125-a621-4e5151dc6806 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:08.415733 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3131/6288] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 14:45:07 2022] POST /identity/v3/users/6e07cef288a94771ac8ea39df578ace3/password => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:08.678343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:08.680570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:08.801351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96ab06-1808-4fe6-94c9-80cca99047a5 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:08.808174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:08.808806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:08.809217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:08.809883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:08.812929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:08.956700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:08.964254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:09.050979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3158/6289] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:09.076092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:09.419853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:09.420400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:09.421237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:09.466976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] MFA Rules not processed for user `6e07cef288a94771ac8ea39df578ace3`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:09.470954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:09.484840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:09.492550 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3132/6290] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:09 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:09.506328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78088f-67c0-4b7b-a373-11d8d1380117 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:09.528363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:09.528363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:09.528363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:09.528881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:09.558360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:09.563185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:09.585543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:09.595580 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3159/6291] 10.222.0.13 () {56 vars in 1263 bytes} [Mon Oct 31 14:45:09 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:09.608340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a224ff-17c7-4e86-a57a-8e0ee9c07118 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:09.614450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:09.617919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:09.618436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:09.618919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/6e07cef288a94771ac8ea39df578ace3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:09.620447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6e07cef288a94771ac8ea39df578ace3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:09.622825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:09.869261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:09.910832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:09.911712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:10.055720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:10.087325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:10.094251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e07cef288a94771ac8ea39df578ace3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:10.131623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3133/6292] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:09 2022] DELETE /identity/v3/users/6e07cef288a94771ac8ea39df578ace3 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:10.139321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:10.156611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2b7f6-f75d-4f9c-835b-55354cc61337 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:10.313422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:10.373982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:10.376271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:10.376466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:10.376905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:10.382856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:10.385470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:10.581899 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3160/6293] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:10 2022] POST /identity/v3/users => generated 367 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:10.586705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:10.588346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:10.622645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c435d-e551-48a0-a019-8337892d51ac tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:10.639804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:10.640264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:10.641162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:10.641530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:10.642181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:10.647155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:10.790000 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3134/6294] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:10 2022] POST /identity/v3/projects => generated 359 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:10.795438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:10.817046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eee28-7075-4c1a-b4fb-1464f4593139 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:10.820055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:10.925570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:11.070256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:11.074327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:11.077947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:11.078389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/9cf94c5ab7824e36a2782c507953419f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:11.149690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:update_user(user_id=9cf94c5ab7824e36a2782c507953419f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:11.163089 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:45:11.163089 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 14:45:11.163089 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 14:45:11.169965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:11.368552 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3161/6295] 10.222.0.13 () {60 vars in 1244 bytes} [Mon Oct 31 14:45:10 2022] PATCH /identity/v3/users/9cf94c5ab7824e36a2782c507953419f => generated 523 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:11.374986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:11.399273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33112a7-2696-4284-9a31-bcf9273a732e tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:11.421013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:11.425259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:11.425570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:11.425848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/9cf94c5ab7824e36a2782c507953419f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:11.437308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:11.494425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:get_user(user_id=9cf94c5ab7824e36a2782c507953419f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:11.503262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:11.511501 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3135/6296] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:45:11 2022] GET /identity/v3/users/9cf94c5ab7824e36a2782c507953419f => generated 389 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:11.513607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:11.532444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9c89-cbbd-4fe1-83da-e785476e3570 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:11.565591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:11.566729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:11.567125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:11.567514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/projects/d5d0e754edb5474da426cdf032d2371e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:11.574345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5d0e754edb5474da426cdf032d2371e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:11.576799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:11.701850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:11.819519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d0e754edb5474da426cdf032d2371e', 'request_id': 'req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:11.913005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d0e754edb5474da426cdf032d2371e', 'request_id': 'req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:11.920134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d0e754edb5474da426cdf032d2371e', 'request_id': 'req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:11.957738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] The token cache is being invalidate because project d5d0e754edb5474da426cdf032d2371e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:11.958305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:11.964085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:11.972076 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3162/6297] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:11 2022] DELETE /identity/v3/projects/d5d0e754edb5474da426cdf032d2371e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:11.972316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:11.975058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:12.008028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eb5cb-10d3-4e2b-a43c-06ece0a130d0 tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:12.205459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5696b820582740bb93e29d47cd654dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2971df3c0a3a449cb3bc675774c3c983', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:12.206161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:12.206667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:12.206944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] PATH_INFO: `/v3/users/9cf94c5ab7824e36a2782c507953419f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:12.234881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9cf94c5ab7824e36a2782c507953419f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:12.234881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:12.498671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=11 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:12.574924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf94c5ab7824e36a2782c507953419f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:12.575751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf94c5ab7824e36a2782c507953419f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:12.715705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf94c5ab7824e36a2782c507953419f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:12.764514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf94c5ab7824e36a2782c507953419f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:12.768115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e41c6e53-b993-4612-8163-835ba380f6fa tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf94c5ab7824e36a2782c507953419f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:12.825860 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3136/6298] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:11 2022] DELETE /identity/v3/users/9cf94c5ab7824e36a2782c507953419f => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:12.833960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:12.835875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:13.084038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7e11-e6db-4592-a1fe-ff15b0a4e7bb tempest-UsersV3TestJSON-893990284 tempest-UsersV3TestJSON-893990284-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:13.244705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:13.245391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:13.245679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:13.245954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] PATH_INFO: `/v3/users/1265fdd143684f60bd26e87f112e840c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:13.304339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1265fdd143684f60bd26e87f112e840c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:13.306017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:13.630510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:13.646705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:13.647417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:13.799277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:13.842576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:13.847229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1265fdd143684f60bd26e87f112e840c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:13.874083 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3163/6299] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:12 2022] DELETE /identity/v3/users/1265fdd143684f60bd26e87f112e840c => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:13.879362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:13.879869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:13.879984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:13.968101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:13.971772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:14.136536 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3137/6300] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:14.150981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:14.155827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:14.394266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0da99b-aaf5-4c32-b3b4-36c7958626b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:14.408806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:14.409866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:14.410352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:14.410866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:14.431530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:14.436634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:14.466551 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3164/6301] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:16.317435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:16.319109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:16.351179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dfd74-022a-4457-88c3-ead3014f23e7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:16.367896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:16.368910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:16.369442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:16.370025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] PATH_INFO: `/v3/projects/826ae4cd24ba49469f1301bad23ae64e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:16.371958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826ae4cd24ba49469f1301bad23ae64e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:16.374188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:16.589567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826ae4cd24ba49469f1301bad23ae64e', 'request_id': 'req-510b2c79-cb56-41e1-b3ed-63063cc953e3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:16.924066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826ae4cd24ba49469f1301bad23ae64e', 'request_id': 'req-510b2c79-cb56-41e1-b3ed-63063cc953e3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:16.929374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:16.931941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826ae4cd24ba49469f1301bad23ae64e', 'request_id': 'req-510b2c79-cb56-41e1-b3ed-63063cc953e3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:16.950173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] The token cache is being invalidate because project 826ae4cd24ba49469f1301bad23ae64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:16.951618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:16.954053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:16.956841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3138/6302] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:16 2022] DELETE /identity/v3/projects/826ae4cd24ba49469f1301bad23ae64e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:16.961172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:16.996481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96c9a4-499b-462a-b6c5-05574e59c8b3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:17.123243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:17.123914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:17.124289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:17.127618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] PATH_INFO: `/v3/users/5696b820582740bb93e29d47cd654dec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:17.162842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5696b820582740bb93e29d47cd654dec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:17.184964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:17.665651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5696b820582740bb93e29d47cd654dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:17.666590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5696b820582740bb93e29d47cd654dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:17.772856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5696b820582740bb93e29d47cd654dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:17.793405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:17.798105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5696b820582740bb93e29d47cd654dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:17.798910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5696b820582740bb93e29d47cd654dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:17.883939 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3165/6303] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:16 2022] DELETE /identity/v3/users/5696b820582740bb93e29d47cd654dec => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:19.058201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:19.061088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:19.234605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2c79-cb56-41e1-b3ed-63063cc953e3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:19.443650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:19.444306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:19.444867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:19.444867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:19.449313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:19.591528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:19.593411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79e767-6c83-454a-9a1e-144db9e85975 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:19.606485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3139/6304] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:21.604535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:21.606126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:21.762827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bbc9-f240-4ab5-abbf-e0e3a7168342 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:21.768477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:21.769439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:21.769912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:21.770401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] PATH_INFO: `/v3/projects/2971df3c0a3a449cb3bc675774c3c983` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:21.771826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2971df3c0a3a449cb3bc675774c3c983)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:21.774107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:21.990179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2971df3c0a3a449cb3bc675774c3c983', 'request_id': 'req-392570ad-7eae-4a6d-b7f3-28b83196eba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:22.135137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2971df3c0a3a449cb3bc675774c3c983', 'request_id': 'req-392570ad-7eae-4a6d-b7f3-28b83196eba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:22.143833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2971df3c0a3a449cb3bc675774c3c983', 'request_id': 'req-392570ad-7eae-4a6d-b7f3-28b83196eba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:22.178890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] The token cache is being invalidate because project 2971df3c0a3a449cb3bc675774c3c983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:22.179204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:22.180059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-392570ad-7eae-4a6d-b7f3-28b83196eba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:22.182654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3166/6305] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:21 2022] DELETE /identity/v3/projects/2971df3c0a3a449cb3bc675774c3c983 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:22.188595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:22.189945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:22.190412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:22.268196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:22.269855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:22.449677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:22.479906 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3140/6306] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:22.508676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:22.509031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:22.509456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:22.574373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:22.578836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:22.605815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3167/6307] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:22.607110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:22.640438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e53e8-7744-4193-8607-6e1f5e62a09b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:22.670301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:22.673239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:22.678369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:22.678755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:22.680230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:22.680477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:22.691413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:22.774391 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3141/6308] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:22.776875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:22.793325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f570b-4a15-48ec-a0d1-2d8cbba4586c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:22.810647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:22.814797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:22.814797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:22.814797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:22.815256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:22.824994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:22.994301 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3168/6309] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:22 2022] POST /identity/v3/projects => generated 359 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:22.994413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:23.012194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e08d1a-e4ca-427f-889e-3adc9cdf2888 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:23.208319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:23.228313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:23.228803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:23.229978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:23.232745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:23.237733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:23.372514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:23.379368 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3142/6310] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:22 2022] POST /identity/v3/users => generated 280 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:23.391231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a820c-35e6-4194-b7ed-de50521257cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:23.400983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:23.404444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:23.404444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:23.404444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:23.404444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:23.405108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:23.418528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3169/6311] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:45:23.422952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:23.480124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5434cf-623a-4b0f-81c3-5273f0e5dbc6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:23.532929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:23.539571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:23.540088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:23.540576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:23.541445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:23.545540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5cc2a-1af2-4140-aab3-7f712833832f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:23.579817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3143/6312] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:23.583384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:23.605876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cb77-a1bd-4c1a-a9ce-6bcc3daefa64 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:23.617937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:23.619758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:23.620530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:23.621019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] PATH_INFO: `/v3/projects/f5bf6928cefc415182c5d7bdc246a505/users/557226a8c96540028239fcb29b2eea0b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:23.669233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bf6928cefc415182c5d7bdc246a505, user_id=557226a8c96540028239fcb29b2eea0b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:23.679409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5a29-cace-4f52-8207-672deb2357f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:23.801061 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3170/6313] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:23 2022] PUT /identity/v3/projects/f5bf6928cefc415182c5d7bdc246a505/users/557226a8c96540028239fcb29b2eea0b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:23.815738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee9d5-6f09-44d5-95fd-585fd7bec9d4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:23.818345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee9d5-6f09-44d5-95fd-585fd7bec9d4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:23.820864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cee9d5-6f09-44d5-95fd-585fd7bec9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:23.952172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-45cee9d5-6f09-44d5-95fd-585fd7bec9d4 None None] MFA Rules not processed for user `557226a8c96540028239fcb29b2eea0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:23.954739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-45cee9d5-6f09-44d5-95fd-585fd7bec9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:24.182166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3144/6314] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:24.187934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.189745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.190234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.237288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] MFA Rules not processed for user `557226a8c96540028239fcb29b2eea0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:24.253636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:24.261022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.261895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.262370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.265739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3171/6315] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:24.293348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] MFA Rules not processed for user `557226a8c96540028239fcb29b2eea0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:24.296167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:24.312364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.316666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3145/6316] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:24.321799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:24.330987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba9ddc-301e-4353-816d-467b3eaaa836 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.338037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.338891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.339360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.339799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.352892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorizing `identity:check_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:24.359421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:24.383447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.383740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3172/6317] 10.222.0.13 () {56 vars in 1264 bytes} [Mon Oct 31 14:45:24 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 31 14:45:24.403275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814f5e3-6935-49eb-bdc2-8457ec9235da None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.415344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.416389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.416931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.424629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.444187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:24.446328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:24.469092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3146/6318] 10.222.0.13 () {56 vars in 1263 bytes} [Mon Oct 31 14:45:24 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:24.469603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.481538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031af08e-2369-4713-9e01-898afe441478 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.491439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.492563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.493285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.493773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.515623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:24.517160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447b192-8cde-4643-8d63-c71a962d122b tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:24.710157 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3173/6319] 10.222.0.13 () {56 vars in 1266 bytes} [Mon Oct 31 14:45:24 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:24.711366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.738741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde6f5d-bb31-44fb-a685-5bb0d871deff tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.754168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.755624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `HEAD` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.757415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.762786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.762786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 31 14:45:24.783953 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 14:45:24.785974 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:45:24.787209 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:45:24.806137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3147/6320] 10.222.0.13 () {56 vars in 1264 bytes} [Mon Oct 31 14:45:24 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 31 14:45:24.808059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.808424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.808762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.843283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] MFA Rules not processed for user `557226a8c96540028239fcb29b2eea0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:24.848316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:24.853291 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3174/6321] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:45:24.855186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.873290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0fd5-f3be-4acc-b5be-f065f52b2f3c tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.892633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.893258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.893531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.893984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.919839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:24.922792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:24.938882 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3148/6322] 10.222.0.13 () {56 vars in 1263 bytes} [Mon Oct 31 14:45:24 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:45:24.942814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:24.957641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde3cbd-10c4-44e3-b464-6329e8acc2f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:24.973347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:24.974207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:24.974720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:24.975281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:24.991492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:24.993492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:25.131391 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3175/6323] 10.222.0.13 () {56 vars in 1266 bytes} [Mon Oct 31 14:45:24 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:25.135573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:25.147818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80564d4-578e-4f76-a3bf-7bc2adb793b0 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:25.160836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557226a8c96540028239fcb29b2eea0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5bf6928cefc415182c5d7bdc246a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:25.161413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:25.161692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:25.161960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:25.167088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:25.182426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-f9c9d1ca-3688-4fd5-a82b-28822d9829a1 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 31 14:45:25.192761 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 31 14:45:25.193725 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 31 14:45:25.194630 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:45:25.195412 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3149/6324] 10.222.0.13 () {56 vars in 1263 bytes} [Mon Oct 31 14:45:25 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:45:25.201897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:25.387814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af55f2-0868-4e09-93a6-a18a87689460 tempest-TokensV3Test-947523559 tempest-TokensV3Test-947523559-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:25.393633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:25.394866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:25.395416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:25.395919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] PATH_INFO: `/v3/users/557226a8c96540028239fcb29b2eea0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:25.397538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=557226a8c96540028239fcb29b2eea0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:25.399848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:25.629108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557226a8c96540028239fcb29b2eea0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:25.632250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557226a8c96540028239fcb29b2eea0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:25.739683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557226a8c96540028239fcb29b2eea0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:25.763746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557226a8c96540028239fcb29b2eea0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:25.764831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557226a8c96540028239fcb29b2eea0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:25.815163 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3176/6325] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:25 2022] DELETE /identity/v3/users/557226a8c96540028239fcb29b2eea0b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:25.817212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:25.818074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:25.818495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:25.854207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:25.855746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:26.004305 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3150/6326] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:26.014119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:26.016026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:26.120565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:26.239765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc22fbb-853f-4136-89d0-61b26a1bb33f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:26.253566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:26.255769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:26.255769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:26.255769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:26.280095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:26.284199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403305ba-3e7e-447c-b98a-a1b20026f3cf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:26.311598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3177/6327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:27.170256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:27.170256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:27.189170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b619c7-d6d7-4e00-a2c4-593692898d2a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:27.213155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:27.213924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:27.214291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:27.214824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] PATH_INFO: `/v3/projects/f5bf6928cefc415182c5d7bdc246a505` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:27.218150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bf6928cefc415182c5d7bdc246a505)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:27.219976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:27.401617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bf6928cefc415182c5d7bdc246a505', 'request_id': 'req-16c281c5-3c23-4b79-aaa0-e435bddb1c44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:27.538951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bf6928cefc415182c5d7bdc246a505', 'request_id': 'req-16c281c5-3c23-4b79-aaa0-e435bddb1c44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:27.545735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bf6928cefc415182c5d7bdc246a505', 'request_id': 'req-16c281c5-3c23-4b79-aaa0-e435bddb1c44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:27.566287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] The token cache is being invalidate because project f5bf6928cefc415182c5d7bdc246a505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:27.566287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:27.566973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-16c281c5-3c23-4b79-aaa0-e435bddb1c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:27.569104 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3151/6328] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:27 2022] DELETE /identity/v3/projects/f5bf6928cefc415182c5d7bdc246a505 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:27.578267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:27.578925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:27.578925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:27.620030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:27.648042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:27.790201 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3178/6329] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:27.797987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:27.798752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:27.799239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:27.843924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:27.845352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:27.861685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3152/6330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:27.863064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:27.884307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eedd4-0213-4d0e-a50a-9880aa2cac72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:27.902310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:27.902988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:27.903326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:27.904449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:27.908664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:27.909094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:27.911818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:27.940333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:27.940564 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3179/6331] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:27.953212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeec51d-98b7-4422-b20a-b58d58f8da69 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:27.964287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:27.965198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:27.965688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:27.966694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:27.967515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:27.970950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:28.076580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:28.078720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3153/6332] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:27 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:28.089613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea374c-ebe8-4b2c-8aed-1b166f24aff2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:28.203683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:28.204395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.204752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.205120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.205831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:28.207879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:28.360842 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3180/6333] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:28 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:28.362055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:28.375632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad26ea9-7d57-4aa4-a2da-f1bfeeef24e9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:28.389275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:28.389903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.390788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.391609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.391833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:28.393793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:28.410205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3154/6334] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:45:28.411394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:28.428862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa41c9-9c29-4ff2-ac05-69b19bd799c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:28.442015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:28.443447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.443766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.444056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.445444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:28.447650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175734cf-5e8b-4f76-b198-42b660080af4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:28.462378 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3181/6335] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:28.467011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:28.507369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ca91-ea4e-499c-9585-539d2df5d88e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:28.512617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:28.517198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.517198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.517198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] PATH_INFO: `/v3/projects/26eaf5de27024370acd22331bbedacf9/users/6faae162d5f84a9db61d322a00106e8d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.549590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eaf5de27024370acd22331bbedacf9, user_id=6faae162d5f84a9db61d322a00106e8d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:28.553539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:28.665887 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3155/6336] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:28 2022] PUT /identity/v3/projects/26eaf5de27024370acd22331bbedacf9/users/6faae162d5f84a9db61d322a00106e8d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:28.677178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.677686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.677763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.749227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] MFA Rules not processed for user `6faae162d5f84a9db61d322a00106e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:28.752029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:28.782946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:28.842834 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3182/6337] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:28.847259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:28.903151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:28.986283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc042c4-cdad-4ee0-a50f-24e9c43728ca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:28.995905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:28.996707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:28.997093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:28.997519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:28.998993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.003363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.151450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3156/6338] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:28 2022] POST /identity/v3/projects => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:29.156313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:29.177029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291469-8133-4701-9afd-7f2e0c664c9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:29.269503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:29.270136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.270420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.270885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:29.271680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.274019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.414769 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3183/6339] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:29 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:29.421215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:29.458492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e564-ea78-457f-b731-22c15d54350f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:29.471695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:29.472239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.472516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.472785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:29.473664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.476014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.500140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3157/6340] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:29.504091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:29.531563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9b65b-70a3-44d0-877f-059715364816 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:29.548442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:29.549757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.550790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.552030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] PATH_INFO: `/v3/projects/be0eb656022340a6bbd8f3ab26481f02/users/506fb68d880c4809b398685bf8906184/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:29.593408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0eb656022340a6bbd8f3ab26481f02, user_id=506fb68d880c4809b398685bf8906184, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.600387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.696539 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3184/6341] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:29 2022] PUT /identity/v3/projects/be0eb656022340a6bbd8f3ab26481f02/users/506fb68d880c4809b398685bf8906184/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:29.700821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:29.717864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb97a-524f-40cc-84d5-e9a3681bb5be admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:29.827678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:29.828517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.828805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.829084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:29.830064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.833291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05db1-868f-41e2-b865-6e1d79af4856 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.857039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3158/6342] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:29.857348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:29.917361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c4326-7e98-4bec-a8b4-110fb0e9e857 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:29.932302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:29.933215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.934342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.935077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] PATH_INFO: `/v3/projects/be0eb656022340a6bbd8f3ab26481f02/users/506fb68d880c4809b398685bf8906184/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:29.941203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0eb656022340a6bbd8f3ab26481f02, user_id=506fb68d880c4809b398685bf8906184, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:29.948555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:29.978794 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3185/6343] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:29 2022] PUT /identity/v3/projects/be0eb656022340a6bbd8f3ab26481f02/users/506fb68d880c4809b398685bf8906184/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:29.985261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:29.985752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:29.986203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:30.028177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] MFA Rules not processed for user `506fb68d880c4809b398685bf8906184`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:30.029501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:30.147178 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3159/6344] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:30.148505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:30.163475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ef31-0993-4c47-9d33-710d985e3c0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:30.173203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506fb68d880c4809b398685bf8906184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0eb656022340a6bbd8f3ab26481f02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:30.174166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:30.174931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:30.176010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:30.176901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:30.177379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:30.180621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:30.231953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:30.250468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3186/6345] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:30.260474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3b4e0-bcff-4c9d-8663-064993277780 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:30.276574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506fb68d880c4809b398685bf8906184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0eb656022340a6bbd8f3ab26481f02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:30.277203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:30.277479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:30.278091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:30.278400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:30.280360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:30.323202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:30.422438 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3160/6346] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:30 2022] POST /identity/v3/projects => generated 350 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:30.427274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:30.443387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57715a5-64b5-4abe-abd5-ac70a3de9d9c tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:30.534314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506fb68d880c4809b398685bf8906184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0eb656022340a6bbd8f3ab26481f02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:30.534512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:30.535060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:30.535307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:30.536247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:30.536361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:30.538529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:30.541608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:30.558826 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3187/6347] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:30.566914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:30.569473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:30.671111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be151-2be1-425c-89c8-5fb4f29284e7 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:30.675669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:30.676337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:30.676601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:30.676866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:30.687894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:30.689427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:30.703406 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3161/6348] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:45:34.509576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:34.532407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2480-a0ae-498e-a964-5cd1c0a23992 tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:34.562583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '506fb68d880c4809b398685bf8906184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0eb656022340a6bbd8f3ab26481f02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:34.563300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:34.563676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:34.563968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] PATH_INFO: `/v3/projects/9d79c07cb4fa470ba11dd671837e2dca` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:34.579732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d79c07cb4fa470ba11dd671837e2dca)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:34.585648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:34.767388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d79c07cb4fa470ba11dd671837e2dca', 'request_id': 'req-799779fe-a7dd-4dc5-80d0-96527efcd2fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:34.900296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d79c07cb4fa470ba11dd671837e2dca', 'request_id': 'req-799779fe-a7dd-4dc5-80d0-96527efcd2fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:34.917549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d79c07cb4fa470ba11dd671837e2dca', 'request_id': 'req-799779fe-a7dd-4dc5-80d0-96527efcd2fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:34.935972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] The token cache is being invalidate because project 9d79c07cb4fa470ba11dd671837e2dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:34.936439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:34.943534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-799779fe-a7dd-4dc5-80d0-96527efcd2fd tempest-QuotasNegativeTest-1038760759 tempest-QuotasNegativeTest-1038760759-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:34.943534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3188/6349] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:34 2022] DELETE /identity/v3/projects/9d79c07cb4fa470ba11dd671837e2dca => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:34.944671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:35.094962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb99da-d667-4692-9bc0-16c5e37395bb service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:35.191943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:35.193140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:35.193488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:35.193839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] PATH_INFO: `/v3/users/6faae162d5f84a9db61d322a00106e8d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:35.195282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faae162d5f84a9db61d322a00106e8d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:35.197698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:35.463592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:35.464956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faae162d5f84a9db61d322a00106e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:35.465709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faae162d5f84a9db61d322a00106e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:35.576129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faae162d5f84a9db61d322a00106e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:35.595434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faae162d5f84a9db61d322a00106e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:35.596577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faae162d5f84a9db61d322a00106e8d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:35.610131 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3162/6350] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:34 2022] DELETE /identity/v3/users/6faae162d5f84a9db61d322a00106e8d => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:35.614649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:35.615208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:35.615208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:35.673370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:35.675177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:35.796048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:35.797777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:35.804740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3189/6351] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:35.880742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bf65-1d82-4ef3-8268-c4c8fe275b03 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:35.885027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:35.885892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:35.886253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:35.886487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:35.896312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:35.897835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:35.909621 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3163/6352] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:45:36.649060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:36.651917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:36.686377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117c40c-f841-4e7c-898c-bf51550e43d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:36.698049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:36.700425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:36.701564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:36.703014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] PATH_INFO: `/v3/projects/26eaf5de27024370acd22331bbedacf9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:36.707858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26eaf5de27024370acd22331bbedacf9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:36.709954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:36.897667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26eaf5de27024370acd22331bbedacf9', 'request_id': 'req-227a6307-eb63-4edb-a9ac-bb2a9e957a81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:36.973912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26eaf5de27024370acd22331bbedacf9', 'request_id': 'req-227a6307-eb63-4edb-a9ac-bb2a9e957a81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:36.985377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26eaf5de27024370acd22331bbedacf9', 'request_id': 'req-227a6307-eb63-4edb-a9ac-bb2a9e957a81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.006348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] The token cache is being invalidate because project 26eaf5de27024370acd22331bbedacf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:37.008126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.009467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.012707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3190/6353] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:36 2022] DELETE /identity/v3/projects/26eaf5de27024370acd22331bbedacf9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:37.017184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:37.035731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63dd-b5eb-4d00-b91a-b78fd3c9c642 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:37.179227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:37.179984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:37.180352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:37.180881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] PATH_INFO: `/v3/users/506fb68d880c4809b398685bf8906184` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:37.182117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=506fb68d880c4809b398685bf8906184)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:37.184155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:37.223649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:37.225123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:37.230670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:37.306395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6307-eb63-4edb-a9ac-bb2a9e957a81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:37.310645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:37.313968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:37.314501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:37.315026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:37.317286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:37.331117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:37.332924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:37.367573 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3191/6354] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:45:37.452106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506fb68d880c4809b398685bf8906184'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.452994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506fb68d880c4809b398685bf8906184'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.573286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506fb68d880c4809b398685bf8906184'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.591889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:37.593178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506fb68d880c4809b398685bf8906184'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.594804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506fb68d880c4809b398685bf8906184'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:37.619370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3164/6355] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:37 2022] DELETE /identity/v3/users/506fb68d880c4809b398685bf8906184 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:37.904067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:37.907963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:38.154537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f492b-3d70-4ab9-8b02-776016bde8e5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:38.327560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:38.334657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:38.334657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:38.334657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:38.334657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:38.470538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:38.540186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:38.541659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:38.571141 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3192/6356] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:38.605668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:38.612623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:38.713545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913980a0-62f2-40e5-a86d-a3e30d8d80cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:38.720080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:38.720871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:38.721099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:38.721499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] PATH_INFO: `/v3/projects/be0eb656022340a6bbd8f3ab26481f02` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:38.722643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0eb656022340a6bbd8f3ab26481f02)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:38.725264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:38.833872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:38.835446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:38.898350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c701b-c492-4eb7-a69a-f78ee4c8152c service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:38.903203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:38.904084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:38.904953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:38.905903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:38.908941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:38.918454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0eb656022340a6bbd8f3ab26481f02', 'request_id': 'req-6ef94faa-b090-411e-aceb-d9fca7148289'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:38.924570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:38.926097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ce779-ec0b-4886-a79b-b202d65e8940 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:38.943547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3193/6357] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:45:39.093545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0eb656022340a6bbd8f3ab26481f02', 'request_id': 'req-6ef94faa-b090-411e-aceb-d9fca7148289'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:39.107780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0eb656022340a6bbd8f3ab26481f02', 'request_id': 'req-6ef94faa-b090-411e-aceb-d9fca7148289'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:39.126410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] The token cache is being invalidate because project be0eb656022340a6bbd8f3ab26481f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:39.127173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:39.128115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ef94faa-b090-411e-aceb-d9fca7148289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:39.134214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3165/6358] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:38 2022] DELETE /identity/v3/projects/be0eb656022340a6bbd8f3ab26481f02 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:39.135616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:39.135904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:39.136227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:39.209364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:39.212444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:39.394266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3194/6359] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:45:39.403906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:39.404276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:39.404474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:39.496606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:39.497854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:39.520076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3166/6360] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:39.531279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:39.560402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b9a2-23e3-4ab6-be45-1eaf99d96610 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:39.595642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:39.596294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:39.596579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:39.598012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:39.598770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:39.599086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:39.610498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:39.643605 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3195/6361] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:39.644445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:39.672945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd85b8-45f5-4811-a405-f1c60d9b982d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:39.699116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:39.699731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:39.700014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:39.700286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:39.700925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:39.704586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:39.823309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3167/6362] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:39 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:39.827793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:39.845260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6b086-650a-4fd1-a364-f396bd03d39c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:39.921927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:39.922844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:39.923185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:39.923529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:39.924273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:39.926205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:39.938335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:40.047634 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3196/6363] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:39 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:40.051389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:40.063378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29ea0-ec8f-4794-abb0-4bd95447373d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:40.068035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:40.068637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.068915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.069183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.069817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:40.071488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:40.082281 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3168/6364] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:40.086971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:40.098210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fecbc8-bc3b-4af0-97af-ac72d12eb9c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:40.103100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:40.103700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.103980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.104254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.104907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:40.106488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0ab60-5b52-4797-a700-881c832b24f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:40.118080 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3197/6365] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:40.122138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:40.134291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62377-a187-41d9-a9bc-7b10f97ba209 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:40.140031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:40.140885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.141134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.141476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] PATH_INFO: `/v3/projects/2bc76e27478b4c6e94a021a72fe8a4fd/users/b04d8edcb29a47d98082dadddf897978/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.161706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc76e27478b4c6e94a021a72fe8a4fd, user_id=b04d8edcb29a47d98082dadddf897978, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:40.164490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:40.326458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3169/6366] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:40 2022] PUT /identity/v3/projects/2bc76e27478b4c6e94a021a72fe8a4fd/users/b04d8edcb29a47d98082dadddf897978/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:40.337709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.338313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.338786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.379046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] MFA Rules not processed for user `b04d8edcb29a47d98082dadddf897978`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:40.380388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:40.463246 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3198/6367] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:40.467550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:40.482912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:40.539362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8fbfd-0ff7-42bb-a95d-2b91c8790a79 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:40.544245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:40.545021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.546776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.546776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.546776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:40.548492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:40.777679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3170/6368] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:40 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:40.782444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:40.843779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4894c-97c9-4e39-863b-9f71f02555bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:40.932948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:40.933711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:40.934208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:40.934489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:40.935746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:40.938858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.099690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3199/6369] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:40 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:41.104597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:41.124052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6a34e-44fa-4443-a7d6-69ef327a0074 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:41.130284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:41.131964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.132482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.132818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.133540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:41.135392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.148207 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3171/6370] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:41.152580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:41.164307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762933a-9b16-4420-9591-937ba6ed4d1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:41.169041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:41.169770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.170152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.170493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] PATH_INFO: `/v3/projects/79e95e2836c34c0b9363da485d3ecda7/users/fd60efeb20a745408d497a9fcf7f47f4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.190207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e95e2836c34c0b9363da485d3ecda7, user_id=fd60efeb20a745408d497a9fcf7f47f4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:41.191752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.302527 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3200/6371] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:41 2022] PUT /identity/v3/projects/79e95e2836c34c0b9363da485d3ecda7/users/fd60efeb20a745408d497a9fcf7f47f4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:41.306312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:41.327397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ca1d-865b-47e8-a00b-dad2c1e8e4df admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:41.400858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:41.402151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.402656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.403240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.404225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:41.406415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fefec-5ba4-44cc-b38e-8999abdda0fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.419564 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3172/6372] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:41.424244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:41.439140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4ab9-0931-4806-8b76-c0290306d70e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:41.444665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:41.445442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.445828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.446206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] PATH_INFO: `/v3/projects/79e95e2836c34c0b9363da485d3ecda7/users/fd60efeb20a745408d497a9fcf7f47f4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.448591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e95e2836c34c0b9363da485d3ecda7, user_id=fd60efeb20a745408d497a9fcf7f47f4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:41.451516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.465837 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3201/6373] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:41 2022] PUT /identity/v3/projects/79e95e2836c34c0b9363da485d3ecda7/users/fd60efeb20a745408d497a9fcf7f47f4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:41.483116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.483429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.484209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.521223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] MFA Rules not processed for user `fd60efeb20a745408d497a9fcf7f47f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:41.522729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:41.651331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3173/6374] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:41.663171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:41.666006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:41.735163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:41.786848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f372359-00df-451c-b2ca-3ae5772a6600 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:41.790507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:41.791315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:41.791968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:41.792598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:41.805287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:41.806771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e630-5a14-41b1-9103-22c8c33e2d0b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:41.817237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3202/6375] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:43.913786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:43.915423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:43.925264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:44.016621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095a93-6f7a-4723-b826-4509355639c8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:44.021288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:44.021933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:44.022297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:44.022530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] PATH_INFO: `/v3/users/642316255c4940488e7f15a72e27bfd6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:44.023901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642316255c4940488e7f15a72e27bfd6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:44.025986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:44.378517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642316255c4940488e7f15a72e27bfd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:44.381836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642316255c4940488e7f15a72e27bfd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:44.510648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642316255c4940488e7f15a72e27bfd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:44.533260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642316255c4940488e7f15a72e27bfd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:44.534631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642316255c4940488e7f15a72e27bfd6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:44.550227 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3174/6376] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:43 2022] DELETE /identity/v3/users/642316255c4940488e7f15a72e27bfd6 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:44.554853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2cac0-1f28-4d7c-b886-6855d431ac9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:44.555411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2cac0-1f28-4d7c-b886-6855d431ac9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:44.555411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2cac0-1f28-4d7c-b886-6855d431ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:44.581520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0ec2cac0-1f28-4d7c-b886-6855d431ac9a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:44.582999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ec2cac0-1f28-4d7c-b886-6855d431ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:44.665698 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3203/6377] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:44.676630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:44.678113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:44.754032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86119cb-1e53-4478-88ac-32ef54d21197 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:44.757520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:44.758148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:44.758427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:44.758734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:44.771100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:44.772574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:44.787507 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3175/6378] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:45.282187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.283037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.283597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.312846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:45.315641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.322060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:45.323809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.341496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76196c-a5f9-48fd-ac94-5917292167d1 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:45.349855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:45.351268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.351781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.352261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] PATH_INFO: `/v3/projects/f16f9db4892d42c5b278d1b4c58e4581` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.354270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16f9db4892d42c5b278d1b4c58e4581)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:45.357410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:45.397007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:45.432828 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3204/6379] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:45:45.448416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:45.449934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.513925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16f9db4892d42c5b278d1b4c58e4581', 'request_id': 'req-da45186b-35cc-4b55-a023-c8dd5a513e56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:45.603370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578596fb-36a3-4fd4-9e10-1d5cde3eb7b3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:45.616734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:45.660891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16f9db4892d42c5b278d1b4c58e4581', 'request_id': 'req-da45186b-35cc-4b55-a023-c8dd5a513e56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:45.667529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16f9db4892d42c5b278d1b4c58e4581', 'request_id': 'req-da45186b-35cc-4b55-a023-c8dd5a513e56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:45.679689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] The token cache is being invalidate because project f16f9db4892d42c5b278d1b4c58e4581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:45.680065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:45.680729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-da45186b-35cc-4b55-a023-c8dd5a513e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:45.682662 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3176/6380] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:45 2022] DELETE /identity/v3/projects/f16f9db4892d42c5b278d1b4c58e4581 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:45.687713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:45.688341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.688620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.688889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.690816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.702841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.715710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.718210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.748760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:45.751005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.805785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:45.808648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335441b-8038-45c7-8576-797b85b9b2cf service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:45.822948 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3205/6381] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:45:45.857874 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3177/6382] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:45.866079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.867199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.867860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.896022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:45.897912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:45.912991 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3206/6383] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:45.914311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:45.929264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32d017-d8ce-4b58-ad8a-203392b011db None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:45.938922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:45.939557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.939839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.940114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.941350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:45.942169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:45.946336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:45.964562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3178/6384] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:45:45.972524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:45.976449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4a45b-3568-49a1-853b-e1adec6db341 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:45.981884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:45.982603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:45.982983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:45.983326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:45.984619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:45.986853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:46.209927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3207/6385] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:45 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:46.211353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:46.226055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5172da-60fc-40ad-8ef8-c5573f5777f7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:46.375004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:46.375670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:46.375990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:46.376262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:46.376901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:46.378869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:46.538699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3179/6386] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:46 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:46.543212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:46.566379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a62d2-a001-4abf-99bc-2ea01d4d2849 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:46.571949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:46.572724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:46.573077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:46.573468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:46.574229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:46.576024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:46.599466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3208/6387] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:45:46.603433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:46.637957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ed51-d09a-467a-ba12-5bcccc9c8b56 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:46.658958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:46.659501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:46.659778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:46.660039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:46.660726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:46.662339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17970-0fab-43ab-a389-2e12ab2e1a25 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:46.709510 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3180/6388] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:46.713601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:46.737447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7b3c7-1f86-4a01-89a6-dda566157d88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:46.752406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:46.753093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:46.753972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:46.753972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] PATH_INFO: `/v3/projects/c1ec36ab012b41a39a0a3f3243753ece/users/562ec6916ef44723bb5e8e5042d4c8c3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:46.792212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ec36ab012b41a39a0a3f3243753ece, user_id=562ec6916ef44723bb5e8e5042d4c8c3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:46.794966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:46.966371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3209/6389] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:46 2022] PUT /identity/v3/projects/c1ec36ab012b41a39a0a3f3243753ece/users/562ec6916ef44723bb5e8e5042d4c8c3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:46.969469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:46.969791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:46.974959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:47.103502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] MFA Rules not processed for user `562ec6916ef44723bb5e8e5042d4c8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:47.105089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:47.112854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:47.235624 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3181/6390] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:47.247901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:47.250453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:47.331777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a9c9-9a54-4357-abbd-a5b5b887a484 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:47.344954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:47.345732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:47.346086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:47.346199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:47.357697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:47.362796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:47.364370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740def-c94f-4849-9647-c7dfa16ee50b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:47.399055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3210/6391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:47.400387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:47.488582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa2e6-f9f4-4e8a-8920-6961bb390697 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:47.501101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:47.502391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:47.502931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:47.503426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] PATH_INFO: `/v3/users/562ec6916ef44723bb5e8e5042d4c8c3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:47.505676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ec6916ef44723bb5e8e5042d4c8c3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:47.510099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:47.795440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ec6916ef44723bb5e8e5042d4c8c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:47.797730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ec6916ef44723bb5e8e5042d4c8c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:47.968331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ec6916ef44723bb5e8e5042d4c8c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:47.986343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ec6916ef44723bb5e8e5042d4c8c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:47.987156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ec6916ef44723bb5e8e5042d4c8c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:48.040399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3182/6392] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:47 2022] DELETE /identity/v3/users/562ec6916ef44723bb5e8e5042d4c8c3 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:48.055895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:48.056447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:48.058338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:48.110904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:48.113605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:48.256154 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3211/6393] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:48.263803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:48.266657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:48.307776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:48.338889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa057c7d-2ecd-4fc9-82ef-37c0bb1c569f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:48.344333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:48.344963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:48.345405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:48.345854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:48.366291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:48.367657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714458-cdb8-48d6-90d0-e4cb5e163081 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:48.403915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3183/6394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:49.159643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:49.161241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:49.183012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56e220-0f0b-4fc1-8ed7-6ad6d7519328 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:49.207642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:49.208606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:49.209046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:49.209506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] PATH_INFO: `/v3/projects/c1ec36ab012b41a39a0a3f3243753ece` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:49.211343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ec36ab012b41a39a0a3f3243753ece)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:49.213531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:49.456091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ec36ab012b41a39a0a3f3243753ece', 'request_id': 'req-82cef72d-fb4c-4582-9310-25847fb837f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:49.553873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ec36ab012b41a39a0a3f3243753ece', 'request_id': 'req-82cef72d-fb4c-4582-9310-25847fb837f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:49.556976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ec36ab012b41a39a0a3f3243753ece', 'request_id': 'req-82cef72d-fb4c-4582-9310-25847fb837f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:49.584247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] The token cache is being invalidate because project c1ec36ab012b41a39a0a3f3243753ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:49.584537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:49.595087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82cef72d-fb4c-4582-9310-25847fb837f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:49.596806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3212/6395] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:49 2022] DELETE /identity/v3/projects/c1ec36ab012b41a39a0a3f3243753ece => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:49.602757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:49.603679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:49.604832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:49.645819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:49.647771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:49.831191 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3184/6396] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:49.840059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:49.840356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:49.840637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:49.902026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:49.903521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:49.925330 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3213/6397] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:49.929554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:49.946049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae56aa-dc0e-4bc6-9d5b-db03b8a43664 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:49.957303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:49.958253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:49.958758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:49.959387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:49.959950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:49.960375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:49.962406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:49.984603 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3185/6398] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:49.988766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:50.000554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191861-b9b7-43d5-a7ef-4c3fb65e16b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:50.015367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:50.016041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:50.016298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:50.016569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:50.017416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:50.024005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:50.173166 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3214/6399] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:49 2022] POST /identity/v3/projects => generated 403 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:50.177694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:50.199797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7794-fea2-43b0-a0cd-2e7bd84ef9ce admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:50.413262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:50.414355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:50.414846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:50.415293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:50.416087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:50.421672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:50.566266 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3186/6400] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:50 2022] POST /identity/v3/users => generated 302 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:50.566464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:50.588394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c535fb-5a5a-416d-aee6-55c755b390cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:50.607398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:50.608079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:50.608957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:50.609181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:50.609839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:50.632158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:50.662108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3215/6401] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:50.663636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:50.679417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af1842-34a5-47a1-82d3-5b478475b375 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:50.716892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:50.718410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:50.720401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:50.721038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:50.726746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:50.737142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bc989-11c6-4e59-8db6-8187b21a0995 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:50.762588 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3187/6402] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:50.768261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:50.806238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575726-50da-4a25-8ece-ee0dcd07c0e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:50.815298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:50.816100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:50.816492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:50.816806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] PATH_INFO: `/v3/projects/3c54d44d5ee645c0ac9a385b0ce208e9/users/2a9bea9d0d6244d9968e43d4e0a4838d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:50.840714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c54d44d5ee645c0ac9a385b0ce208e9, user_id=2a9bea9d0d6244d9968e43d4e0a4838d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:50.848261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:50.990214 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3216/6403] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:50 2022] PUT /identity/v3/projects/3c54d44d5ee645c0ac9a385b0ce208e9/users/2a9bea9d0d6244d9968e43d4e0a4838d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:51.015800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:51.016115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:51.016681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:51.106804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] MFA Rules not processed for user `2a9bea9d0d6244d9968e43d4e0a4838d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:51.109565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:51.193783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:51.335566 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3188/6404] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:51.339078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:51.390580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:51.491541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c3bb-9015-476a-b520-c96a2b5462eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:51.501173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:51.503108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:51.504099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:51.505005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:51.506812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:51.516445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:51.633325 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3217/6405] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:51 2022] POST /identity/v3/projects => generated 401 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:51.637468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:51.657449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171abc0-286f-48bc-ac15-b766f1384074 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:51.718925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:51.719630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:51.719909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:51.720089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:51.720697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:51.722685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:52.170120 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3189/6406] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:51 2022] POST /identity/v3/users => generated 307 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:52.174575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:52.194500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd3449-62e6-4147-8f96-fb356ca343f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:52.207331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:52.207999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:52.208372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:52.208509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:52.209668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:52.213239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:52.246275 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3218/6407] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:52.250916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:52.266817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80276-866e-42f0-9e82-bf28d1994f45 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:52.276368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:52.277439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:52.278374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:52.278871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] PATH_INFO: `/v3/projects/e257309b4c9e4a3d90745060d9c2ef82/users/5c1be967f8cc40b0b22cfacb79d55227/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:52.445585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e257309b4c9e4a3d90745060d9c2ef82, user_id=5c1be967f8cc40b0b22cfacb79d55227, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:52.445585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:52.641676 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3190/6408] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:52 2022] PUT /identity/v3/projects/e257309b4c9e4a3d90745060d9c2ef82/users/5c1be967f8cc40b0b22cfacb79d55227/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:52.645465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:52.675005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23052fd-2b19-4fb3-b3fc-47cfaa772500 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:52.887526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:52.888323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:52.888752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:52.889124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:52.890640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:52.894116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955da22a-847d-4c0c-832e-a949e7f6a72a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:52.932305 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3219/6409] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:45:52.932553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:52.970416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4cfee-de26-4353-a195-f5709a710af9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:52.987978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:52.992262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:52.992262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:52.992262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] PATH_INFO: `/v3/projects/e257309b4c9e4a3d90745060d9c2ef82/users/5c1be967f8cc40b0b22cfacb79d55227/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:52.999451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e257309b4c9e4a3d90745060d9c2ef82, user_id=5c1be967f8cc40b0b22cfacb79d55227, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:53.008422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:53.036466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:53.037191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:53.037625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:53.047748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3191/6410] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:52 2022] PUT /identity/v3/projects/e257309b4c9e4a3d90745060d9c2ef82/users/5c1be967f8cc40b0b22cfacb79d55227/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:53.083098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] MFA Rules not processed for user `5c1be967f8cc40b0b22cfacb79d55227`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:53.084771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:53.219014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3220/6411] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:53.228566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:53.238255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:53.415817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f05d34-8aa0-4211-9bd8-862ad817477e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:53.422982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:53.423806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:53.424256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:53.424625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:53.443288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:53.445119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:53.465667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3192/6412] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:53.742329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:53.760349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:53.883245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9dd9f-c7e0-4f60-94ff-58d96ee0b1e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:53.890394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:53.891807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:53.892467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:53.892982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] PATH_INFO: `/v3/users/2a9bea9d0d6244d9968e43d4e0a4838d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:53.894685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9bea9d0d6244d9968e43d4e0a4838d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:53.897758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:54.215892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:54.217415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:54.272927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:54.286507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9bea9d0d6244d9968e43d4e0a4838d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:54.288231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9bea9d0d6244d9968e43d4e0a4838d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:54.349710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642441-e32a-491f-8598-95e430fcda6e service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:54.356159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd60efeb20a745408d497a9fcf7f47f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79e95e2836c34c0b9363da485d3ecda7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:54.357406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:54.358051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:54.358960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:54.359868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:54.360384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:54.362367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:54.383816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3193/6413] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:54.384954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:54.386842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:54.393005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9bea9d0d6244d9968e43d4e0a4838d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:54.402846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12f720-ac5e-4911-8493-dd354adaffa3 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:54.408596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd60efeb20a745408d497a9fcf7f47f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79e95e2836c34c0b9363da485d3ecda7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:54.409361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:54.409785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:54.409909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:54.410736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:54.412631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:54.419352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9bea9d0d6244d9968e43d4e0a4838d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:54.419352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a5c042-e61d-4927-bf5a-9f529c5e485c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9bea9d0d6244d9968e43d4e0a4838d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:54.447016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3221/6414] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:53 2022] DELETE /identity/v3/users/2a9bea9d0d6244d9968e43d4e0a4838d => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:54.451664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:54.456603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:54.457014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:54.511018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:54.512498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:54.535742 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3194/6415] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:54 2022] POST /identity/v3/projects => generated 349 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:54.542397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:54.681821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3222/6416] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:54.693511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:54.695308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:54.754187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4a08d-e146-478e-96b3-3bda3b1b9635 tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:54.768534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd60efeb20a745408d497a9fcf7f47f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79e95e2836c34c0b9363da485d3ecda7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:54.769169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:54.769446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:54.773292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:54.774405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:54.774816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:54.778693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:54.824268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:54.875586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aae76-4883-4696-89c2-0001d17b6f0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:54.883581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3195/6417] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:55.014200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:55.019933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:55.023623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:55.023623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:55.176985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:55.178454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:55.201711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3223/6418] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:45:55.915308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:55.917172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:55.950067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e2cc-62d5-470c-9c25-940c0e9563eb tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:55.985776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:55.986768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:55.989626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:55.990522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] PATH_INFO: `/v3/projects/3c54d44d5ee645c0ac9a385b0ce208e9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:55.992209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c54d44d5ee645c0ac9a385b0ce208e9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:55.998075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:56.232456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c54d44d5ee645c0ac9a385b0ce208e9', 'request_id': 'req-4dd35754-70e7-4ba8-8723-c34e8509e205'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:56.424645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c54d44d5ee645c0ac9a385b0ce208e9', 'request_id': 'req-4dd35754-70e7-4ba8-8723-c34e8509e205'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:56.435493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c54d44d5ee645c0ac9a385b0ce208e9', 'request_id': 'req-4dd35754-70e7-4ba8-8723-c34e8509e205'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:56.485938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] The token cache is being invalidate because project 3c54d44d5ee645c0ac9a385b0ce208e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:56.486295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:56.489281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:56.498016 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3196/6419] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:55 2022] DELETE /identity/v3/projects/3c54d44d5ee645c0ac9a385b0ce208e9 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:56.499867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:56.525921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aa1ff-5cdc-46de-bc26-5c55d6eef117 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:56.690529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:56.691167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:56.691537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:56.691938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] PATH_INFO: `/v3/users/5c1be967f8cc40b0b22cfacb79d55227` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:56.693263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1be967f8cc40b0b22cfacb79d55227)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:56.695312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:56.908923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:56.910610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:56.929322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:57.018822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd35754-70e7-4ba8-8723-c34e8509e205 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:57.024273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd60efeb20a745408d497a9fcf7f47f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79e95e2836c34c0b9363da485d3ecda7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:57.032065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:57.032065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:57.032065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] PATH_INFO: `/v3/projects/08c3a23aa8214af3a1933dba5d276fcf` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:57.032065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08c3a23aa8214af3a1933dba5d276fcf)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:57.032441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:57.109908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:57.140578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1be967f8cc40b0b22cfacb79d55227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.140578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1be967f8cc40b0b22cfacb79d55227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.236022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c3a23aa8214af3a1933dba5d276fcf', 'request_id': 'req-0e001970-c274-4bac-ba49-c07fde0aaaae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.304790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1be967f8cc40b0b22cfacb79d55227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.325859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1be967f8cc40b0b22cfacb79d55227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.327750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1be967f8cc40b0b22cfacb79d55227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.363797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3224/6420] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:45:56 2022] DELETE /identity/v3/users/5c1be967f8cc40b0b22cfacb79d55227 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:57.462582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c3a23aa8214af3a1933dba5d276fcf', 'request_id': 'req-0e001970-c274-4bac-ba49-c07fde0aaaae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.477144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c3a23aa8214af3a1933dba5d276fcf', 'request_id': 'req-0e001970-c274-4bac-ba49-c07fde0aaaae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.514298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] The token cache is being invalidate because project 08c3a23aa8214af3a1933dba5d276fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:57.515197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.519144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:57.522816 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3197/6421] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:56 2022] DELETE /identity/v3/projects/08c3a23aa8214af3a1933dba5d276fcf => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:45:57.536798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:57.539251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:57.731863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1171-13a3-4288-9564-05a00ee4f0c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:57.731863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:57.751458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:57.751747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:57.752005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:57.756379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:57.919787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:57.921955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9bb1-8060-47b3-b61f-49e1c06b51fa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:57.944952 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3225/6422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:45:58.318345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:58.320684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:58.401088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e001970-c274-4bac-ba49-c07fde0aaaae tempest-RoutersIpV6AdminTest-50471705 tempest-RoutersIpV6AdminTest-50471705-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:58.509595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:58.510644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:58.511382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:58.511855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] PATH_INFO: `/v3/projects/e257309b4c9e4a3d90745060d9c2ef82` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:58.515595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e257309b4c9e4a3d90745060d9c2ef82)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:58.519441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:58.692887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e257309b4c9e4a3d90745060d9c2ef82', 'request_id': 'req-9791cc2d-77be-4cdb-87b8-06063fec0a38'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:58.747842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:58.794136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e257309b4c9e4a3d90745060d9c2ef82', 'request_id': 'req-9791cc2d-77be-4cdb-87b8-06063fec0a38'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:58.811387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e257309b4c9e4a3d90745060d9c2ef82', 'request_id': 'req-9791cc2d-77be-4cdb-87b8-06063fec0a38'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:58.833971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] The token cache is being invalidate because project e257309b4c9e4a3d90745060d9c2ef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:45:58.834154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:58.835157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9791cc2d-77be-4cdb-87b8-06063fec0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:45:58.843381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3198/6423] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:45:58 2022] DELETE /identity/v3/projects/e257309b4c9e4a3d90745060d9c2ef82 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:58.845130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:58.845597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:58.845700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:58.891655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:58.892883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:59.030287 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3226/6424] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:59.032093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.032388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.032685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.056126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:59.057923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:59.073636 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3199/6425] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:45:59.075578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.088692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2d7fd-f105-4c86-9313-65930072b33c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.095980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.095980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.095980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.095980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.096485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:45:59.096821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.098639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.106718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:45:59.117532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.158854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755330-14c8-47f0-8f97-9df2d7074831 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.159017 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3227/6426] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:45:59.159117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.159117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.159117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.159117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.159468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.159468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.283986 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3200/6427] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:45:59.288572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.301117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d974-50b0-4713-baa9-31661f94e2d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.420202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.421388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.421692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.421951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.422873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.425107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.623530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3228/6428] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:45:59 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:45:59.625468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.636444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd867b3e-1f5c-4c0a-a599-1952473b3d35 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.641200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.641878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.642245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.642592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.643361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.645080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.656613 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3201/6429] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:59.661068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.672963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c8df-9570-4543-bdbb-c309d37cb76a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.678046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.679404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.679802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.680331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.681071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.683088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fefe4-7299-4484-a0c9-3258230b99b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.700233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3229/6430] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:45:59.701562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:45:59.726943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982d1f-4fdf-4c75-a44d-bcf9b8a8ceca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:45:59.735932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:45:59.738957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.738957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.738957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] PATH_INFO: `/v3/projects/ad7f06455f6241d7a2a848f44012e66f/users/c48a77c8504c4b2894416f7b49c94d76/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.759808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7f06455f6241d7a2a848f44012e66f, user_id=c48a77c8504c4b2894416f7b49c94d76, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:45:59.771030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:45:59.869945 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3202/6431] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:45:59 2022] PUT /identity/v3/projects/ad7f06455f6241d7a2a848f44012e66f/users/c48a77c8504c4b2894416f7b49c94d76/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:45:59.880471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:45:59.881000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:45:59.881102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:45:59.913256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] MFA Rules not processed for user `c48a77c8504c4b2894416f7b49c94d76`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:45:59.914882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:45:59.988233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3230/6432] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:45:59.992699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.079655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370deb5d-0671-473e-ae89-e17fd2a00445 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.085569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.086306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.086800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.087141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.087850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.091808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:00.305426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:00.314779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3203/6433] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:46:00.319328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.336639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae289-9789-43e4-830c-5ab19faf2753 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.441018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.447086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.447086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.447086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.447086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.447086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:00.634680 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3231/6434] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:00 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:00.636052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.649089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67e50-f901-4f9c-8b9b-3bee95dc15b5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.662012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.662757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.663106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.663498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.664233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.666009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:00.678929 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3204/6435] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:00.683294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.695045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e71f6-2767-446c-9eba-cd00b374c32d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.699913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.700655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.701108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.701452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] PATH_INFO: `/v3/projects/23d2e9104fe143018e27eeabe60afc33/users/a0965d3c1e3045779a8f4c96cf24fd0a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.719416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d2e9104fe143018e27eeabe60afc33, user_id=a0965d3c1e3045779a8f4c96cf24fd0a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.722861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:00.842905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:00.860066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3232/6436] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:00 2022] PUT /identity/v3/projects/23d2e9104fe143018e27eeabe60afc33/users/a0965d3c1e3045779a8f4c96cf24fd0a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:00.861393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.873449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5957-b442-4e12-bf37-1ef3f4b34de6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.941450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.942070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.945830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.945830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.945830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.945830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13365a3-c583-4d4e-b1c3-091a3b3c1912 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:00.961441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3205/6437] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:00.962333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:00.976113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325a02b-0537-4080-8c41-106d14c55788 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:00.981482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:00.982239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:00.982594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:00.983000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] PATH_INFO: `/v3/projects/23d2e9104fe143018e27eeabe60afc33/users/a0965d3c1e3045779a8f4c96cf24fd0a/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:00.985622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d2e9104fe143018e27eeabe60afc33, user_id=a0965d3c1e3045779a8f4c96cf24fd0a, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:00.988773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:01.014972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:01.015361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:01.015701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:01.024956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3233/6438] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:00 2022] PUT /identity/v3/projects/23d2e9104fe143018e27eeabe60afc33/users/a0965d3c1e3045779a8f4c96cf24fd0a/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:01.079996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] MFA Rules not processed for user `a0965d3c1e3045779a8f4c96cf24fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:01.081411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:01.192575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3206/6439] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:01.203541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:01.205264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:01.288695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf76c-1865-4cbf-a1c4-ceaa948d93a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:01.293087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:01.293723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:01.294004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:01.294281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:01.382969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:01.384788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e612d3-dd61-40a7-aeb5-0225b1fd7e4e service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:01.397857 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3234/6440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:01.506313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:01.508025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:01.637312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e071-3a80-4896-8090-a8ecaed41620 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:01.644744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:01.644744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:01.645334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:01.645809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] PATH_INFO: `/v3/users/ad661eceb09d4e14a9696aee73f3be54` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:01.647389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad661eceb09d4e14a9696aee73f3be54)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:01.649687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:01.663501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:01.955120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad661eceb09d4e14a9696aee73f3be54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:01.955862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad661eceb09d4e14a9696aee73f3be54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:02.112820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad661eceb09d4e14a9696aee73f3be54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:02.130139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad661eceb09d4e14a9696aee73f3be54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:02.130918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad661eceb09d4e14a9696aee73f3be54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:02.147728 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3207/6441] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:01 2022] DELETE /identity/v3/users/ad661eceb09d4e14a9696aee73f3be54 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:02.152629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:02.153097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:02.153097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:02.188084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:02.189355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:02.279768 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3235/6442] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:02.288252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:02.289452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:02.397285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d656441-04ab-4fc1-ab03-1bfca89091cd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:02.403169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:02.403169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:02.403169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:02.403169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:02.412550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:02.414071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:02.425758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3208/6443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:03.156281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:03.158429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:03.190077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fe340-ec36-4207-adfb-f4d25a94e218 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:03.195446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:03.200772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:03.202970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:03.203325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] PATH_INFO: `/v3/projects/2d29e8890a4e4cf8b07fac0d7a2caa25` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:03.205133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d29e8890a4e4cf8b07fac0d7a2caa25)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:03.207194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:03.216157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:03.383812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d29e8890a4e4cf8b07fac0d7a2caa25', 'request_id': 'req-aaabb8eb-d745-4039-8b49-7169d11203b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:03.459631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d29e8890a4e4cf8b07fac0d7a2caa25', 'request_id': 'req-aaabb8eb-d745-4039-8b49-7169d11203b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:03.467494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d29e8890a4e4cf8b07fac0d7a2caa25', 'request_id': 'req-aaabb8eb-d745-4039-8b49-7169d11203b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:03.483767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] The token cache is being invalidate because project 2d29e8890a4e4cf8b07fac0d7a2caa25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:03.484163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:03.484921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:03.489435 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3236/6444] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:03 2022] DELETE /identity/v3/projects/2d29e8890a4e4cf8b07fac0d7a2caa25 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:03.492025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:03.503295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2288-5f9e-405d-a433-64f24e56d502 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:03.588400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:03.589304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:03.589762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:03.590197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] PATH_INFO: `/v3/users/5b056fab27f84ff5b7a11c2651c59f80` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:03.591900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b056fab27f84ff5b7a11c2651c59f80)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:03.594243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:04.005909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:04.032151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b056fab27f84ff5b7a11c2651c59f80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:04.033082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b056fab27f84ff5b7a11c2651c59f80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:04.100735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:04.102192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:04.196021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b056fab27f84ff5b7a11c2651c59f80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:04.211121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb8eb-d745-4039-8b49-7169d11203b3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:04.219343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:04.220113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:04.220452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:04.220787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:04.223223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:04.224132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b056fab27f84ff5b7a11c2651c59f80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:04.225871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b056fab27f84ff5b7a11c2651c59f80'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:04.256368 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3209/6445] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:03 2022] DELETE /identity/v3/users/5b056fab27f84ff5b7a11c2651c59f80 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:04.306548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:04.308790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23877e6-8045-42c4-bea1-7f7f32c7228c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:04.339308 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3237/6446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:04.956458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:04.958324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:05.105000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b699e3-ab05-4e4f-82b3-3088bdb14b6d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:05.113912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:05.115271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:05.115716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:05.116291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] PATH_INFO: `/v3/projects/46bad970a29142a48aefbf293f69de3b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:05.117712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bad970a29142a48aefbf293f69de3b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:05.120841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:05.378452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bad970a29142a48aefbf293f69de3b', 'request_id': 'req-627d83c9-9c82-4b30-929a-85b17f1b4661'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:05.510487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bad970a29142a48aefbf293f69de3b', 'request_id': 'req-627d83c9-9c82-4b30-929a-85b17f1b4661'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:05.517433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bad970a29142a48aefbf293f69de3b', 'request_id': 'req-627d83c9-9c82-4b30-929a-85b17f1b4661'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:05.556359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] The token cache is being invalidate because project 46bad970a29142a48aefbf293f69de3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:05.556657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:05.557341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-627d83c9-9c82-4b30-929a-85b17f1b4661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:05.559370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3210/6447] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:04 2022] DELETE /identity/v3/projects/46bad970a29142a48aefbf293f69de3b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:05.566018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:05.566536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:05.566830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:05.626197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:05.627468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:05.692030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:05.835097 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3238/6448] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:05.842421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:05.842953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:05.843428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:05.879367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:05.883883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:05.902093 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3211/6449] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:05.906406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:05.925054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce93e-4c31-4fe6-890f-e11acf198c37 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:05.931050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:05.933484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:05.933484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:05.933484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:05.933484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:05.933484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:05.939943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:05.976647 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3239/6450] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:05.980751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:05.996955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a9ebc-5c7a-467c-998f-006472816229 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:06.003088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:06.004364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.008568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.008568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.008568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:06.008568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:06.171878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3212/6451] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:05 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:06.176445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:06.203122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23c1c6-2a58-4ab9-919d-2d18764d65dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:06.343778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:06.344670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.345006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.345219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.345864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:06.347960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:06.502942 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3240/6452] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:06 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:06.505327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:06.524274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1bd76-5bea-4bca-938c-1474288f10d6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:06.535344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:06.535989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.536270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.536722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.537527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:06.539414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:06.548182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:06.562241 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3213/6453] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:06.566921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:06.583152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee68cda-bc26-4955-ab1a-0c2cc0ca9704 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:06.589667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:06.590539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.591025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.591454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.592285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:06.595844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d45c8-9c04-4f6a-8021-2300026d1db0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:06.613762 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3241/6454] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:06.617610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:06.634429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457ccd-63f3-44b7-827a-c40eee650ae5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:06.640246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:06.641554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.641989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.642426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] PATH_INFO: `/v3/projects/9325a510e0f24bfe8a3794496c8df69e/users/f15d651d0fb645778d6f5188002212b6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.661346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9325a510e0f24bfe8a3794496c8df69e, user_id=f15d651d0fb645778d6f5188002212b6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:06.664729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:06.882422 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3214/6455] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:06 2022] PUT /identity/v3/projects/9325a510e0f24bfe8a3794496c8df69e/users/f15d651d0fb645778d6f5188002212b6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:06.885384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:06.885714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:06.885992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:06.955619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] MFA Rules not processed for user `f15d651d0fb645778d6f5188002212b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:06.966889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:07.086778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:07.087468 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3242/6456] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:07.246199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233168db-ba53-472d-9f86-094d1490ef44 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:07.259234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:07.260393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:07.260669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:07.261129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:07.262043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:07.266360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:07.479830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:07.483135 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3215/6457] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:07 2022] POST /identity/v3/projects => generated 387 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:46:07.493310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064be5ec-39e5-41fa-8c39-73083ed31f52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:07.632973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:07.633814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:07.634096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:07.639862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:07.639862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:07.639862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:07.851884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3243/6458] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:07 2022] POST /identity/v3/users => generated 300 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:07.855370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:07.869936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937efd79-b6e7-4dea-8dae-2042cb408fd3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:07.881122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:07.881828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:07.882030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:07.882589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:07.883644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:07.885303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:07.902527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:07.903275 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3216/6459] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:07.915848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ab29-be88-45f7-b361-f53833a976c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:07.927929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:07.928892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:07.929351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:07.929807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] PATH_INFO: `/v3/projects/f3d5740d208c4136a4d3ff3965153daf/users/dafdf1a325574bb9822a4c8497076879/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:07.956863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d5740d208c4136a4d3ff3965153daf, user_id=dafdf1a325574bb9822a4c8497076879, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:07.960307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:08.102811 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3244/6460] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:07 2022] PUT /identity/v3/projects/f3d5740d208c4136a4d3ff3965153daf/users/dafdf1a325574bb9822a4c8497076879/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:08.107560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:08.114939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:08.125198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b640-b4be-4e5c-abaf-08abede641d0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:08.297834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:08.298704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:08.299031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:08.299319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:08.301072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:08.304852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e1674-d6fe-4b40-89fc-cdf4b3716604 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:08.349096 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3217/6461] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:08.353356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:08.392156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f662c-c0a5-4139-96d5-37ccf6a14c89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:08.406217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:08.406976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:08.407291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:08.407574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] PATH_INFO: `/v3/projects/f3d5740d208c4136a4d3ff3965153daf/users/dafdf1a325574bb9822a4c8497076879/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:08.419143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d5740d208c4136a4d3ff3965153daf, user_id=dafdf1a325574bb9822a4c8497076879, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:08.426912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f133eae-7f51-4937-af05-1ed3ee278057 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:08.469631 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3245/6462] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:08 2022] PUT /identity/v3/projects/f3d5740d208c4136a4d3ff3965153daf/users/dafdf1a325574bb9822a4c8497076879/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:08.480260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:08.480595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:08.481483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:08.581379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] MFA Rules not processed for user `dafdf1a325574bb9822a4c8497076879`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:08.582677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:08.731166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:08.733308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:08.733743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:08.793647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:08.795232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:08.802024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3218/6463] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:08.819397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:08.820815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:08.975548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92356af7-ef6d-4abf-a330-64f09af10987 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:08.984027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:08.984677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:08.984954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:08.985225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:08.991821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3246/6464] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:46:09.007661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:09.009422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:09.032233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:09.033873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:09.035687 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3219/6465] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:09.179441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:09.268288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e92f-a817-405a-850b-c85f7438f352 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:09.272351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:09.273094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:09.273475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:09.273867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:09.296757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:09.296757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:09.300325 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3247/6466] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:46:09.529470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:09.535259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:09.612856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:09.615380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:09.753504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca3fc-ddd3-4256-8814-1a926624c649 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:09.761893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:09.763777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:09.765226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:09.766106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] PATH_INFO: `/v3/users/f15d651d0fb645778d6f5188002212b6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:09.767799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15d651d0fb645778d6f5188002212b6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:09.771908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:09.835307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180de453-f047-4fe6-abf3-90ac87aae6b3 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:09.868007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:09.868921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:09.869334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:09.869704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] PATH_INFO: `/v3/users/c48a77c8504c4b2894416f7b49c94d76` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:09.872776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48a77c8504c4b2894416f7b49c94d76)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:09.879110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:10.177346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15d651d0fb645778d6f5188002212b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.178327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15d651d0fb645778d6f5188002212b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.341241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15d651d0fb645778d6f5188002212b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.352576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48a77c8504c4b2894416f7b49c94d76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.353164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48a77c8504c4b2894416f7b49c94d76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.370602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15d651d0fb645778d6f5188002212b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.371884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-515a058a-7875-408e-a60a-48ea8cea6384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15d651d0fb645778d6f5188002212b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.419153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3220/6467] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:09 2022] DELETE /identity/v3/users/f15d651d0fb645778d6f5188002212b6 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:10.430199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:10.430482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:10.430795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:10.527430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:10.531480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:10.552885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48a77c8504c4b2894416f7b49c94d76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.572514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48a77c8504c4b2894416f7b49c94d76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.574458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7f798c6-c676-40c9-970e-ee821f98afdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48a77c8504c4b2894416f7b49c94d76'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:10.618036 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3248/6468] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:09 2022] DELETE /identity/v3/users/c48a77c8504c4b2894416f7b49c94d76 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:10.624329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:10.624615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:10.626068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:10.705824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:10.707111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:10.772286 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3221/6469] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:10.880475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:10.882060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:10.899527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:10.975700 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3249/6470] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:11.006477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:11.008349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:11.081158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:11.087775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a721-92db-4399-82a2-cc87687718a5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:11.143837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815557-c460-45bc-8732-4871cf8a2067 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:11.151739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:11.152358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:11.152637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:11.153056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:11.172104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:11.173677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:11.193238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:11.195121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:11.195713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:11.196383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:11.211154 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3250/6471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:11.225336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:11.227231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:11.251002 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3222/6472] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:12.567631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:12.570310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:12.604722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870651-fe69-435a-a183-763d5c533da7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:12.619714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:12.620586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:12.620874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:12.621328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] PATH_INFO: `/v3/projects/9325a510e0f24bfe8a3794496c8df69e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:12.625700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9325a510e0f24bfe8a3794496c8df69e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:12.628035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:12.818527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9325a510e0f24bfe8a3794496c8df69e', 'request_id': 'req-7747ffbc-5957-4c25-af9e-33b6545a4e07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:12.938430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:12.941243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:12.977772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270bf3d-1dc5-414e-b09c-6f438039cd0b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:13.004726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9325a510e0f24bfe8a3794496c8df69e', 'request_id': 'req-7747ffbc-5957-4c25-af9e-33b6545a4e07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.015453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9325a510e0f24bfe8a3794496c8df69e', 'request_id': 'req-7747ffbc-5957-4c25-af9e-33b6545a4e07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.047137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] The token cache is being invalidate because project 9325a510e0f24bfe8a3794496c8df69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:13.047677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.048366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.049974 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3251/6473] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:12 2022] DELETE /identity/v3/projects/9325a510e0f24bfe8a3794496c8df69e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:13.053755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:13.055218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:13.093018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:13.093970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:13.094796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:13.096132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] PATH_INFO: `/v3/projects/ad7f06455f6241d7a2a848f44012e66f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:13.098081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7f06455f6241d7a2a848f44012e66f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:13.101357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:13.178312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ffbc-5957-4c25-af9e-33b6545a4e07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:13.184698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:13.187082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:13.189003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:13.189451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] PATH_INFO: `/v3/users/dafdf1a325574bb9822a4c8497076879` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:13.192595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafdf1a325574bb9822a4c8497076879)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:13.204330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:13.300136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7f06455f6241d7a2a848f44012e66f', 'request_id': 'req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.447140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7f06455f6241d7a2a848f44012e66f', 'request_id': 'req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.447140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7f06455f6241d7a2a848f44012e66f', 'request_id': 'req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.456245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] The token cache is being invalidate because project ad7f06455f6241d7a2a848f44012e66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:13.456705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.457472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.459423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3223/6474] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:12 2022] DELETE /identity/v3/projects/ad7f06455f6241d7a2a848f44012e66f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:13.463512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:13.464921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:13.585453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3e84-7d7e-4fdf-ad59-3680caf7d930 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:13.595718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:13.599169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:13.599689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:13.600129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] PATH_INFO: `/v3/users/a0965d3c1e3045779a8f4c96cf24fd0a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:13.601894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0965d3c1e3045779a8f4c96cf24fd0a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:13.604350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:13.637875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafdf1a325574bb9822a4c8497076879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.639444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafdf1a325574bb9822a4c8497076879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.802503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafdf1a325574bb9822a4c8497076879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.826279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafdf1a325574bb9822a4c8497076879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.828033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafdf1a325574bb9822a4c8497076879'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.838813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:13.863964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3252/6475] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:13 2022] DELETE /identity/v3/users/dafdf1a325574bb9822a4c8497076879 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:13.944117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0965d3c1e3045779a8f4c96cf24fd0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.944810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0965d3c1e3045779a8f4c96cf24fd0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:13.987391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:14.176682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0965d3c1e3045779a8f4c96cf24fd0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:14.192735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0965d3c1e3045779a8f4c96cf24fd0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:14.193500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0965d3c1e3045779a8f4c96cf24fd0a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:14.210833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3224/6476] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:13 2022] DELETE /identity/v3/users/a0965d3c1e3045779a8f4c96cf24fd0a => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:14.691226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:14.692721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:14.778163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea780a-f8d1-4d50-a635-b9374a3d9584 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:14.879338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:14.880458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:14.880747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:14.881172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] PATH_INFO: `/v3/projects/f3d5740d208c4136a4d3ff3965153daf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:14.882712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d5740d208c4136a4d3ff3965153daf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:14.885368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.081843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d5740d208c4136a4d3ff3965153daf', 'request_id': 'req-5c12a58f-a780-4824-93f6-80a4184a2735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.239435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d5740d208c4136a4d3ff3965153daf', 'request_id': 'req-5c12a58f-a780-4824-93f6-80a4184a2735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.247054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:15.247551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d5740d208c4136a4d3ff3965153daf', 'request_id': 'req-5c12a58f-a780-4824-93f6-80a4184a2735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.248692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.258926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:15.265685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5018e-dce7-4546-979b-3f01c15a24f0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:15.270166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] The token cache is being invalidate because project f3d5740d208c4136a4d3ff3965153daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:15.270166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.270166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5c12a58f-a780-4824-93f6-80a4184a2735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.273724 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3253/6477] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:14 2022] DELETE /identity/v3/projects/f3d5740d208c4136a4d3ff3965153daf => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:15.279110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658448c6-ede0-4a59-b838-740e0dcf55db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.279395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658448c6-ede0-4a59-b838-740e0dcf55db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.279666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658448c6-ede0-4a59-b838-740e0dcf55db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.305707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-658448c6-ede0-4a59-b838-740e0dcf55db None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:15.307226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-658448c6-ede0-4a59-b838-740e0dcf55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.354559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:15.355285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.355567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.355843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] PATH_INFO: `/v3/projects/23d2e9104fe143018e27eeabe60afc33` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.357015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d2e9104fe143018e27eeabe60afc33)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:15.359126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.395249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3254/6478] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:15.402973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.403260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.403535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.424636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:15.425870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.434688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3255/6479] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:15.439308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:15.449956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f479ee6-a486-49c6-a1b3-a6aecec4bd7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:15.466288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:15.467040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.468399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.468706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.470563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:15.470918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:15.474889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.504161 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3256/6480] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:46:15.506235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:15.519970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba8954-433b-4905-8724-d7c08c338a42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:15.524239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d2e9104fe143018e27eeabe60afc33', 'request_id': 'req-f727820b-6b4e-414c-87ed-2c2000c339f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.597726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:15.598448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.598977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.599356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.600418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:15.603884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.630055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d2e9104fe143018e27eeabe60afc33', 'request_id': 'req-f727820b-6b4e-414c-87ed-2c2000c339f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.637490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d2e9104fe143018e27eeabe60afc33', 'request_id': 'req-f727820b-6b4e-414c-87ed-2c2000c339f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.650374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] The token cache is being invalidate because project 23d2e9104fe143018e27eeabe60afc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:15.650703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.651574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f727820b-6b4e-414c-87ed-2c2000c339f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:15.658845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3225/6481] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:15 2022] DELETE /identity/v3/projects/23d2e9104fe143018e27eeabe60afc33 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:15.660499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0d-4e93-4275-9d80-cba8da9d298e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.660862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0d-4e93-4275-9d80-cba8da9d298e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.661254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0d-4e93-4275-9d80-cba8da9d298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.681517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-579aad0d-4e93-4275-9d80-cba8da9d298e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:15.682902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-579aad0d-4e93-4275-9d80-cba8da9d298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.693060 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3226/6482] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:46:15.702374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.702965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.703428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.739816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3257/6483] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:15.743815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:15.746456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.770464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:15.774921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:15.885149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397112-e5da-45a1-96fe-415c472d4635 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:15.892076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:15.892076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.892076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.892076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.895120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:15.898106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.926142 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3227/6484] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:46:15.927491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:15.960846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554a9e-c5f3-4a1e-90bc-a8f9a64adb0b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:15.972226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:15.973892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:15.974421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:15.975176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:15.979543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:15.980047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:15.984370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:15.997901 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3258/6485] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:15 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:16.001791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.023921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3228/6486] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:16.025096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.039758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fef20-2097-4715-8a25-b8c5c319c864 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.049612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377055-11a0-4e48-8825-7b470b5bbd36 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.052384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.053003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.053288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.056654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.057567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.059158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.060119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.060612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.061144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.061318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.062235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.070358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.096253 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3259/6487] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:46:16.098722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.111912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3c6c2-2555-48c2-adae-d32d82fd92a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.124947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.124947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.124947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.124947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.125482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.125482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.138801 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3260/6488] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:16.142249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.152660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa5d6-ca35-476e-b6ae-a18295e213e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.158046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.158732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.159016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.159309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] PATH_INFO: `/v3/projects/50cf0e6007f34dfd80ab6961c5b995bf/users/d70fed97628747928ffdf4772193a302/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.175590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf0e6007f34dfd80ab6961c5b995bf, user_id=d70fed97628747928ffdf4772193a302, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.178481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338048b-8cfd-4c58-8c61-9cde283ef3e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.251169 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3229/6489] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:16.255441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.340503 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3261/6490] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:16 2022] PUT /identity/v3/projects/50cf0e6007f34dfd80ab6961c5b995bf/users/d70fed97628747928ffdf4772193a302/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:16.408118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8a9-0450-44b6-b28c-0ca2044182dd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.431504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.432053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.432497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.473606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] MFA Rules not processed for user `d70fed97628747928ffdf4772193a302`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:16.475429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:16.506007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.507041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.507323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.507596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.508227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.511136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.552631 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3262/6491] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:16.556282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.570660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9789bd-1b85-43cb-9c73-5ada905e0666 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.575636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.576215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.576506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.576824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.577492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.580155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.680257 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3230/6492] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:16 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:46:16.687326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.700762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd1c76-3ff4-4027-b85c-e7cac6f0c400 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.711358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.713021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.713455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.717100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.717100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.723481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.752722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3263/6493] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:16 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:46:16.757077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.760274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3231/6494] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:16.765097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.788471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc20fa-912e-472d-88e0-753212524083 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.877953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2b64-2197-4183-b54e-641a4eed05dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.888446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:16.892252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.893252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.894594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.895180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.896546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.905196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.917056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.917677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.917959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.918238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.918934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.920899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:16.937670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3232/6495] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:16.939327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:16.953181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67423f03-9cbf-4c71-a26b-f0e7d8b40b1c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:16.960231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:16.961516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:16.961802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:16.962075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] PATH_INFO: `/v3/projects/ef1702eba45745759fc0e6e212d8053a/users/36795b1d958d425b9486bfc982eaa4de/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:16.983904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1702eba45745759fc0e6e212d8053a, user_id=36795b1d958d425b9486bfc982eaa4de, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:16.987036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e922b7-a8fc-4dc7-b3ae-9dc9d4896eb4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.102063 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3264/6496] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:16 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:17.117411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.141095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88825-378a-4be2-ba89-b08fddf6f59e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.161394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.162017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.162297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.162903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.163620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.165165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.174841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3233/6497] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:16 2022] PUT /identity/v3/projects/ef1702eba45745759fc0e6e212d8053a/users/36795b1d958d425b9486bfc982eaa4de/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:17.186824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.187324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.187799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.204951 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3265/6498] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:17.209859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.240402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b72b-2472-4baa-ae65-15065750b728 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.249050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] MFA Rules not processed for user `36795b1d958d425b9486bfc982eaa4de`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:17.251580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:17.358994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.360621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.362236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.372403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] PATH_INFO: `/v3/projects/e7f9fca3936f49619f60014e5d53fd76/users/3aad01a0cf864d14bc751ba2995a3470/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.410221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:17.410784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f9fca3936f49619f60014e5d53fd76, user_id=3aad01a0cf864d14bc751ba2995a3470, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.415298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.427453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3234/6499] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:46:17.428577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.442227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de6f0d-7af9-4335-9b3e-e08ec98a2bd0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.448451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.449850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.450344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.450818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.453011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.455360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.538030 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3266/6500] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:17 2022] PUT /identity/v3/projects/e7f9fca3936f49619f60014e5d53fd76/users/3aad01a0cf864d14bc751ba2995a3470/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:17.543522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.577677 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3235/6501] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:17.581586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.705068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814fac-5977-467b-b87c-24c4137b3899 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.718525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.719244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.719533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.719806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.720459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.722128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.725548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d7263-6084-48cb-94cd-ab524bc7d90e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.736552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.737187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.737464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.737932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.738817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.742789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.747965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3267/6502] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:17.752227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.769517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d06aae-49cd-40ec-9525-24bbe87e2a0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.782172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:17.782875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.783206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.783433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] PATH_INFO: `/v3/projects/e7f9fca3936f49619f60014e5d53fd76/users/3aad01a0cf864d14bc751ba2995a3470/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.785600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f9fca3936f49619f60014e5d53fd76, user_id=3aad01a0cf864d14bc751ba2995a3470, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:17.788507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cb321-c4d5-40b2-b879-77b3f3dfbf48 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:17.802997 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3268/6503] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:17 2022] PUT /identity/v3/projects/e7f9fca3936f49619f60014e5d53fd76/users/3aad01a0cf864d14bc751ba2995a3470/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:17.818966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:17.818966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:17.818966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:17.849569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3236/6504] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:17 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:17.850862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:17.874079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c374a-e443-41e7-b95c-79361f37a942 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:17.907251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] MFA Rules not processed for user `3aad01a0cf864d14bc751ba2995a3470`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:17.911892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:18.008802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.009613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.009993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.010551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.011415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:18.026427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:18.054814 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3237/6505] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:18.055778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:18.064918 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3269/6506] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:18.076292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:18.078749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:18.084847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d804c1-20e8-406a-83ce-c32437c07d42 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:18.105779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.107014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.107484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.108569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.109542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:18.111452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:18.150230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3238/6507] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:18.152610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:18.204640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce4aad-3782-4545-971b-1c1f32f970cd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:18.217344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.231064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.232112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.232417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] PATH_INFO: `/v3/projects/88317a41239641d59672f9dd36104685/users/2d301d1ea5ac4b8d92183002207861c4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.269323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c3d65-1d9a-415d-ac3b-01976909a5e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:18.275860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.275860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.275860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.276737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88317a41239641d59672f9dd36104685, user_id=2d301d1ea5ac4b8d92183002207861c4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:18.279531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:18.280083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.306157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:18.310531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b635-b785-4130-9157-73cfbb1bff62 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:18.361339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3270/6508] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:18.459078 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3239/6509] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:18 2022] PUT /identity/v3/projects/88317a41239641d59672f9dd36104685/users/2d301d1ea5ac4b8d92183002207861c4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:18.471837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.474362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.475763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.506195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:18.589675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] MFA Rules not processed for user `2d301d1ea5ac4b8d92183002207861c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:18.591363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:18.708503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:18.747760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3271/6510] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:18.754294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:18.863504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e630f-332a-49a7-9caa-07341a1798d9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:18.878121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.879851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.880282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.883664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.978113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56583be-6991-474b-8fb9-58c566f4b2da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:18.982384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:18.996058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:18.996978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:18.997427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:18.997852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:18.998784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:19.001934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:19.048608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:19.051706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:19.071950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3240/6511] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:19.236693 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3272/6512] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:19.238396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:19.254800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff3342-f7f0-4496-bf5c-6f14e58f2b8c service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:19.347151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:19.349197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:19.350598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:19.351338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:19.352303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:19.356142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:19.576228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3241/6513] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:19 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:19.580953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:19.596762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26723-f540-485c-be92-f9f908a77d43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:19.611015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:19.611667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:19.611954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:19.612232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:19.612914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:19.614527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:19.628090 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3273/6514] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:19.632041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:19.646016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5536-13c7-48b1-a2fc-b6867ac9c59a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:19.652181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:19.653099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:19.653386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:19.653660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] PATH_INFO: `/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e/users/8e168ac67fa14dc3994f4fcc38dc61bf/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:19.677004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5d8850de2b45fd947ab5663b66ce0e, user_id=8e168ac67fa14dc3994f4fcc38dc61bf, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:19.685069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:19.900902 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3242/6515] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:19 2022] PUT /identity/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e/users/8e168ac67fa14dc3994f4fcc38dc61bf/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:19.906714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:19.935652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f88f-aab6-4411-84dc-951ae0e91bba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:19.996834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:20.053067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:20.054186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:20.054536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:20.054907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:20.055694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:20.057587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ff047-f6da-4e76-b3a5-053393bd98cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:20.070833 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3274/6516] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:20.079435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:20.090197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e561d-f332-42cb-9f85-eb8765941d83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:20.102395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:20.103508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:20.103954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:20.104225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] PATH_INFO: `/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e/users/8e168ac67fa14dc3994f4fcc38dc61bf/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:20.106453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5d8850de2b45fd947ab5663b66ce0e, user_id=8e168ac67fa14dc3994f4fcc38dc61bf, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:20.109213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:20.126924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3243/6517] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:20 2022] PUT /identity/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e/users/8e168ac67fa14dc3994f4fcc38dc61bf/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:20.134108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:20.134786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:20.136321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:20.171596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] MFA Rules not processed for user `8e168ac67fa14dc3994f4fcc38dc61bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:20.183162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:20.346744 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3275/6518] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:21.038484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:21.742097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:22.533365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:22.850226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:23.899570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:23.901839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:23.987250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0ac8-3258-4967-ab86-038001d23c19 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:23.991105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:23.991747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:23.992045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:23.992335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:24.059945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:24.061671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:24.071794 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3244/6519] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:27.858990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:27.872061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a332d-5723-4c70-bd8f-5acec765fdb5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:27.875934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:27.876546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:27.876952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:27.877233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:27.956118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:27.957759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:27.991100 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3276/6520] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:30.497065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:30.518873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b74f60-4aaa-400e-95fc-7b79a5645cfc service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:30.525322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:30.530419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:30.530419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:30.530419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:30.541646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:30.543433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:30.559815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3245/6521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:31.631076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:31.632879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:31.680854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:31.838458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673604-1634-4dfe-8940-31babef81af4 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:31.845854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:31.846584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:31.846989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:31.847459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:31.856924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:32.018825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:32.023127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b025b9d-8385-4fa6-b6a0-3c617dba9c4d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:32.045415 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3277/6522] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:33.415551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:33.417091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:33.548915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:33.561152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6904d87-851a-43d1-89f3-8d9e3257f6d3 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:33.576858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:33.582594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:33.582594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:33.582594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] PATH_INFO: `/v3/users/daf5210d56f14f459af7d9d6b30ee5c5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:33.582594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf5210d56f14f459af7d9d6b30ee5c5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:33.582594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:33.865677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf5210d56f14f459af7d9d6b30ee5c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:33.866796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf5210d56f14f459af7d9d6b30ee5c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:34.019094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf5210d56f14f459af7d9d6b30ee5c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:34.044195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf5210d56f14f459af7d9d6b30ee5c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:34.047092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf5210d56f14f459af7d9d6b30ee5c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:34.079408 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3246/6523] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:33 2022] DELETE /identity/v3/users/daf5210d56f14f459af7d9d6b30ee5c5 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:34.081405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:34.081887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:34.082106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:34.141666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:34.148732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:34.401525 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3278/6524] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:34.408894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:34.411394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:34.548203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e195277-f26f-42a3-9c0d-a85b6a238489 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:34.558328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:34.558983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:34.559267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:34.559544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:34.593642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:34.596871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1da5-b952-4250-92cd-50d5bac6eeaa service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:34.633536 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3247/6525] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:35.528323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:35.530582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:35.589436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3794a4-09df-4c66-bba3-fc8044702077 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:35.596583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:35.597412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:35.597704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:35.598127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] PATH_INFO: `/v3/projects/aa3a33246fdf43b19b714b30fe88754e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:35.599573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3a33246fdf43b19b714b30fe88754e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:35.602983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:35.822798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3a33246fdf43b19b714b30fe88754e', 'request_id': 'req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:35.982806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3a33246fdf43b19b714b30fe88754e', 'request_id': 'req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:35.984540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:35.994809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3a33246fdf43b19b714b30fe88754e', 'request_id': 'req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:36.036024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] The token cache is being invalidate because project aa3a33246fdf43b19b714b30fe88754e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:36.036330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:36.037048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f93ec50-2fb2-455e-936d-c5790a0c3b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:36.039085 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3279/6526] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:35 2022] DELETE /identity/v3/projects/aa3a33246fdf43b19b714b30fe88754e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:36.048658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:36.049591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:36.049971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:36.076593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:36.078793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:36.258143 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3248/6527] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:36.266659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:36.269013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:36.269140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:36.346415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:36.351091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:36.377382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:36.383836 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3280/6528] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:36.389582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feedb2-9464-41f6-986b-72578b7e88d6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:36.402150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:36.406116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:36.407622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:36.408093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:36.409729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:36.411443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:36.413355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:36.474050 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3249/6529] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:36.480989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:36.491882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9713c-d2b8-4d2f-a55b-5e14667703e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:36.503843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:36.504549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:36.504828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:36.506366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:36.524652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:36.524652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:36.644721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:36.655919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3281/6530] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:36 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:36.656593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:36.661313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea50e83-ec00-4bbe-b5d2-931a1d885270 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:36.802075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:36.804188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:36.808805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:36.811191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:36.812005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:36.820075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:36.982347 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3250/6531] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:36 2022] POST /identity/v3/users => generated 284 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:36.987370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:37.010428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282928-b28b-499c-a019-1c2eb8689b72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:37.036615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:37.037260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.037562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.040549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.041262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:37.051981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:37.074382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3282/6532] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:37.079009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:37.092899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e328-2d88-4991-972a-b97674fdcc59 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:37.133880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:37.134571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.142718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.142718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.142718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:37.142718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3dc5-d75e-40a9-a3b7-c5e74ce63707 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:37.180636 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3251/6533] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:46:37.184709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:37.205206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb30dd-21b6-4b93-93ed-dcae13c1a9cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:37.222797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:37.223192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.223477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.230352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] PATH_INFO: `/v3/projects/355a8d25ae754150a1fce02e33d02896/users/b897e329282b42039b87c9da71c38aaf/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.294659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=355a8d25ae754150a1fce02e33d02896, user_id=b897e329282b42039b87c9da71c38aaf, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:37.302605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:37.420907 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3283/6534] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:37 2022] PUT /identity/v3/projects/355a8d25ae754150a1fce02e33d02896/users/b897e329282b42039b87c9da71c38aaf/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:37.432117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.432405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.432685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.499401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] MFA Rules not processed for user `b897e329282b42039b87c9da71c38aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:37.500937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:37.688402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3252/6535] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:37.744148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:37.745930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:37.913236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac4760-a530-426c-acf5-1113c09ae68a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:37.934663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:37.934663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.934663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.934663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.949089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:37.952002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:37.963855 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3284/6536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:44.629689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.632047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:44.657824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.659267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:44.775789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170dd1-4bb7-43bf-aa3f-d17cdfb2b05c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.782290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.783269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.783731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.784544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] PATH_INFO: `/v3/users/b04d8edcb29a47d98082dadddf897978` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.786521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04d8edcb29a47d98082dadddf897978)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.789354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.795887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6366c9c-9fd8-4bf9-bd24-c107932a93af service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.801676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.802675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.803020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.803306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] PATH_INFO: `/v3/users/d70fed97628747928ffdf4772193a302` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.805119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70fed97628747928ffdf4772193a302)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.807160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.807863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.937309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:45.106580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04d8edcb29a47d98082dadddf897978'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.107536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04d8edcb29a47d98082dadddf897978'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.110757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70fed97628747928ffdf4772193a302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.111522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70fed97628747928ffdf4772193a302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.227491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04d8edcb29a47d98082dadddf897978'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.243315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04d8edcb29a47d98082dadddf897978'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.244155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-47c4a298-a298-4685-8246-4d9ee7f9b563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04d8edcb29a47d98082dadddf897978'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.260081 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3253/6537] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:44 2022] DELETE /identity/v3/users/b04d8edcb29a47d98082dadddf897978 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:45.265086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:45.265374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:45.265654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:45.288834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:45.290059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:45.311857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70fed97628747928ffdf4772193a302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.325769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70fed97628747928ffdf4772193a302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.327287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1cb7213-9a25-4e2b-a360-fc6fe1695d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70fed97628747928ffdf4772193a302'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:45.355319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3285/6538] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:44 2022] DELETE /identity/v3/users/d70fed97628747928ffdf4772193a302 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:45.356675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:45.356959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:45.357691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:45.384189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:45.390821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:45.408567 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3254/6539] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:45.428184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:45.430868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:45.491874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3286/6540] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:45.505609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:45.517957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1795a4-5d1b-404b-b0be-7115cd4f6116 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:45.595494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:45.596190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839254ac-52ea-450a-9309-bf751a7a89d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:45.603635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:45.604250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:45.607805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:45.607805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:45.608010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:45.608010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:45.608010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:45.608010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:45.617869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:45.619585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:45.631926 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3287/6541] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:45.634765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:45.640533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:45.653258 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3255/6542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:46:46.594318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:46.596379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:46.656531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38c056-2802-43d3-9dee-8f2ca27fadd2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:46.674756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:46.675605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:46.676101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:46.676525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] PATH_INFO: `/v3/projects/50cf0e6007f34dfd80ab6961c5b995bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:46.683422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cf0e6007f34dfd80ab6961c5b995bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:46.685946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:46.693819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:46.695833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:46.730929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d6ea8-c073-4301-bb3c-5c723adff7e7 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:46.750004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:46.750004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:46.750004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:46.750004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] PATH_INFO: `/v3/projects/2bc76e27478b4c6e94a021a72fe8a4fd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:46.751658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc76e27478b4c6e94a021a72fe8a4fd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:46.753596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:46.875525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:46.885164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cf0e6007f34dfd80ab6961c5b995bf', 'request_id': 'req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:46.961495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc76e27478b4c6e94a021a72fe8a4fd', 'request_id': 'req-5755f512-76f4-49e5-bc17-352835113780'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.021684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cf0e6007f34dfd80ab6961c5b995bf', 'request_id': 'req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.028591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cf0e6007f34dfd80ab6961c5b995bf', 'request_id': 'req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.043046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] The token cache is being invalidate because project 50cf0e6007f34dfd80ab6961c5b995bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:47.043335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.044003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.045676 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3288/6543] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:46 2022] DELETE /identity/v3/projects/50cf0e6007f34dfd80ab6961c5b995bf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:47.050200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:47.052071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:47.112888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc76e27478b4c6e94a021a72fe8a4fd', 'request_id': 'req-5755f512-76f4-49e5-bc17-352835113780'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.122804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc76e27478b4c6e94a021a72fe8a4fd', 'request_id': 'req-5755f512-76f4-49e5-bc17-352835113780'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.143911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] The token cache is being invalidate because project 2bc76e27478b4c6e94a021a72fe8a4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:47.145294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.148588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.151733 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3256/6544] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:46 2022] DELETE /identity/v3/projects/2bc76e27478b4c6e94a021a72fe8a4fd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:47.160462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:47.164957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:47.181390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8240-0f31-4ebd-9f23-9bf7a62caf1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:47.311955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755f512-76f4-49e5-bc17-352835113780 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:47.316247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:47.317036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.331781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.332186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] PATH_INFO: `/v3/users/3aad01a0cf864d14bc751ba2995a3470` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.334072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aad01a0cf864d14bc751ba2995a3470)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:47.339749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:47.358552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:47.359472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.359601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.359787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] PATH_INFO: `/v3/users/fd60efeb20a745408d497a9fcf7f47f4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.361307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd60efeb20a745408d497a9fcf7f47f4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:47.363410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:47.612771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aad01a0cf864d14bc751ba2995a3470'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.613978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aad01a0cf864d14bc751ba2995a3470'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.640075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd60efeb20a745408d497a9fcf7f47f4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.640812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd60efeb20a745408d497a9fcf7f47f4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.710734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aad01a0cf864d14bc751ba2995a3470'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.750964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aad01a0cf864d14bc751ba2995a3470'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.752632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aad01a0cf864d14bc751ba2995a3470'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.767480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:47.797907 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3289/6545] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:47 2022] DELETE /identity/v3/users/3aad01a0cf864d14bc751ba2995a3470 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:47.836420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd60efeb20a745408d497a9fcf7f47f4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.863787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd60efeb20a745408d497a9fcf7f47f4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.866043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd60efeb20a745408d497a9fcf7f47f4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:47.872329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:47.899798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3257/6546] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:47 2022] DELETE /identity/v3/users/fd60efeb20a745408d497a9fcf7f47f4 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:48.513086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.514770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:48.529914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.535909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:48.704387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797bc65-ac55-4157-bf4d-b1461118289c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.715574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed36b-63f8-4db1-b1eb-a1b3e9963fc0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.716345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.717765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.718368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.718972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] PATH_INFO: `/v3/projects/79e95e2836c34c0b9363da485d3ecda7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.720476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e95e2836c34c0b9363da485d3ecda7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.722813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.724321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.725005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.725398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.725674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] PATH_INFO: `/v3/projects/e7f9fca3936f49619f60014e5d53fd76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.729818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f9fca3936f49619f60014e5d53fd76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.738723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.958522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f9fca3936f49619f60014e5d53fd76', 'request_id': 'req-65991fad-473b-4c78-99a8-cf348bc1f59d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:48.959201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e95e2836c34c0b9363da485d3ecda7', 'request_id': 'req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.079513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e95e2836c34c0b9363da485d3ecda7', 'request_id': 'req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.086929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e95e2836c34c0b9363da485d3ecda7', 'request_id': 'req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.114580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] The token cache is being invalidate because project 79e95e2836c34c0b9363da485d3ecda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:49.117079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.127082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.132048 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3290/6547] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:48 2022] DELETE /identity/v3/projects/79e95e2836c34c0b9363da485d3ecda7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:49.133364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.137306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.238111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f9fca3936f49619f60014e5d53fd76', 'request_id': 'req-65991fad-473b-4c78-99a8-cf348bc1f59d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.244734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f9fca3936f49619f60014e5d53fd76', 'request_id': 'req-65991fad-473b-4c78-99a8-cf348bc1f59d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.266552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] The token cache is being invalidate because project e7f9fca3936f49619f60014e5d53fd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:49.266873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.267676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65991fad-473b-4c78-99a8-cf348bc1f59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.270497 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3258/6548] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:48 2022] DELETE /identity/v3/projects/e7f9fca3936f49619f60014e5d53fd76 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:49.275871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef07c1-a8f3-4760-bd5a-fc4734c576d9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.277854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef07c1-a8f3-4760-bd5a-fc4734c576d9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.277854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef07c1-a8f3-4760-bd5a-fc4734c576d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.309142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebecada-c1f9-4d3a-b8e9-e6625f18f9dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.333448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.334106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.334388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.334684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] PATH_INFO: `/v3/users/36795b1d958d425b9486bfc982eaa4de` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.341548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=36795b1d958d425b9486bfc982eaa4de)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.344069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.347193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fbef07c1-a8f3-4760-bd5a-fc4734c576d9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.348436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fbef07c1-a8f3-4760-bd5a-fc4734c576d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.375117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3259/6549] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:49.376405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019754-ee8b-447f-aac2-b6f6d6aad8b0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.378727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019754-ee8b-447f-aac2-b6f6d6aad8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.379029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019754-ee8b-447f-aac2-b6f6d6aad8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.436452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-69019754-ee8b-447f-aac2-b6f6d6aad8b0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.438848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69019754-ee8b-447f-aac2-b6f6d6aad8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.461780 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3260/6550] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:49.466199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c524b-3def-42aa-a969-1816fa7e0599 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.466504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c524b-3def-42aa-a969-1816fa7e0599 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.467342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c524b-3def-42aa-a969-1816fa7e0599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.491757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-830c524b-3def-42aa-a969-1816fa7e0599 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.493345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-830c524b-3def-42aa-a969-1816fa7e0599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.502563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:49.509954 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3261/6551] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:49.509954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.509954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.509954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.543687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.545701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.558076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3262/6552] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:49.558076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.590762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647575-3c3f-4e6f-9b00-ee455527a765 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.611278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.612479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.613945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.614323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.616042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:49.618846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.620830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.675383 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3263/6553] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.678157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.699700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36795b1d958d425b9486bfc982eaa4de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.703930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36795b1d958d425b9486bfc982eaa4de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.722555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc7e16-efc3-4fb2-80b6-9d632115ded8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.744019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.745584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.745860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.746140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.746833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:49.747141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.749336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.786923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3264/6554] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.788369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.791324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.812173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1077d69-c62b-4926-9ace-cf7c40f0dcae admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.829749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.831721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.838565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.838565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.838565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.838565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30792a-0850-47e8-81b7-05d4157b8819 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.861255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36795b1d958d425b9486bfc982eaa4de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.886036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36795b1d958d425b9486bfc982eaa4de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.892225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36795b1d958d425b9486bfc982eaa4de'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:49.928528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3291/6555] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:49 2022] DELETE /identity/v3/users/36795b1d958d425b9486bfc982eaa4de => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:49.930346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.931937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.989925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3265/6556] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:49.991248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.991592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.991874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.039362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:50.040634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:50.045658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:50.138936 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3266/6557] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:50.141711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.152708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135b9f1-b6e4-4cda-8391-9ffa5d76e78f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.158455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803ef2d-1cb0-49b6-be70-1d1c742f7a83 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.166096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.166550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.166769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.167073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.171049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.171173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.171173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.171340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.171430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.171430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.171618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.172537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.366952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3267/6558] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:50 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:50.367158 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3292/6559] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/projects => generated 385 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:50.367262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.367354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.372638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:50.457086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfffb28-21ee-44dc-ab42-ccfddf536a7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.462730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.483351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.484666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.485217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.486026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.493456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.642464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3293/6560] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:50 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:50.643593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.667868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841ac8-3014-4866-86fd-5732d6ec7a5f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.694479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875dad5-e3cc-41b5-b5b5-a36d5e094197 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.724633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.725492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.726426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.726832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.727714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.729537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.770470 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3294/6561] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:50.775914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.776553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.776841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.777117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.784330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.791677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.793135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.804043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90f8c-4a9d-4267-93fd-c1a4694207ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.816818 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3268/6562] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:50.817691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.830499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.834971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.836202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.837842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.837974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce690-2e45-47a5-b7e4-e12679294480 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.839390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.846376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.850168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.851066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.851528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.851961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.852788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.856664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.868875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:50.885740 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3269/6563] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:50.895405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.899954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3295/6564] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:50.908263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.926560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad577-63ba-409f-a86e-23b81929dbf5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.943010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8cf0d-d992-421a-9a3c-b6699bbc697c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.943545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.944641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.944923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.945202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] PATH_INFO: `/v3/projects/6dbaa2c9613648ceadbdbc49a218a2c8/users/075833c954804fa0b5943c91bd7d6953/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.962828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.963831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.964423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.964970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.969852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.973963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.990178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbaa2c9613648ceadbdbc49a218a2c8, user_id=075833c954804fa0b5943c91bd7d6953, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.991633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcd665-180c-48d0-a228-a6502ed0aa76 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:51.000303 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3296/6565] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:51.005951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.018904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64227d5d-363a-4359-ad60-565f0af778fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:51.024913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:51.024913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.025117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.025273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] PATH_INFO: `/v3/projects/4ef8fe22ea0e4835897c8a68a281cb1e/users/c7377b783983425c8563d049fbfa7de2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.044299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef8fe22ea0e4835897c8a68a281cb1e, user_id=c7377b783983425c8563d049fbfa7de2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:51.048688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:51.081543 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3270/6566] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:50 2022] PUT /identity/v3/projects/6dbaa2c9613648ceadbdbc49a218a2c8/users/075833c954804fa0b5943c91bd7d6953/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:51.091273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c170-d910-4a60-9f73-bc66c2838bc1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.091950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c170-d910-4a60-9f73-bc66c2838bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.092435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8c170-d910-4a60-9f73-bc66c2838bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.166488 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3297/6567] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:51 2022] PUT /identity/v3/projects/4ef8fe22ea0e4835897c8a68a281cb1e/users/c7377b783983425c8563d049fbfa7de2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:51.176907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.179818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9ab8c170-d910-4a60-9f73-bc66c2838bc1 None None] MFA Rules not processed for user `075833c954804fa0b5943c91bd7d6953`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:51.181427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.182348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ab8c170-d910-4a60-9f73-bc66c2838bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.199865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:51.389571 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3271/6568] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:46:51.389571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.392957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.398543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.401878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeaba1-4b0d-46a4-b1c1-6242f8624dfd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:51.419398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:51.419398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.419398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.419398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.420783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.446446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:51.448495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:51.459481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] MFA Rules not processed for user `c7377b783983425c8563d049fbfa7de2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:51.463019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.475866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3298/6569] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:51.485460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.604709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3272/6570] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:51.631268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.653499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.668964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c866ef-a7d9-4c2f-b097-4c5fcdf8ca46 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:51.680540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:51.683571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.683571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.683571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.702759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:51.704486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:51.732717 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3299/6571] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:51.830296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfd246-1263-41f5-99c0-70130231f28e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:51.835337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:51.836324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:51.836809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:51.837261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:51.861194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:51.863474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:51.880324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3273/6572] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:51.911573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.913133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:51.932363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:51.971381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c174a7-880a-406e-8f2f-d4c5668fe14d service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:51.998711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:51.999346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.000919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.003219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.007401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:52.040216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:52.046700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05f47-86b8-4ee9-800a-05633d0823c4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:52.052244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:52.053047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.053334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.053611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] PATH_INFO: `/v3/projects/ef1702eba45745759fc0e6e212d8053a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.054839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1702eba45745759fc0e6e212d8053a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:52.056817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:52.066268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:52.067729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:52.085469 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3274/6573] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:46:52.256274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1702eba45745759fc0e6e212d8053a', 'request_id': 'req-954f913c-5579-4940-ae50-7bd5a2be79f4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.256572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:52.258660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:52.291780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:52.370106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1702eba45745759fc0e6e212d8053a', 'request_id': 'req-954f913c-5579-4940-ae50-7bd5a2be79f4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.378792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1702eba45745759fc0e6e212d8053a', 'request_id': 'req-954f913c-5579-4940-ae50-7bd5a2be79f4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.392165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] The token cache is being invalidate because project ef1702eba45745759fc0e6e212d8053a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:52.392700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.393753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.396104 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3300/6574] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:51 2022] DELETE /identity/v3/projects/ef1702eba45745759fc0e6e212d8053a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:52.399612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:52.401350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:52.414665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0709b1-5500-412e-9800-8681baad8ae9 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:52.562952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f913c-5579-4940-ae50-7bd5a2be79f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:52.575206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:52.575786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.577303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:52.578141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.578680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.579068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.581745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.581745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] PATH_INFO: `/v3/users/2d301d1ea5ac4b8d92183002207861c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.581997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:52.582091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d301d1ea5ac4b8d92183002207861c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:52.588475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:52.746227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:52.748814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:52.771593 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3275/6575] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:46:52.864674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d301d1ea5ac4b8d92183002207861c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.866837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d301d1ea5ac4b8d92183002207861c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:52.999241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d301d1ea5ac4b8d92183002207861c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:53.026467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d301d1ea5ac4b8d92183002207861c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:53.027611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d301d1ea5ac4b8d92183002207861c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:53.084584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3301/6576] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:52 2022] DELETE /identity/v3/users/2d301d1ea5ac4b8d92183002207861c4 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:53.967597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:53.984266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e810b-3ecd-47cb-a2d9-3556923ddb67 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:54.194144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:54.212283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:54.212944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:54.213248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:54.213516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] PATH_INFO: `/v3/projects/88317a41239641d59672f9dd36104685` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:54.219953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88317a41239641d59672f9dd36104685)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:54.226406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:54.411718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88317a41239641d59672f9dd36104685', 'request_id': 'req-752773c0-054d-4a54-ad29-2bb322bd96cc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:54.500005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88317a41239641d59672f9dd36104685', 'request_id': 'req-752773c0-054d-4a54-ad29-2bb322bd96cc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:54.510261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88317a41239641d59672f9dd36104685', 'request_id': 'req-752773c0-054d-4a54-ad29-2bb322bd96cc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:54.543482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] The token cache is being invalidate because project 88317a41239641d59672f9dd36104685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:54.547079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:54.550871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:54.612022 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3276/6577] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:53 2022] DELETE /identity/v3/projects/88317a41239641d59672f9dd36104685 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:54.616000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:54.617996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:54.646221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:54.659237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c7ec-8d04-43aa-a291-98fe0d2bd424 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:54.971460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:54.972300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:54.972680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:54.973069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] PATH_INFO: `/v3/users/8e168ac67fa14dc3994f4fcc38dc61bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:54.976488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e168ac67fa14dc3994f4fcc38dc61bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:54.986521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:55.371120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e168ac67fa14dc3994f4fcc38dc61bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:55.374460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e168ac67fa14dc3994f4fcc38dc61bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:55.456119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e168ac67fa14dc3994f4fcc38dc61bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:55.488798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e168ac67fa14dc3994f4fcc38dc61bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:55.501116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-feb285eb-2e81-455c-b6ee-ed3adfdb9339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e168ac67fa14dc3994f4fcc38dc61bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:55.543455 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3302/6578] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:46:54 2022] DELETE /identity/v3/users/8e168ac67fa14dc3994f4fcc38dc61bf => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:56.729067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:56.732860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:56.805230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752773c0-054d-4a54-ad29-2bb322bd96cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:57.031722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:57.032948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:57.034256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:57.045437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] PATH_INFO: `/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:57.045437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5d8850de2b45fd947ab5663b66ce0e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:57.048049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:57.236007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5d8850de2b45fd947ab5663b66ce0e', 'request_id': 'req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:57.347870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5d8850de2b45fd947ab5663b66ce0e', 'request_id': 'req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:57.363157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5d8850de2b45fd947ab5663b66ce0e', 'request_id': 'req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:57.413370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] The token cache is being invalidate because project ff5d8850de2b45fd947ab5663b66ce0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:46:57.416304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:57.419093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-88e36fa8-51c4-4d2b-8f74-114a21e4f00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:46:57.430870 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3277/6579] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:46:56 2022] DELETE /identity/v3/projects/ff5d8850de2b45fd947ab5663b66ce0e => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:57.436211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:57.436673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:57.436764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:57.494149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:57.495904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:57.693796 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3303/6580] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:57.701939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a03e-44cf-401a-b204-58803653636e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:57.702400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a03e-44cf-401a-b204-58803653636e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:57.702867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a03e-44cf-401a-b204-58803653636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:57.751097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-72b0a03e-44cf-401a-b204-58803653636e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:57.752252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72b0a03e-44cf-401a-b204-58803653636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:57.785592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3278/6581] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:46:57.789650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:57.806207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599452f-9657-4674-b110-0f49ad91f716 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:57.845418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:57.848098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:57.848560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:57.849643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:57.850482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:57.851718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:57.855821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:57.897729 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3304/6582] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:57.900752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0a03e-44cf-401a-b204-58803653636e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:57.921329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0a03e-44cf-401a-b204-58803653636e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:57.932491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:57.933128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:57.933417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:57.936105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:57.936105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:57.940162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:57.969508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:58.089747 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3279/6583] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:46:57 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:58.094348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:58.123216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586dc2-ced9-4bcc-b6ae-585138b61f3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:58.138540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:58.334948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:58.335584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:58.337127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:58.337127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:58.337127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:58.339981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:58.452220 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3305/6584] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:46:58 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:58.456345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:58.475600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51fb9c-268e-4ff1-a073-58aa63142d09 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:58.493007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:58.493643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:58.493925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:58.494193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:58.494876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:58.514416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:58.569857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:58.570000 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3280/6585] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:58.589502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd32e8-fdd7-499a-8c66-d4b6ac191da0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:58.620296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:58.620926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:58.621212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:58.621486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:58.622140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:58.632998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ed42a-c9e7-4d25-9050-920117b273d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:58.697332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3306/6586] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:46:58.699557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:58.711619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf47d-f92a-44cb-a533-b32d78064add admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:58.759386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:58.760159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:58.760349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:58.760809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] PATH_INFO: `/v3/projects/fa02250cc09843a5b5c303a97a515358/users/5a86d0498c7740d796d0f85e97bcb42c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:58.817512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa02250cc09843a5b5c303a97a515358, user_id=5a86d0498c7740d796d0f85e97bcb42c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:58.825272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:59.903129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3281/6587] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:46:58 2022] PUT /identity/v3/projects/fa02250cc09843a5b5c303a97a515358/users/5a86d0498c7740d796d0f85e97bcb42c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 1204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:46:59.909818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.910331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.910867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.976272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:59.979973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:00.301348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3307/6588] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:00.315083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.317831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:00.566917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a227-53c2-4c5a-8a0f-0fc23edde01e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.602992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.603831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.604274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.606374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.632527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.633995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c23d6-0806-4e42-be29-8e6c301701e6 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.663877 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3282/6589] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:02.109901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:02.112671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:02.141999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09a05-25cf-4c09-92cb-3b59e5ce9613 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:02.149800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:02.150726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:02.151920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:02.151920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:02.154426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:02.174494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:02.176867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:02.210418 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3308/6590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:03.897119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:03.898004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:03.898476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:03.945607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] MFA Rules not processed for user `5a86d0498c7740d796d0f85e97bcb42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:03.948209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:04.267612 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3283/6591] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:04.281194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:04.284545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:04.469140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014c1d0-ebc1-48b8-8436-57dcd3fcb2aa service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:04.479159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:04.481516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.482398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.482969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.503711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:04.506006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d863575-3323-4ac3-a269-67dbb7e259eb service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:04.519490 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3309/6592] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:05.153140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.170990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18730db-f604-4042-9d9e-2bfd26eb667d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.181482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.184679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.184679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.184679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.191390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:05.226542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.228069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.290361 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3284/6593] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:09.319337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.319881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.320134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.384970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] MFA Rules not processed for user `5a86d0498c7740d796d0f85e97bcb42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:09.386221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:09.406740 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3310/6594] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:09.461248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.463362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:09.539267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:09.593003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c240-66dd-4aaa-9efd-1b8debe3706b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.604765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.606262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.608054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.608418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.611422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:09.884773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:09.886367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:09.924344 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3285/6595] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:13.121678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:13.158254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e0fd8-3875-48e6-844f-6663ed868d21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:13.171880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:13.172520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:13.181638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:13.182119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:13.192048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:13.271336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:13.272798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:13.301921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:13.337306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3311/6596] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:15.622032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:15.622032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:15.632365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33301-3178-4a78-8d33-336fb7d99983 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:15.638280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:15.638964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.648658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.648658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] PATH_INFO: `/v3/users/c7377b783983425c8563d049fbfa7de2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.648658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7377b783983425c8563d049fbfa7de2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:15.648658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.177671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.179149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:16.196792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7377b783983425c8563d049fbfa7de2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.197850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7377b783983425c8563d049fbfa7de2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.206809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cd611-e19c-429f-afac-122b489c9dc0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.213005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.218744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.219282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.219780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] PATH_INFO: `/v3/users/a55fa5e6656648faaf79309f68a9f9af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.222297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55fa5e6656648faaf79309f68a9f9af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.224654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.423661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7377b783983425c8563d049fbfa7de2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.453067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7377b783983425c8563d049fbfa7de2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.454325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b359444b-0d0d-42f1-8868-cb1972ac2763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7377b783983425c8563d049fbfa7de2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.477689 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3286/6597] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:15 2022] DELETE /identity/v3/users/c7377b783983425c8563d049fbfa7de2 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:16.483194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.483488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.483765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.515351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:16.517564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:16.569463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.577269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55fa5e6656648faaf79309f68a9f9af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.577982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55fa5e6656648faaf79309f68a9f9af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.622880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3287/6598] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:47:16.624063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.626894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:16.743970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eae7ee-7ecc-4c95-abf7-8685863ced95 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.750236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.751173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.752437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.752901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.766933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.770312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.784441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3288/6599] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:16.913645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55fa5e6656648faaf79309f68a9f9af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.932838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55fa5e6656648faaf79309f68a9f9af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.934157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55fa5e6656648faaf79309f68a9f9af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:16.965043 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3312/6600] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:16 2022] DELETE /identity/v3/users/a55fa5e6656648faaf79309f68a9f9af => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:17.928038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.929697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:17.987798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059e73b-b23a-4cab-a4cf-4df75c22334d service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:18.148796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:18.149707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:18.150342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:18.150830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] PATH_INFO: `/v3/projects/996836f46be04880be0a880fad2d493c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:18.152301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] RBAC: Authorizing `identity:delete_project(project_id=996836f46be04880be0a880fad2d493c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:18.156040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:18.479082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996836f46be04880be0a880fad2d493c', 'request_id': 'req-111d2c4e-fb57-4423-b47d-374b33ea293b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:18.882812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:18.884203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:18.910485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f2a3-ccb3-4368-8b98-b594331d4212 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.005544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996836f46be04880be0a880fad2d493c', 'request_id': 'req-111d2c4e-fb57-4423-b47d-374b33ea293b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.016018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996836f46be04880be0a880fad2d493c', 'request_id': 'req-111d2c4e-fb57-4423-b47d-374b33ea293b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.039201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] The token cache is being invalidate because project 996836f46be04880be0a880fad2d493c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:19.039763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.043451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-111d2c4e-fb57-4423-b47d-374b33ea293b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.053026 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3289/6601] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:17 2022] DELETE /identity/v3/projects/996836f46be04880be0a880fad2d493c => generated 0 bytes in 1121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:19.054848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f739e-5f40-4f81-ad68-51540a0d1612 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.055315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f739e-5f40-4f81-ad68-51540a0d1612 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.056160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f739e-5f40-4f81-ad68-51540a0d1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.086176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fa3f739e-5f40-4f81-ad68-51540a0d1612 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.088357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.088952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fa3f739e-5f40-4f81-ad68-51540a0d1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.091818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.092754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.093345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] PATH_INFO: `/v3/projects/4ef8fe22ea0e4835897c8a68a281cb1e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.096261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef8fe22ea0e4835897c8a68a281cb1e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.100604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.118542 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3290/6602] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:19.120166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.120775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.121273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.158275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.159950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.174864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.184997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3291/6603] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:19.186337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.198582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b525e-9a81-4d64-8158-05196fb326a4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.209560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.210591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.211187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.211686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.212573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:19.215913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.218394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.278121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3292/6604] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:19.284100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.291366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef8fe22ea0e4835897c8a68a281cb1e', 'request_id': 'req-df90e4a5-e497-4544-a139-3a9c142ee9b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.324926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22694d3-89b4-4a62-9a15-55bdca907816 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.471016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.471951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.472264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.472597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.474083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.476626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5564f-0004-4217-bf8c-cb518cd614f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.510514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef8fe22ea0e4835897c8a68a281cb1e', 'request_id': 'req-df90e4a5-e497-4544-a139-3a9c142ee9b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.518705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef8fe22ea0e4835897c8a68a281cb1e', 'request_id': 'req-df90e4a5-e497-4544-a139-3a9c142ee9b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.537294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] The token cache is being invalidate because project 4ef8fe22ea0e4835897c8a68a281cb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:19.537634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.539094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:19.541669 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3313/6605] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:18 2022] DELETE /identity/v3/projects/4ef8fe22ea0e4835897c8a68a281cb1e => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:19.543425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.545655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.553053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.649224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3293/6606] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:19.656226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.656592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.656793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.697775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e4a5-e497-4544-a139-3a9c142ee9b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.759627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.765537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.815744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.816377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.816667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.816943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.823769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.977368 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3294/6607] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:19.980455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.985773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.995342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.996805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f28d-2930-403a-911d-32cb5641fdd4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.019824 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3314/6608] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:20.026285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.026980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.029317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.034112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393825-e6ca-419a-a7a1-0a0d778da4f9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.057303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.060806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.063697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.064097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.066876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.081310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.109602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:20.112761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:20.128663 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3315/6609] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:20.132803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.146826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5db5b-14fa-4221-97c1-df2828464472 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.155115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.157788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.159178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.159683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.160693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:20.161225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.163686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.179999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3316/6610] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:20.186350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.213549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abccfe7-a4eb-4897-b3ce-e51707f1ac66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.245071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.246305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.246941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.247371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.248120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.257163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.321758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3295/6611] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:20.326071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.358346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ae3e-f400-4941-9b2d-8882625e5cdf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.374395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.375250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.375636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.377275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.378121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.381715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.415935 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3296/6612] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:47:20.422602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.458963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15d63-776f-4c22-b666-e2eb3c78f6c0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.475768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.476428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.476713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.477171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.477835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.479557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.521147 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3317/6613] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:20 2022] POST /identity/v3/projects => generated 361 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:20.525329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.541812 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3297/6614] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:20.542684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.571046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a6f6d-d599-40b1-ba7c-60fc25540a05 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.661433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ce449-2375-4831-babc-c61be2e7f499 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.680429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.681115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.681399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.681722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.682314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.684527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.729414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.730187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.730476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.730821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] PATH_INFO: `/v3/projects/6af41f1903d34376b8397d48da97856a/users/ee734d5b89a84f44ba569e81cbde21b4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.753280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af41f1903d34376b8397d48da97856a, user_id=ee734d5b89a84f44ba569e81cbde21b4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.756208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1052-013e-4b02-888e-22c1aeac4f72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.909958 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3318/6615] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:20 2022] POST /identity/v3/users => generated 281 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:20.916032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.939153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195d58-db32-4483-828b-addbc49dbf7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.956350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.957144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.957427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.957700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.958345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.959993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.977613 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3298/6616] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:20 2022] PUT /identity/v3/projects/6af41f1903d34376b8397d48da97856a/users/ee734d5b89a84f44ba569e81cbde21b4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:20.991962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.992244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.992514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.995407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3319/6617] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:21.000341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.021326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0c90-886a-414d-9ded-f7aa948eb1e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:21.086379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] MFA Rules not processed for user `ee734d5b89a84f44ba569e81cbde21b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:21.087960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:21.190518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:21.190912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.199381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.199381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.199381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:21.199381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.223360 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3320/6618] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:21.230589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.235843 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3299/6619] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:21.245728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.247596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:21.275465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3acb7-1257-4249-804c-84b2972617ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:21.299680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:21.300611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.301071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.301488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] PATH_INFO: `/v3/projects/92102cdea788418c970451ca4031df83/users/3bde7748d36546679f7db008c3d89b9a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.357599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92102cdea788418c970451ca4031df83, user_id=3bde7748d36546679f7db008c3d89b9a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:21.360597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69169d-b3bb-46cb-9b87-a0e0809f9b36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.450659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc279-e21a-4dc3-99f4-bcab17ac99ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:21.460805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:21.461698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.462132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.462556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.475887 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3321/6620] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:21 2022] PUT /identity/v3/projects/92102cdea788418c970451ca4031df83/users/3bde7748d36546679f7db008c3d89b9a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:21.488713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.489327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.489695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.498321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:21.499728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.527448 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3300/6621] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:21.562066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] MFA Rules not processed for user `3bde7748d36546679f7db008c3d89b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:21.563602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:21.775399 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3322/6622] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:21.838845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.841416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:21.991019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4644-9e02-4b52-8105-fdc6ee82124a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:22.109040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:22.110452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.112631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.112960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.157207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:22.158641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d59b5-279e-4c31-a118-ad70bd920f30 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:22.199128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3301/6623] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:22.201012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:22.328146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa1bf-b49e-45d4-9a32-d34f7d6b50e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:22.337551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:22.340496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.341865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.343082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] PATH_INFO: `/v3/users/3bde7748d36546679f7db008c3d89b9a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.345758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bde7748d36546679f7db008c3d89b9a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:22.349201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:22.651786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:22.748226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bde7748d36546679f7db008c3d89b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:22.749308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bde7748d36546679f7db008c3d89b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:22.951444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bde7748d36546679f7db008c3d89b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:22.954009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:22.993323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bde7748d36546679f7db008c3d89b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:22.994722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bde7748d36546679f7db008c3d89b9a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:23.063014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3323/6624] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:22 2022] DELETE /identity/v3/users/3bde7748d36546679f7db008c3d89b9a => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:23.063416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.063416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.065476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.160644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:23.162796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:23.243076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3302/6625] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:23.253409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.255042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:23.362694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363580e-c6f8-43b7-a8a7-05ceb36a3d6b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.367952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.368822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.369279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.369767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.381836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.383803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04230-cebe-40b8-a9e9-9b094c380e9d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.397717 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3324/6626] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:24.903032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:24.905101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:24.928182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e8fe-dbe1-4f00-a8bf-38bd0a20e34e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:24.934327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:24.935976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:24.937195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:24.937491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] PATH_INFO: `/v3/projects/92102cdea788418c970451ca4031df83` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:24.939481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92102cdea788418c970451ca4031df83)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:24.942465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:24.983920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:25.157006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92102cdea788418c970451ca4031df83', 'request_id': 'req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:25.322371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92102cdea788418c970451ca4031df83', 'request_id': 'req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:25.329306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92102cdea788418c970451ca4031df83', 'request_id': 'req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:25.352080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] The token cache is being invalidate because project 92102cdea788418c970451ca4031df83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:25.354408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:25.355457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e1b8e55e-b05e-4d34-8c90-0687c4c013f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:25.370958 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3303/6627] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:24 2022] DELETE /identity/v3/projects/92102cdea788418c970451ca4031df83 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:25.383876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.383876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.383876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.435804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:25.439682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:25.593396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:25.696238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3325/6628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:25.696726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.696726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.696726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.739058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:25.739058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:25.748849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:25.749489 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3304/6629] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:25.772967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7979e-ff68-4dec-9bcb-da6bc8d36033 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:25.790697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:25.791716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.793414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.793702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.797473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:25.800321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:25.800321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:25.840333 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3326/6630] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:25.841913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:25.853133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd628416-81c3-43f9-b0bd-7f270536627f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:25.868006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:25.868870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.877744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.878308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.879272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:25.883490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:25.950016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:25.952455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:25.983601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326eee-8389-4876-ad0d-3b6be2d571e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.003669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.004766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.005069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.005325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] PATH_INFO: `/v3/users/2857f070fe4f4625bf6a1e866863ea0d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.006537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2857f070fe4f4625bf6a1e866863ea0d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.008521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.078121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3305/6631] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:26.082327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.239826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2478b07-238f-4e39-a59b-278e5755aa72 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.260293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.261031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.261381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.261792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.263232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.265469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.353944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2857f070fe4f4625bf6a1e866863ea0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:26.355163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2857f070fe4f4625bf6a1e866863ea0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:26.417630 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3306/6632] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:26 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:47:26.418929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.423657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:26.438641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2857f070fe4f4625bf6a1e866863ea0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:26.462145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2857f070fe4f4625bf6a1e866863ea0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:26.462412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353947-4c64-490a-8bf6-1554d19a93ac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.467344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2857f070fe4f4625bf6a1e866863ea0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:26.471725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.472359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.472636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.472907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.473568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.475339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.487054 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3307/6633] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:26.490939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.495975 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3327/6634] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:25 2022] DELETE /identity/v3/users/2857f070fe4f4625bf6a1e866863ea0d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:26.506826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc3082-15a2-4683-bf56-2a2ea9462deb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.605069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.606169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.606731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.607299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.608707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.612072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cffc17-5d6b-442d-b87c-7dda2b70e744 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.633594 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3308/6635] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:26.642143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.669466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607aa57-8a7f-4f8d-a132-744c01b10efb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.702988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.704005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.706819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.707287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] PATH_INFO: `/v3/projects/0a78277feff64f1d8a2df6acbcefb8f9/users/0da5f89804c64a8eb5977d19d32615ad/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.751114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78277feff64f1d8a2df6acbcefb8f9, user_id=0da5f89804c64a8eb5977d19d32615ad, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.754474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.976069 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3328/6636] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:26 2022] PUT /identity/v3/projects/0a78277feff64f1d8a2df6acbcefb8f9/users/0da5f89804c64a8eb5977d19d32615ad/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:26.980611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.980892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.981166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:27.075936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] MFA Rules not processed for user `0da5f89804c64a8eb5977d19d32615ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:27.079279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:27.300466 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3309/6637] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:27.318006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:27.320190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:27.456013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645eb32-6ec2-4bf4-9a29-379595b4a6f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:27.469714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:27.473343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:27.473343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:27.473343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:27.481633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:27.483657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:27.505194 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3329/6638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:28.108035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:28.127346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:28.130522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:28.263363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab114-cacd-4f1c-891f-3a63e44d31a9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:28.281084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:28.281744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:28.282026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:28.282296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] PATH_INFO: `/v3/projects/a1c9a71c813f4732b5df736816315d18` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:28.283559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c9a71c813f4732b5df736816315d18)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:28.291869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:28.439126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:28.469513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c9a71c813f4732b5df736816315d18', 'request_id': 'req-89a8861f-c4ff-4845-9b6c-1a06aeb041da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:28.569764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c9a71c813f4732b5df736816315d18', 'request_id': 'req-89a8861f-c4ff-4845-9b6c-1a06aeb041da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:28.585388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c9a71c813f4732b5df736816315d18', 'request_id': 'req-89a8861f-c4ff-4845-9b6c-1a06aeb041da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:28.631812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] The token cache is being invalidate because project a1c9a71c813f4732b5df736816315d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:28.634598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:28.637446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:28.643289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3310/6639] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:28 2022] DELETE /identity/v3/projects/a1c9a71c813f4732b5df736816315d18 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:28.648004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:28.665260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4c3e-28d6-43c4-ab0a-9c2bda53dcd8 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:28.834465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:28.835398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:28.835842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:28.836294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] PATH_INFO: `/v3/users/57f76dd056e84a0584dde26d5c61c44d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:28.840571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f76dd056e84a0584dde26d5c61c44d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:28.845418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:29.168027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f76dd056e84a0584dde26d5c61c44d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:29.168876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f76dd056e84a0584dde26d5c61c44d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:29.267033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f76dd056e84a0584dde26d5c61c44d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:29.328575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f76dd056e84a0584dde26d5c61c44d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:29.330774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f76dd056e84a0584dde26d5c61c44d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:29.383393 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3330/6640] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:28 2022] DELETE /identity/v3/users/57f76dd056e84a0584dde26d5c61c44d => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:30.100200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.102327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:30.182870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8861f-c4ff-4845-9b6c-1a06aeb041da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.362338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.363332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.363828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.364309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] PATH_INFO: `/v3/projects/7955368b3d084860b33dc242ee0e8057` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.366933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7955368b3d084860b33dc242ee0e8057)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.371118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.624456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7955368b3d084860b33dc242ee0e8057', 'request_id': 'req-f08e86cd-51e1-463e-92ac-dff77a32dba2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:30.747764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7955368b3d084860b33dc242ee0e8057', 'request_id': 'req-f08e86cd-51e1-463e-92ac-dff77a32dba2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:30.756765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7955368b3d084860b33dc242ee0e8057', 'request_id': 'req-f08e86cd-51e1-463e-92ac-dff77a32dba2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:30.800935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] The token cache is being invalidate because project 7955368b3d084860b33dc242ee0e8057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:30.803587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:30.804300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:30.821515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3311/6641] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:30 2022] DELETE /identity/v3/projects/7955368b3d084860b33dc242ee0e8057 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:31.096644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:31.170915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:32.874920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:36.465299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:36.467913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:36.749863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2f64-5e8f-4a8c-98d3-c77f7f3d0968 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:36.872808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:36.909556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:36.910159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:36.910415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:36.910708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:36.912747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:36.947843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:36.949576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:36.976360 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3331/6642] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:41.558127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:41.559772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:41.694878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:41.696509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:41.739570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266db8f-a7a4-4b12-a869-f03785a81554 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.754577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.755233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.755567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.755843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.767622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:41.770506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86cd-51e1-463e-92ac-dff77a32dba2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.781368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.785443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.785875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.786161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] PATH_INFO: `/v3/users/a29fb36f4f794981a0dcf92416022670` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.789624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29fb36f4f794981a0dcf92416022670)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.796313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.812498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.815184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.850991 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3332/6643] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:47:42.089979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29fb36f4f794981a0dcf92416022670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:42.091906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29fb36f4f794981a0dcf92416022670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:42.214689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29fb36f4f794981a0dcf92416022670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:42.260620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29fb36f4f794981a0dcf92416022670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:42.260842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29fb36f4f794981a0dcf92416022670'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:42.306227 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3312/6644] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:41 2022] DELETE /identity/v3/users/a29fb36f4f794981a0dcf92416022670 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:42.771061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:42.773498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:42.793555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb482-2d99-4008-b690-9be645fbfaef service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:42.930317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:42.931377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:42.932180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:42.932665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] PATH_INFO: `/v3/users/ee734d5b89a84f44ba569e81cbde21b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:42.934735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee734d5b89a84f44ba569e81cbde21b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:42.944567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:43.095751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:43.098440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:43.124572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7aed0-cb5f-4e8f-a42d-5e8dd6486359 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:43.135119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:43.136075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:43.136925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:43.137405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] PATH_INFO: `/v3/projects/02c599acfaf7477aa05fb351e8e389ba` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:43.140366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c599acfaf7477aa05fb351e8e389ba)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:43.148165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:43.199329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:43.258609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee734d5b89a84f44ba569e81cbde21b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.272249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee734d5b89a84f44ba569e81cbde21b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.354886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c599acfaf7477aa05fb351e8e389ba', 'request_id': 'req-78b7be5b-aa35-4f83-87aa-d62f40e55590'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.408017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee734d5b89a84f44ba569e81cbde21b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.440563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee734d5b89a84f44ba569e81cbde21b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.442019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85311bbb-e4e0-480c-8ec6-d44bf334796f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee734d5b89a84f44ba569e81cbde21b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.488322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c599acfaf7477aa05fb351e8e389ba', 'request_id': 'req-78b7be5b-aa35-4f83-87aa-d62f40e55590'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.490122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3333/6645] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:42 2022] DELETE /identity/v3/users/ee734d5b89a84f44ba569e81cbde21b4 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:43.497849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c599acfaf7477aa05fb351e8e389ba', 'request_id': 'req-78b7be5b-aa35-4f83-87aa-d62f40e55590'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.501238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:43.501882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:43.502375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:43.529770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] The token cache is being invalidate because project 02c599acfaf7477aa05fb351e8e389ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:43.535097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.537567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:43.540623 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3313/6646] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:43 2022] DELETE /identity/v3/projects/02c599acfaf7477aa05fb351e8e389ba => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:43.545438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:43.547484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:43.576005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:43.580169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:43.715508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7be5b-aa35-4f83-87aa-d62f40e55590 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:43.740593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:43.794930 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3334/6647] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:47:43.929551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:43.929880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:43.955416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:43.957497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:43.959205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:43.963059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] PATH_INFO: `/v3/users/8efb712019674c1aaeb44e207bc53d99` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:43.969311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efb712019674c1aaeb44e207bc53d99)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:43.979044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:44.117526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d76fd-09f7-41a9-be56-80481d8eb999 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:44.135659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:44.136490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.136959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.137390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.171094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:44.171094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:44.217090 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3335/6648] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:47:44.305878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efb712019674c1aaeb44e207bc53d99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:44.306917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efb712019674c1aaeb44e207bc53d99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:44.439410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efb712019674c1aaeb44e207bc53d99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:44.446850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:44.484712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efb712019674c1aaeb44e207bc53d99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:44.492166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efb712019674c1aaeb44e207bc53d99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:44.510468 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3314/6649] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:43 2022] DELETE /identity/v3/users/8efb712019674c1aaeb44e207bc53d99 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:45.929654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.952673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d08bd-bd23-4526-b422-f4ec99e3264c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.958913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.960575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:46.124188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.127510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.129398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.134217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] PATH_INFO: `/v3/projects/b6808be101764be681cc4122b167aeab` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.144417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6808be101764be681cc4122b167aeab)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:46.148047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:46.159370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d0d5-a793-4708-971f-1c830b4c949d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:46.174709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.175397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.175684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.176164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] PATH_INFO: `/v3/projects/6af41f1903d34376b8397d48da97856a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.182809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af41f1903d34376b8397d48da97856a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:46.189722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:46.401398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af41f1903d34376b8397d48da97856a', 'request_id': 'req-96ff003c-a5b8-4b75-a299-d22200d11f68'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.474247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6808be101764be681cc4122b167aeab', 'request_id': 'req-4425826c-27f4-433a-ab61-fae5f104c306'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.484147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af41f1903d34376b8397d48da97856a', 'request_id': 'req-96ff003c-a5b8-4b75-a299-d22200d11f68'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.495171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af41f1903d34376b8397d48da97856a', 'request_id': 'req-96ff003c-a5b8-4b75-a299-d22200d11f68'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.536160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] The token cache is being invalidate because project 6af41f1903d34376b8397d48da97856a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:46.536585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.549876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-96ff003c-a5b8-4b75-a299-d22200d11f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.585061 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3315/6650] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:45 2022] DELETE /identity/v3/projects/6af41f1903d34376b8397d48da97856a => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:46.592033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220791c7-9c32-42e5-ab42-d361b98c1782 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.592471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220791c7-9c32-42e5-ab42-d361b98c1782 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.593424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220791c7-9c32-42e5-ab42-d361b98c1782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.610534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6808be101764be681cc4122b167aeab', 'request_id': 'req-4425826c-27f4-433a-ab61-fae5f104c306'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.630914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6808be101764be681cc4122b167aeab', 'request_id': 'req-4425826c-27f4-433a-ab61-fae5f104c306'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.660520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] The token cache is being invalidate because project b6808be101764be681cc4122b167aeab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:46.660812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.661794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4425826c-27f4-433a-ab61-fae5f104c306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:46.669521 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3336/6651] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:45 2022] DELETE /identity/v3/projects/b6808be101764be681cc4122b167aeab => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:46.671230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4651-0a20-40d1-9158-bcd7bd5b3d76 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.675790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4651-0a20-40d1-9158-bcd7bd5b3d76 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.676259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4651-0a20-40d1-9158-bcd7bd5b3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.692759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-220791c7-9c32-42e5-ab42-d361b98c1782 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:46.694334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-220791c7-9c32-42e5-ab42-d361b98c1782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:46.727021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1ea4651-0a20-40d1-9158-bcd7bd5b3d76 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:46.728262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1ea4651-0a20-40d1-9158-bcd7bd5b3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:46.772533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:46.888975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3316/6652] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:46.897666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.898027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.898227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.913273 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3337/6653] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:46.931105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:46.993785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:46.997623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:47.014870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.015418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.015502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.041427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3317/6654] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:47.045781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.064880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043930f7-2734-468e-83cf-c73a991bdab3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.066772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:47.068069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:47.078097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.078756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.079040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.079312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.079975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:47.080281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.085055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.088058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3338/6655] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:47.093328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.111897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fbc95-38e3-42e2-ad41-0a24bed6fad0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.124917 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3318/6656] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:47.125871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.133229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.133863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.134143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.134414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.135103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:47.135408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.151039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.170950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603b66-15ae-4ea2-8de7-d8e92c4a6b7a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.181668 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3339/6657] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:47.181952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.181952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.181952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.183629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.183629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.187479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.188593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.214050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d956495-4032-4813-be83-1c75fb15874b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.228256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.229225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.230784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.235235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.235968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.246261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.307253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3319/6658] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:47.315204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.434373 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3340/6659] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:47.435936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.479268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7cae0-12a4-4237-a257-b72690acfad6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.633778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.634692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.635126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.635587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.636386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.639477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9702-02db-4e04-845b-d853057ef492 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.696149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea707ea-d4e8-46db-8c3e-a07f74d4e6a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.702874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.703518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.704051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.704324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.713274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.713274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.809143 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3320/6660] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/users => generated 287 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:47.811867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.812289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.812757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.843685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] MFA Rules not processed for user `5a86d0498c7740d796d0f85e97bcb42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:47.844935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:47.935274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3321/6661] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:47.936587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.955305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39e7f-1033-4f5f-bbd3-14a59a4e944c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.963741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.964375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.964655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.964925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.966074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.967748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.000742 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3341/6662] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/users => generated 292 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:48.012206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3322/6663] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:48.013259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.014527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.034991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f06a1-85a3-4d56-ac05-4b8e357bf289 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.040964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4007-3ce4-4aee-a030-32f154601d6e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.041515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.041966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.048434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.048434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.048434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.048434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.065729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.076013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.076013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.076494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.077129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.078892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.107390 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3342/6664] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:48.108199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.109902 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3323/6665] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:48.114097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.128780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569fdf4-063d-4a49-b393-23dfd2c7fadc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.140245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.141295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.141784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.142425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] PATH_INFO: `/v3/projects/b7fd6fa4a61c481c8b6c83180d093790/users/d38837d04bdf42a68d83d04f4ec13e50/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.144345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738c63-82a8-440d-b3cb-33235fe20a34 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.166272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.166472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.166865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.168659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.168659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.172309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.173975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fd6fa4a61c481c8b6c83180d093790, user_id=d38837d04bdf42a68d83d04f4ec13e50, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.184629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de5f0f-1dfe-4e6e-8a74-afc0307edeb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.198975 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3324/6666] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:48.201418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.224600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64c68-949f-4547-b880-bc9de50d3631 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.232152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.232559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.232839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.233112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] PATH_INFO: `/v3/projects/ff5cbc15bdbb4bbaa47b192be7296301/users/45a9564cb2e2487d87f9d7f0d75f80b7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.255777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5cbc15bdbb4bbaa47b192be7296301, user_id=45a9564cb2e2487d87f9d7f0d75f80b7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.259295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874cad-e147-475a-91af-e8e79b58fc84 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.291929 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3343/6667] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:48 2022] PUT /identity/v3/projects/b7fd6fa4a61c481c8b6c83180d093790/users/d38837d04bdf42a68d83d04f4ec13e50/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:48.294601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.295081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.295758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.355089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] MFA Rules not processed for user `d38837d04bdf42a68d83d04f4ec13e50`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:48.355089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:48.361419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3325/6668] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:48 2022] PUT /identity/v3/projects/ff5cbc15bdbb4bbaa47b192be7296301/users/45a9564cb2e2487d87f9d7f0d75f80b7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:48.367718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.368240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.368621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.405799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:48.407772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:48.433198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.448651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.540072 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3344/6669] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:48.549450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.550958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:48.574185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3326/6670] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:48.603044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.605382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:48.743575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bae35-ab7b-45d9-9a6e-a7e5b016c2e9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.755117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.757017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.757017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.757017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.768634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.770508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.783203 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3327/6671] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:48.788634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8142-1b08-4f57-a69b-59d38b6fe974 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.807820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.809455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.809455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.809455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.826213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.840363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.863792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3345/6672] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:49.425518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.428118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:49.589843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.658762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a3d6-9e4c-432e-a327-1c48418932a5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.679839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.680474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.680781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.681055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.691430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:49.751241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.751241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.806873 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3328/6673] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:47:52.517938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.519738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:52.626037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffffd15-c4e3-4ce7-a5c8-bf84f8d96864 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.663655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.667615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.673353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.673874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] PATH_INFO: `/v3/users/2dac64cc9d10438c802bcd594e6bda86` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.681142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dac64cc9d10438c802bcd594e6bda86)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.683421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.007167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dac64cc9d10438c802bcd594e6bda86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:53.007913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dac64cc9d10438c802bcd594e6bda86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:53.170411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dac64cc9d10438c802bcd594e6bda86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:53.196967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dac64cc9d10438c802bcd594e6bda86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:53.207167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f48a1982-440e-440c-ab06-9719a64db744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dac64cc9d10438c802bcd594e6bda86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:53.227706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3346/6674] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:52 2022] DELETE /identity/v3/users/2dac64cc9d10438c802bcd594e6bda86 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:53.719572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:53.737277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699a41-cb5a-47ec-9442-a8eefbba630d service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:54.028564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:54.029294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.029574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.030033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] PATH_INFO: `/v3/projects/91c9cc66dc6a40179b3a306cd3f9304a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.032023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c9cc66dc6a40179b3a306cd3f9304a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:54.034600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:54.285037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c9cc66dc6a40179b3a306cd3f9304a', 'request_id': 'req-65edd664-4a5b-4167-8187-6617ff1876ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:54.403671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c9cc66dc6a40179b3a306cd3f9304a', 'request_id': 'req-65edd664-4a5b-4167-8187-6617ff1876ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:54.411683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c9cc66dc6a40179b3a306cd3f9304a', 'request_id': 'req-65edd664-4a5b-4167-8187-6617ff1876ef'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:54.448719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] The token cache is being invalidate because project 91c9cc66dc6a40179b3a306cd3f9304a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:54.449401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:54.453422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65edd664-4a5b-4167-8187-6617ff1876ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:54.467395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.468598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.469099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.480179 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3329/6675] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:53 2022] DELETE /identity/v3/projects/91c9cc66dc6a40179b3a306cd3f9304a => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:54.521394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:54.522682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:54.605478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:54.758645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3347/6676] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:54.767850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.768856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.769312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.840017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:54.869573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:54.911213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:54.923420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3330/6677] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:54.924516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68887483-9dc4-4b29-9b8b-4803f6fe31f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:54.943552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:54.948514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.948882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.949236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.952618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:54.952618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:54.964412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.028683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.044745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3348/6678] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:55.050239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40040d4-a4fd-4013-a8c8-a851726da48a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.063195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.064577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.064855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.067629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.070021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.071715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.218848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3331/6679] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:55 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:55.223355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.237258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e52de1-e4bd-4b72-a475-8a9abd8d31e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.345768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.346482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.346824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.347104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.352268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.358502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.504015 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3349/6680] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:55 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:55.505258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.522980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12579f-9386-43e6-b27c-8100095ec1cb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.538208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.538966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.539316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.539681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.540588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.546948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.572965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3332/6681] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:55.574376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.589532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bcae6-6334-480a-a38f-5823d47a2d8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.603734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.604654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.605125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.605569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.606968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.609953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e97b7e-3921-41da-8ae5-cc27cfe41850 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.644761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.645488 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3350/6682] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:55.668150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eeda6-837a-427d-a584-a7a343c4e2c4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.689021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.691705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.691705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.691705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] PATH_INFO: `/v3/projects/333d44d1c8e0405a856b6a166f79794e/users/23e7dfcf2ae94fc3844ff1f4139b9d4c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.759476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333d44d1c8e0405a856b6a166f79794e, user_id=23e7dfcf2ae94fc3844ff1f4139b9d4c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.764424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.885047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3333/6683] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:55 2022] PUT /identity/v3/projects/333d44d1c8e0405a856b6a166f79794e/users/23e7dfcf2ae94fc3844ff1f4139b9d4c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:55.889828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.890114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.890391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.949724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] MFA Rules not processed for user `23e7dfcf2ae94fc3844ff1f4139b9d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:55.951180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:56.126452 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3351/6684] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:56.131628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.150343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.432472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178892f-7d2f-45fc-bf83-ceb323eaf955 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.461619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.462861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.463338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.464016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.465066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.467335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.740760 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3334/6685] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:47:56 2022] POST /identity/v3/projects => generated 389 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:56.740894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.775260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327253bd-8f4e-4ad6-9a00-8cf0b38a08f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.839509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.007641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375110-610e-40cf-a940-dd835109255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.010979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375110-610e-40cf-a940-dd835109255b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.010979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375110-610e-40cf-a940-dd835109255b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.010979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375110-610e-40cf-a940-dd835109255b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.010979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23375110-610e-40cf-a940-dd835109255b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.012841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23375110-610e-40cf-a940-dd835109255b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.155126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3352/6686] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:47:56 2022] POST /identity/v3/users => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:57.163963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.194031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f4dba-63b3-493e-9654-8567acfeaaa4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.212994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.213712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.214082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.214594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.216422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.219091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.267084 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3335/6687] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:47:57.271688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375110-610e-40cf-a940-dd835109255b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.298052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375110-610e-40cf-a940-dd835109255b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.314239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.315179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.315564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.318049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] PATH_INFO: `/v3/projects/42174f4c876e487ab2e5988bee6ad64f/users/f48a4a4f1eb9467cb37362d13be39964/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.354511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42174f4c876e487ab2e5988bee6ad64f, user_id=f48a4a4f1eb9467cb37362d13be39964, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.362636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.476957 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3353/6688] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:57 2022] PUT /identity/v3/projects/42174f4c876e487ab2e5988bee6ad64f/users/f48a4a4f1eb9467cb37362d13be39964/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:57.482915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.507946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e9bb-ea39-4368-8101-1b83a187c6e5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.658238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.658915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.659392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.659825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.660658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.662464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24663d27-b870-4813-bb95-a7cef3f1b7e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.679977 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3336/6689] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:57.681028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.696976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a75ab-8b84-4493-a3fa-bba6919dcf29 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.708403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.713646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.714956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.716029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] PATH_INFO: `/v3/projects/42174f4c876e487ab2e5988bee6ad64f/users/f48a4a4f1eb9467cb37362d13be39964/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.725247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42174f4c876e487ab2e5988bee6ad64f, user_id=f48a4a4f1eb9467cb37362d13be39964, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.728112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.800241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3354/6690] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:47:57 2022] PUT /identity/v3/projects/42174f4c876e487ab2e5988bee6ad64f/users/f48a4a4f1eb9467cb37362d13be39964/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:57.813297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.826797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.826797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.885681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] MFA Rules not processed for user `f48a4a4f1eb9467cb37362d13be39964`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:57.889557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:58.044397 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3337/6691] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:47:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:47:58.049865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.070184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ce36-fdef-4d39-a9e0-6664642f2e21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.076231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.077521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.077864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.078227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects/333d44d1c8e0405a856b6a166f79794e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.079847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:get_project(project_id=333d44d1c8e0405a856b6a166f79794e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.091640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.091640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3355/6692] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects/333d44d1c8e0405a856b6a166f79794e => generated 387 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.094684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.099084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.114770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb98ca-514b-47eb-bfdc-733c3b02592e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.119879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.120498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.120780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.121088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.122280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.124252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.301153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3338/6693] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 14:47:58 2022] POST /identity/v3/projects => generated 338 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:58.302309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.303785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611904e-f198-45ab-af52-f24c63e165f6 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.507155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.514865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.514865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.514865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.514865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.515383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.572498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3356/6694] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects => generated 5801 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:58.576511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.611595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b63b7a-5b49-419a-95cc-2f8416301fc5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.622748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.623696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.623979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.624422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects/333d44d1c8e0405a856b6a166f79794e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.627889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:get_project(project_id=333d44d1c8e0405a856b6a166f79794e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.630181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.637804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.638441 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3339/6695] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects/333d44d1c8e0405a856b6a166f79794e => generated 387 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.657125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cb5cf-739a-4a0d-9894-dfebc2e12753 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.677548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.683090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.683090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.683090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects/714a549903c0470cbfaf4a533336c773` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.683090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:get_project(project_id=714a549903c0470cbfaf4a533336c773)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.683475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.694163 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3357/6696] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects/714a549903c0470cbfaf4a533336c773 => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.695847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.725193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbb60d-e036-4348-82c5-2f86d26d05df tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.743272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.744354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.744873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.745382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.746254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.748586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.814103 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3340/6697] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects => generated 5801 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:58.815112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.851704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7112c5-c720-432b-b1bf-49756fdc506b tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.887076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.888111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.897571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.898147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.899122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.899691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.901895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.011946 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3358/6698] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects?domain_id=default => generated 5470 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:47:59.013822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.038128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de361737-fdbe-40cc-b01d-7380cf4af0e7 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.054395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.055318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.055808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.056288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.057130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.059808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.115875 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3341/6699] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects => generated 5801 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:59.119901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.145007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3440c1-6b25-4b39-b05f-328c5cfa8442 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.154551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.159588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.159588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.159588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.159588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:59.160418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.160418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.194962 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3359/6700] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects?domain_id=default => generated 5470 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:47:59.201697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.214036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332eab2-b1a2-4a84-b2f3-1bf9895fa914 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.224203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.225268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.225855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.226335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.233473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.240755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.270425 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3342/6701] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects => generated 5801 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:47:59.275670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.289299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71010fd-6c3e-445a-91bd-961bb8b19284 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.296056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.297559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.298073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.298440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.300189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-647518361) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:59.300330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.303786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.324536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.328454 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3360/6702] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-647518361 => generated 534 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:59.340009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6b1c-756d-4afb-838f-d6931231cb2a tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.347563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f48a4a4f1eb9467cb37362d13be39964', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42174f4c876e487ab2e5988bee6ad64f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.348871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.349335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.349745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] PATH_INFO: `/v3/projects/714a549903c0470cbfaf4a533336c773` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.351898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorizing `identity:delete_project(project_id=714a549903c0470cbfaf4a533336c773)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.356906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.593853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714a549903c0470cbfaf4a533336c773', 'request_id': 'req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:59.747488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714a549903c0470cbfaf4a533336c773', 'request_id': 'req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:59.754577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714a549903c0470cbfaf4a533336c773', 'request_id': 'req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:59.783564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] The token cache is being invalidate because project 714a549903c0470cbfaf4a533336c773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:47:59.783993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:59.784789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:47:59.787234 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3343/6703] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:47:59 2022] DELETE /identity/v3/projects/714a549903c0470cbfaf4a533336c773 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:59.791062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.792950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:59.856677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.084049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b7024-f608-4cf7-8743-061034ca61a5 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.254057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.255747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:00.294304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.294947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.295223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.295498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] PATH_INFO: `/v3/users/23e7dfcf2ae94fc3844ff1f4139b9d4c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.309384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e7dfcf2ae94fc3844ff1f4139b9d4c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.311373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.464798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a4e1b-14ac-41fc-a4cc-ae8b6887b0d8 tempest-ListProjectsStaticTestJSON-1184888865 tempest-ListProjectsStaticTestJSON-1184888865-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.476143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.476807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.477084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.477351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] PATH_INFO: `/v3/users/d38837d04bdf42a68d83d04f4ec13e50` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.482864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38837d04bdf42a68d83d04f4ec13e50)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.484802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.541597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.637571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e7dfcf2ae94fc3844ff1f4139b9d4c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.637571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e7dfcf2ae94fc3844ff1f4139b9d4c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.759853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e7dfcf2ae94fc3844ff1f4139b9d4c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.777918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e7dfcf2ae94fc3844ff1f4139b9d4c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.783232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c3f1a7f-01e1-4b7c-a2a4-f21d6e3f5db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e7dfcf2ae94fc3844ff1f4139b9d4c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.838601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38837d04bdf42a68d83d04f4ec13e50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.841521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38837d04bdf42a68d83d04f4ec13e50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:00.854354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3361/6704] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:47:59 2022] DELETE /identity/v3/users/23e7dfcf2ae94fc3844ff1f4139b9d4c => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:00.861717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b628e-5a21-42cd-a9ec-1631588e3a63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.863355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b628e-5a21-42cd-a9ec-1631588e3a63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.863355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b628e-5a21-42cd-a9ec-1631588e3a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.892248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-300b628e-5a21-42cd-a9ec-1631588e3a63 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:00.893564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-300b628e-5a21-42cd-a9ec-1631588e3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:01.006501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.023273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38837d04bdf42a68d83d04f4ec13e50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:01.062598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38837d04bdf42a68d83d04f4ec13e50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:01.062598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38837d04bdf42a68d83d04f4ec13e50'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:01.091687 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3362/6705] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:01.122515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3344/6706] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:00 2022] DELETE /identity/v3/users/d38837d04bdf42a68d83d04f4ec13e50 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:01.129540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.129839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.130115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.175091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.175091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:01.208990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:01.210385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:01.432693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275ba0b-1870-4d20-9c9f-c15f99b29abc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.448785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.449428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.449770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.474517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.489433 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3363/6707] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:01.576985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.603712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8014762-7da9-4b32-8e47-ea50d69aa807 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.615483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.616120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.616400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.616669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.660900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.666724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.682051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.683552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5cf78-a289-4e9b-8caa-dc40ccf9036c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.706359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3364/6708] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:01.731812 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3345/6709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:02.905765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.907412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:02.933427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a441fc0-7919-45ae-94fe-3ee7404f1f4c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:02.954916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.955810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.962301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.962793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] PATH_INFO: `/v3/users/0da5f89804c64a8eb5977d19d32615ad` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.966485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da5f89804c64a8eb5977d19d32615ad)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:02.968590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.379721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da5f89804c64a8eb5977d19d32615ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:03.383191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da5f89804c64a8eb5977d19d32615ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:03.506354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da5f89804c64a8eb5977d19d32615ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:03.530042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da5f89804c64a8eb5977d19d32615ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:03.535726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da5f89804c64a8eb5977d19d32615ad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:03.566910 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3365/6710] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:02 2022] DELETE /identity/v3/users/0da5f89804c64a8eb5977d19d32615ad => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:03.571228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.571759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.571759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.615684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:03.617195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:03.742990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.784540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3346/6711] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:03.814471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.817054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:04.009085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.051889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db4cb-1905-4377-9069-5ea0776332a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.067793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.068486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.069626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.069626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.085189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.087166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.103275 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3366/6712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:04.617348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.618989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:04.645203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32ca86-f24f-44ad-ada2-dd48190221dd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.658975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.660355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.662029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.662541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] PATH_INFO: `/v3/projects/b7fd6fa4a61c481c8b6c83180d093790` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.667004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fd6fa4a61c481c8b6c83180d093790)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.678995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.884070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.885587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:04.901349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f6a3-6ef0-46b0-9df9-939b2bd9c217 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.915636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fd6fa4a61c481c8b6c83180d093790', 'request_id': 'req-6cc26d93-68e3-452a-89b5-b6988a18f068'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.021507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fd6fa4a61c481c8b6c83180d093790', 'request_id': 'req-6cc26d93-68e3-452a-89b5-b6988a18f068'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.022868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.024182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.024737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.025282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] PATH_INFO: `/v3/projects/333d44d1c8e0405a856b6a166f79794e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.026883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333d44d1c8e0405a856b6a166f79794e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.031707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fd6fa4a61c481c8b6c83180d093790', 'request_id': 'req-6cc26d93-68e3-452a-89b5-b6988a18f068'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.032279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.060740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] The token cache is being invalidate because project b7fd6fa4a61c481c8b6c83180d093790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:05.061821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.064659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6cc26d93-68e3-452a-89b5-b6988a18f068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.068693 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3347/6713] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:04 2022] DELETE /identity/v3/projects/b7fd6fa4a61c481c8b6c83180d093790 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:05.074894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f96c0-0826-464e-98a2-6c87d300a859 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.075441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f96c0-0826-464e-98a2-6c87d300a859 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.075938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f96c0-0826-464e-98a2-6c87d300a859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.121302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-682f96c0-0826-464e-98a2-6c87d300a859 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:05.124495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-682f96c0-0826-464e-98a2-6c87d300a859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:05.157994 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3348/6714] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:05.171034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.173771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.174917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.247705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333d44d1c8e0405a856b6a166f79794e', 'request_id': 'req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.251923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:05.256591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:05.364931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333d44d1c8e0405a856b6a166f79794e', 'request_id': 'req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.377051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333d44d1c8e0405a856b6a166f79794e', 'request_id': 'req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.404162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] The token cache is being invalidate because project 333d44d1c8e0405a856b6a166f79794e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:05.405744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.406869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.409465 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3367/6715] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:04 2022] DELETE /identity/v3/projects/333d44d1c8e0405a856b6a166f79794e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:05.414851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.419430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:05.454960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3349/6716] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:05.455889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.460461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:05.490518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb98eac-e502-40d9-a94a-950ee37f3b48 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.499028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.499028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.499404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.499825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] PATH_INFO: `/v3/users/f48a4a4f1eb9467cb37362d13be39964` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.500890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48a4a4f1eb9467cb37362d13be39964)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.502967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.526128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93631c2-c897-47f8-9aa6-2f3dbd5700e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.531725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.533044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.533044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.533317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] PATH_INFO: `/v3/projects/0a78277feff64f1d8a2df6acbcefb8f9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.544582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a78277feff64f1d8a2df6acbcefb8f9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.549182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.804543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a78277feff64f1d8a2df6acbcefb8f9', 'request_id': 'req-ce26d238-07c0-43e2-9f82-db368097e7ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.807755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48a4a4f1eb9467cb37362d13be39964'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.808775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48a4a4f1eb9467cb37362d13be39964'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.925636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48a4a4f1eb9467cb37362d13be39964'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.971373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48a4a4f1eb9467cb37362d13be39964'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.972531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48a4a4f1eb9467cb37362d13be39964'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:05.999751 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3350/6717] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:05 2022] DELETE /identity/v3/users/f48a4a4f1eb9467cb37362d13be39964 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:06.000909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.002538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.045285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a78277feff64f1d8a2df6acbcefb8f9', 'request_id': 'req-ce26d238-07c0-43e2-9f82-db368097e7ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:06.059185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a78277feff64f1d8a2df6acbcefb8f9', 'request_id': 'req-ce26d238-07c0-43e2-9f82-db368097e7ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:06.079791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] The token cache is being invalidate because project 0a78277feff64f1d8a2df6acbcefb8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:06.080492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:06.081419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce26d238-07c0-43e2-9f82-db368097e7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:06.091466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3368/6718] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:05 2022] DELETE /identity/v3/projects/0a78277feff64f1d8a2df6acbcefb8f9 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:06.098350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f49e-b49f-4644-adcc-01a3b738d547 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.098350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f49e-b49f-4644-adcc-01a3b738d547 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.099041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f49e-b49f-4644-adcc-01a3b738d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.127256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e7f2f49e-b49f-4644-adcc-01a3b738d547 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:06.128757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7f2f49e-b49f-4644-adcc-01a3b738d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.132307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c6f5-91d3-471d-982c-88fa78447d3d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.145259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.145259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.145259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.146076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.146384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:06.146715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.148595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.171798 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3369/6719] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:06.181503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.186041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.186041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.186263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3351/6720] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:06.188212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.191112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.218406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def712b8-5f64-4e28-bcb4-a0fd16aa4df9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.233472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.234005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:06.234128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.234381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.238899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.242109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.244910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.250820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.279261 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3370/6721] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:06.283177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.322890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868fe08-faba-4190-9f3e-5a9bfa8c8e81 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.345935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.350387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.351262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.351699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.354075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:06.354687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.362826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7881e0c-4cfd-40dc-b289-b9f4f8e22af2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.399308 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3352/6722] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:06.403691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.426215 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3371/6723] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:06.430802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.431374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.431862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.485008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] MFA Rules not processed for user `45a9564cb2e2487d87f9d7f0d75f80b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:06.486420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.561237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ec8f9-0c80-4523-b67a-b09e410c4f45 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.573295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.573927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.577247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.581242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:06.582081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.583091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.585073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b77d2-4cc6-418e-a5e0-e02469af1c38 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.632552 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3372/6724] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:06.637055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.662374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794ceb-4984-4ec1-a5be-b66d33978fb4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.678563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.678563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.678827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.681533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.681988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.687687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.708983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3353/6725] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:06.714841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.715739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.716045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.734391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:06.779435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] MFA Rules not processed for user `45a9564cb2e2487d87f9d7f0d75f80b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:06.780659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.800996 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3354/6726] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:06.801876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.839481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443162a1-ec4e-4a0c-9798-5976e669a7b3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.853449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.856812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.857269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.857756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.858585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.862736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.916394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3355/6727] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:06.917765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:06.926932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.962501 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3373/6728] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/projects => generated 373 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:06.964011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.109080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204779a4-c9aa-41c4-af2e-8c2d4a800bd0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.181708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7e7a4-c1d9-4179-98fe-e26b9fb89b11 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.192764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.193657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.194149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.194693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.195946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.200781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.239406 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3374/6729] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:07.240555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.257567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92c74-9ef9-4aad-ac6f-4a4813572afe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.279567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.280208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.280495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.280777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.281420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.283991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.297240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.297240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.297240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.297240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.405599 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3375/6730] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:07 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:07.405599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.416021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:07.433687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.433687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.437511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede5b7a-2aa2-4e34-a3b2-5129d4fa383f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.453800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.454492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.454853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.455235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] PATH_INFO: `/v3/projects/42174f4c876e487ab2e5988bee6ad64f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.456447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42174f4c876e487ab2e5988bee6ad64f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.459013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.461435 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3356/6731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:07.474195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.514145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920f471-034f-46e3-a7e4-21d0f1129bdc service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.523162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.525019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.525371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.525627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] PATH_INFO: `/v3/projects/94a0895413fd4bd4b6eef840354b7c03/users/d195924f523c43268787721e3caee2a4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.574158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a0895413fd4bd4b6eef840354b7c03, user_id=d195924f523c43268787721e3caee2a4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.603935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.627100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42174f4c876e487ab2e5988bee6ad64f', 'request_id': 'req-b414bb24-9e22-4719-977c-1f84f07cc536'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:07.719948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42174f4c876e487ab2e5988bee6ad64f', 'request_id': 'req-b414bb24-9e22-4719-977c-1f84f07cc536'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:07.740173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42174f4c876e487ab2e5988bee6ad64f', 'request_id': 'req-b414bb24-9e22-4719-977c-1f84f07cc536'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:07.741515 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3357/6732] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:07 2022] PUT /identity/v3/projects/94a0895413fd4bd4b6eef840354b7c03/users/d195924f523c43268787721e3caee2a4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:07.756149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.802296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] The token cache is being invalidate because project 42174f4c876e487ab2e5988bee6ad64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:07.803156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:07.807326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b414bb24-9e22-4719-977c-1f84f07cc536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:07.819863 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3376/6733] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:07 2022] DELETE /identity/v3/projects/42174f4c876e487ab2e5988bee6ad64f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:07.823481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.823948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.825425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.895800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] MFA Rules not processed for user `d195924f523c43268787721e3caee2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:07.898183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:07.973750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5eeef-754f-49c7-bb25-765b862c6c9d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.987374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.988013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.988292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.988562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.989212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.997778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988aa7-5526-4bf6-97dc-4ada044de54b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.023663 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3358/6734] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:08.028683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.028975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.029254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.056216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.083515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:08.085044 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3377/6735] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:08.086319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.087267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.088886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.109047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ecee5-28c4-4f18-927c-d5c088ca3728 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.111641 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3359/6736] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:08.112906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.115055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.115883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.116278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.116648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.117271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.117851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.119671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46a62a-6c8b-4396-bab0-98d565b9b472 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.142856 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3378/6737] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:08.145610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80eb73-f130-4eb5-ba47-d5a5edd7d368 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.158307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.158307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.158307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.161340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.162223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.162690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.163318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.164373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.172437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.187665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.223727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:08.225492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.242484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3379/6738] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:08.243758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.256621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1dfe3-6584-4589-afd6-a2cd5e5a6b1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.264530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.264530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.264530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.264530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] PATH_INFO: `/v3/projects/088796f54dae4011ab52c9af5cae9a06/users/27fe59c95f6a45e1ad98d3a85dfe46f9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.284221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088796f54dae4011ab52c9af5cae9a06, user_id=27fe59c95f6a45e1ad98d3a85dfe46f9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.287380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.348136 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3360/6739] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:08.349204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.404908 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3380/6740] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:08 2022] PUT /identity/v3/projects/088796f54dae4011ab52c9af5cae9a06/users/27fe59c95f6a45e1ad98d3a85dfe46f9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:08.406484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.487578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b2326-ce48-4f6b-bb7c-d15fa436e377 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.594922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9192-066b-4411-b5da-4413aef2f658 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.608466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.609732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.610024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.610570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.611654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.613620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.618445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.619469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.619740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.620117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.620895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:08.622642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.625426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a866-0474-4aa0-a180-50ec982beaa4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.655896 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3361/6741] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:08.655896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.655896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.655896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.695683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:08.698954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.738151 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3362/6742] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:08.739499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.751962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b268b2-ce0f-40c0-b94b-1a84011b5c0f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.760326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3381/6743] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/users => generated 298 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:08.763822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.775040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.775524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.778751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.779192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.779702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.784654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.792270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.969526 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3363/6744] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:08.979207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.982551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa03a2-38cd-4cd0-9610-577c122b7c80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.983665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.120575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.130606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.131687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.132099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.132482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.239326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca08a0-ca0b-4747-b5d6-db84720f606c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.261596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.262811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.263095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.263367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.264015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.265652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.297029 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3364/6745] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:09.297617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.307327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.308978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.320813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24966ef-8c3c-4a2d-b28c-82d91ec44485 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.335013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.339432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.339432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.339432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.339731 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3382/6746] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:09.339827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.339934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.340030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.372177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59fe7-200b-4ef3-88ce-eac77694d1da service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.378773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.379608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.381757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.382264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] PATH_INFO: `/v3/projects/dd45630195c04e20b9b2bdd817795b85/users/c99c05b4582645f6a091d183bc17a660/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.404723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd45630195c04e20b9b2bdd817795b85, user_id=c99c05b4582645f6a091d183bc17a660, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.409533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.491201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.511592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3365/6747] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:09 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:09.512805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.529606 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3383/6748] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:09 2022] PUT /identity/v3/projects/dd45630195c04e20b9b2bdd817795b85/users/c99c05b4582645f6a091d183bc17a660/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:09.530949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.553952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34af4b2-b1c4-46e0-860d-8cfb688870a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.729186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80f17-2d24-446d-8a89-246c8665ffd6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.748545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.749433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.755437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.756355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.756700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.757078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.757814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.758853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.759348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.760231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.769597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.770231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.826918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3366/6749] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:09.828155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.828983 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3384/6750] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:09.831500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.861922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.886399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e9d2a-08d8-4ba7-b93f-91e011fdaaee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.889060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b5d68-e57d-4f19-8290-6df286d12da0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.908670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.908913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.910020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.910020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.910782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.912441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] PATH_INFO: `/v3/projects/dd45630195c04e20b9b2bdd817795b85/users/c99c05b4582645f6a091d183bc17a660/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.912841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.913217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.915252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.917536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.919296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd45630195c04e20b9b2bdd817795b85, user_id=c99c05b4582645f6a091d183bc17a660, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.928266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c3748-60a1-4d28-80f3-d05f82980cbb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.953253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3367/6751] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:09.957029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.969474 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3385/6752] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:09 2022] PUT /identity/v3/projects/dd45630195c04e20b9b2bdd817795b85/users/c99c05b4582645f6a091d183bc17a660/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:09.969821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbc70-4986-45c4-bc2e-6bcdd29bbdf2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.971289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.971659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.971988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.087641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] MFA Rules not processed for user `c99c05b4582645f6a091d183bc17a660`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:10.090481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:10.257464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.258182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.259480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.261479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] PATH_INFO: `/v3/projects/d05a33fa6a0f47eaa87e869a05441bdb/users/ff4de69341c946e8a80ac35955f2283a/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.325759 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3386/6753] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:10.333481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.337195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05a33fa6a0f47eaa87e869a05441bdb, user_id=ff4de69341c946e8a80ac35955f2283a, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.346898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e9a6-c3e3-4acb-a1f4-9bdb27156b60 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.405750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344734be-b91c-440d-9cfb-4c85bf56e741 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.421077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.421703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.422172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.422634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.431761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.431761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invalid input for field 'name': '' is too short Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: '' Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.460974 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:48:10.462812 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Oct 31 14:48:10.464081 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.467112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3387/6754] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:10 2022] POST /identity/v3/domains => generated 283 bytes in 134 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:48:10.473379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.502211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.524023 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3368/6755] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:09 2022] PUT /identity/v3/projects/d05a33fa6a0f47eaa87e869a05441bdb/users/ff4de69341c946e8a80ac35955f2283a/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:10.526815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.527043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.527500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.557803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d0c07-2e72-4e0a-9145-3481b38982ac tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.618272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] MFA Rules not processed for user `ff4de69341c946e8a80ac35955f2283a`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:10.626108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:10.717188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.717689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.718179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.718651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.719621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.725909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.734572 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 31 14:48:10.736136 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 14:48:10.737291 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:10.740606 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3388/6756] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:10 2022] POST /identity/v3/domains => generated 412 bytes in 268 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 14:48:10.745370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.758604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1743-adb2-4234-8b96-7e06b85dc55d tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.769333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.770375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.771088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.771606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.778045 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3369/6757] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:10.778964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.784354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.786271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.876975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195fd2a-ee2c-43b5-9cde-3c98e6ddbdf7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.890163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.891131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.891576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.892114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.893141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.895644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.909385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3389/6758] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:10 2022] POST /identity/v3/domains => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:10.913295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.000100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aa481-cc5b-433e-a94e-8bc2cbee6046 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.007890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.008657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.009105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.009369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.044365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.057195 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3370/6759] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:10 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:11.063910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.066190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ea6190bccbc24366bd9f716f1e7e3c81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.069232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 31 14:48:11.124636 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 31 14:48:11.125865 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:11.128395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3390/6760] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:10 2022] DELETE /identity/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81 => generated 120 bytes in 215 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:48:11.132364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.189659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa68b8-649b-4df3-bc35-e59c1ec98539 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.235096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ffba5-8146-4a5d-a7e2-22db82a13e98 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.257566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.258401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.258786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.259312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.266864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.269094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.361791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.362493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.363004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.363469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.364990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ea6190bccbc24366bd9f716f1e7e3c81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.366655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.393808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.394549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.396265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3371/6761] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:11 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:11.400684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.404394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:11.422899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046253a-f5c0-4f07-8348-57bc8a93ae96 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.499670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.506537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.514797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3391/6762] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:48:11 2022] PATCH /identity/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81 => generated 276 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:11.516031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.518444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:11.561945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.563382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.563637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.563904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.567825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.569543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.595687 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3372/6763] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:11.599893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.603372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:11.623119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890d68-75c8-49a4-a780-29133b7537b3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.649465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ba5a5-9389-4f7d-ae5c-a46e9f9efbd4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.656480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.661472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.661836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.664372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] PATH_INFO: `/v3/projects/e3f291aab56f4c7dafa132de345d2164/users/c1abb5ac227948b0bf9257d4b425a738/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.694085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.694813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.695301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.695838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.721004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f291aab56f4c7dafa132de345d2164, user_id=c1abb5ac227948b0bf9257d4b425a738, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.724122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.726517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ea6190bccbc24366bd9f716f1e7e3c81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.731141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.757223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.763719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:11.873197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3373/6764] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:11 2022] PUT /identity/v3/projects/e3f291aab56f4c7dafa132de345d2164/users/c1abb5ac227948b0bf9257d4b425a738/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:11.877449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.976806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.014290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a23e-0a7b-4dc9-9517-020d6dc9adc1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.080858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.092096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.111886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.112855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.113234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.114559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.117307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.117307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.125947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] The token cache is being invalidate because project ea6190bccbc24366bd9f716f1e7e3c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:12.126256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.130088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.142252 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3374/6765] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:12.150201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.150686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.151459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.152101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ea6190bccbc24366bd9f716f1e7e3c81', 'request_id': 'req-912b9551-eef2-44a3-98ec-bb923f4c5697'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:12.159524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:12.178950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3392/6766] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:11 2022] DELETE /identity/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:12.184061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.186263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:12.193327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380f753-4494-44a7-a6cc-dc869b3f833d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.206846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.209144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.209684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.210319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] PATH_INFO: `/v3/projects/e3f291aab56f4c7dafa132de345d2164/users/c1abb5ac227948b0bf9257d4b425a738/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.213707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f291aab56f4c7dafa132de345d2164, user_id=c1abb5ac227948b0bf9257d4b425a738, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.217126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83cb4-3f4f-4ab4-991f-25b6f36fec8f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.245579 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3375/6767] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:12 2022] PUT /identity/v3/projects/e3f291aab56f4c7dafa132de345d2164/users/c1abb5ac227948b0bf9257d4b425a738/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:12.248346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.265193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.268088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.268582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.348786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b9551-eef2-44a3-98ec-bb923f4c5697 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.372599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] MFA Rules not processed for user `c1abb5ac227948b0bf9257d4b425a738`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:12.378649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:12.468596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.469256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.469537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.469805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/8ca7bb2cd99247a69649476ac8efa2cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.481893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Could not find domain: 8ca7bb2cd99247a69649476ac8efa2cd.: keystone.exception.DomainNotFound: Could not find domain: 8ca7bb2cd99247a69649476ac8efa2cd. Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8ca7bb2cd99247a69649476ac8efa2cd. Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:12.488299 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:12.489286 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:12.490268 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8ca7bb2cd99247a69649476ac8efa2cd. Oct 31 14:48:12.491376 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:12.491376 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3393/6768] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:12 2022] DELETE /identity/v3/domains/8ca7bb2cd99247a69649476ac8efa2cd => generated 112 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:48:12.497224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.539748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8aa79-d4e8-49da-a826-8c95f3564743 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.556776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.559977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.564369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.564369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.566056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.584596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.608213 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3376/6769] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:12.612493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.634687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07135f77-f30e-4c6b-ad82-6a07f7fe7d98 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.641337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.642121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.643069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.643460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.644291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.646085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.648729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.695853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3394/6770] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/domains => generated 253 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:12.699598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.757735 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3377/6771] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/domains => generated 277 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:12.762123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.880478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f55ff-b967-4879-bb64-6e74e619b5e4 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.925396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de465a2-4b59-447c-ac2c-ad064ea91103 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.937836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.939926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.940635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.942850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.943794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.946085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.007375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.008353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.008808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.009617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.010444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.013249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.072651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1248783599' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:13.072651 n-d-863055-2 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:13.072651 n-d-863055-2 devstack@keystone.service[82161]: [parameters: {'id': '21a01a161b514f199135d7e7bea09e84', 'name': 'tempest-domain-dup-1248783599', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:48:13.072651 n-d-863055-2 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:48:13.107404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3378/6772] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/users => generated 345 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:13.111481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1248783599.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1248783599. Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:13.136170 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1248783599' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 14:48:13.137295 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 31 14:48:13.138425 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:48:13.139582 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:48:13.140662 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:13.141622 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1248783599' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '21a01a161b514f199135d7e7bea09e84', 'name': 'tempest-domain-dup-1248783599', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.144994 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1248783599. Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:13.148368 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1248783599. Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:13.151727 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3395/6773] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/domains => generated 212 bytes in 442 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:13.156796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.160333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bc1d1-fc1b-4c2f-b26c-77f05b07d1ad tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.177146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f56b9e-a260-4178-9256-ad76978361c5 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.181741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.182542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.182861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.183137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.184519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.189268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.207422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.211131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.211411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.211685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/1c760f14a98b43c8b8266fdbb5136421` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.263021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1c760f14a98b43c8b8266fdbb5136421)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.264579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.326309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3379/6774] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:13 2022] POST /identity/v3/users => generated 324 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:13.331474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.334228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.335103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.355877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d9c5-e863-4cec-857c-5bf71e0aa2c5 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.446519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.447125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.447264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.449580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.450442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3396/6775] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:48:13 2022] PATCH /identity/v3/domains/1c760f14a98b43c8b8266fdbb5136421 => generated 254 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.451023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.452018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users/c9fa715bd5884c3f943bb80e0b2161eb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.455099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.458905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:13.486055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.492770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:get_user(user_id=c9fa715bd5884c3f943bb80e0b2161eb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.498067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.501387 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3380/6776] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/users/c9fa715bd5884c3f943bb80e0b2161eb => generated 345 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:13.506319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.508653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:13.526216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98b726-1ee5-4f72-9f53-da1a72a58d43 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.533890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.534677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.535066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.535618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.536847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Adding query filter params (domain_id=645963bb13064d33b5fd10416377c6e8) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.537260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.540155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.573606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3381/6777] 10.222.0.13 () {58 vars in 1207 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/users?domain_id=645963bb13064d33b5fd10416377c6e8 => generated 482 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.573606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.581441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98367eb-326d-4abd-90b8-44e81cae40c6 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.592619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f9c1-8132-4451-a74f-89b0304d6e89 tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.602543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.603397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.603499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.603764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/1c760f14a98b43c8b8266fdbb5136421` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.612719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.617629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.620506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.621000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.621945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.627730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.634690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1c760f14a98b43c8b8266fdbb5136421)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.634690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.692000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.696831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.727176 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3382/6778] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/users => generated 8286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:13.733481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.753919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb8a7e-34d7-42f6-923f-dd9248b7647e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.776148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.777057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.777291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.778487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.779091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Adding query filter params (name=tempest-test_user-3013052) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.779598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.781622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.870010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3383/6779] 10.222.0.13 () {58 vars in 1183 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/users?name=tempest-test_user-3013052 => generated 470 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.871134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.873990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.898298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33ef72-1f6a-40eb-bcc9-c218d225aa2d tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.972279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:13.992374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.011696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] The token cache is being invalidate because project 1c760f14a98b43c8b8266fdbb5136421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:14.011696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.013170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.023175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.023903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.025055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1c760f14a98b43c8b8266fdbb5136421', 'request_id': 'req-048b25fd-bcfa-4b9e-b398-409227ccfc5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.036024 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3397/6780] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:13 2022] DELETE /identity/v3/domains/1c760f14a98b43c8b8266fdbb5136421 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:14.040472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.043109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:14.055106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.055869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.056198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.056556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.062730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:14.062730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.064330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.108790 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3384/6781] 10.222.0.13 () {58 vars in 1149 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:14.113721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.115705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:14.139385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63428774-c827-4ac5-8ebf-1dc1dee849be tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.154557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.156046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.157216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.158592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users/178766db99634815b1216d018475e172` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.170869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b25fd-bcfa-4b9e-b398-409227ccfc5b tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.184238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99c05b4582645f6a091d183bc17a660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd45630195c04e20b9b2bdd817795b85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.185972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.187082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.188164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] PATH_INFO: `/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.189170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=178766db99634815b1216d018475e172)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.194801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.206377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Could not find domain: ea6190bccbc24366bd9f716f1e7e3c81.: keystone.exception.DomainNotFound: Could not find domain: ea6190bccbc24366bd9f716f1e7e3c81. Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ea6190bccbc24366bd9f716f1e7e3c81. Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:14.219348 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:14.220441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:14.221430 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ea6190bccbc24366bd9f716f1e7e3c81. Oct 31 14:48:14.222441 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 14:48:14.222441 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3398/6782] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:48:14 2022] PATCH /identity/v3/domains/ea6190bccbc24366bd9f716f1e7e3c81 => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 14:48:14.224767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.229664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:14.267836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:14.328676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762694d0-65c1-42e0-9034-d93a37a3916a tempest-DomainsNegativeTestJSON-1910202345 tempest-DomainsNegativeTestJSON-1910202345-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.334161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.334984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.335269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.335545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] PATH_INFO: `/v3/users/d195924f523c43268787721e3caee2a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.336833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d195924f523c43268787721e3caee2a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.338853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.413795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178766db99634815b1216d018475e172'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.416413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178766db99634815b1216d018475e172'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.511737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178766db99634815b1216d018475e172'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.535711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178766db99634815b1216d018475e172'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.536632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178766db99634815b1216d018475e172'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.564017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3385/6783] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:14 2022] DELETE /identity/v3/users/178766db99634815b1216d018475e172 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:14.565174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.569809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:14.596859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd195924f523c43268787721e3caee2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.599033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd195924f523c43268787721e3caee2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.708641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd195924f523c43268787721e3caee2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.727397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aa9e0-87a2-49c1-91bc-e3845b7109aa tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.734510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd195924f523c43268787721e3caee2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.735783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43dd21df-a0e1-46d9-9036-c20f43dd1482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd195924f523c43268787721e3caee2a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.743394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.746261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.747497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.748188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/users/c9fa715bd5884c3f943bb80e0b2161eb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.751009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa715bd5884c3f943bb80e0b2161eb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.754242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.793654 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3399/6784] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:14 2022] DELETE /identity/v3/users/d195924f523c43268787721e3caee2a4 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:14.795270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.796901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.797894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.837643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:14.839024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:14.931048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa715bd5884c3f943bb80e0b2161eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.932150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa715bd5884c3f943bb80e0b2161eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:14.968526 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3400/6785] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:14.991478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.993208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:15.021433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa715bd5884c3f943bb80e0b2161eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.049671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa715bd5884c3f943bb80e0b2161eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.050178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:15.054706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa715bd5884c3f943bb80e0b2161eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.093819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3386/6786] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:14 2022] DELETE /identity/v3/users/c9fa715bd5884c3f943bb80e0b2161eb => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:15.102796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.104314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:15.160241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd954d-d247-4a16-8070-181a123c5257 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.286950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4af74f-661f-4cd8-b861-bad03edf104e tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.307519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.308326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.308686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.309118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/domains/645963bb13064d33b5fd10416377c6e8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.313330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=645963bb13064d33b5fd10416377c6e8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.315343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.376250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.376526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.376947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.377302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.408755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.409548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.502487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.504623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.524821 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3401/6787] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:48:15.545381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.547577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.558402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3387/6788] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:48:15 2022] PATCH /identity/v3/domains/645963bb13064d33b5fd10416377c6e8 => generated 278 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:15.560483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.584811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382baf4-37d5-44f0-8d30-e3d52763ee7b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.738760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1abb5ac227948b0bf9257d4b425a738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3f291aab56f4c7dafa132de345d2164', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.739463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.739747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.740082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] PATH_INFO: `/v3/domains/645963bb13064d33b5fd10416377c6e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.780960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=645963bb13064d33b5fd10416377c6e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.782848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.868536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:15.883301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '645963bb13064d33b5fd10416377c6e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.085352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.085570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.085570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:16.205148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.225018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.232490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.293491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] The token cache is being invalidate because project 645963bb13064d33b5fd10416377c6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:16.293491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.297227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.342855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21080b-03c6-4026-a4d9-e7ee03792315 tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.364617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.366201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.370794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '645963bb13064d33b5fd10416377c6e8', 'request_id': 'req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:16.392194 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3402/6789] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:15 2022] DELETE /identity/v3/domains/645963bb13064d33b5fd10416377c6e8 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:16.400190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.400190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.400190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:16.544393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.545221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.545507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.546198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.555562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:16.590009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.593525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.623188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3388/6790] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:16.659673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5b3c-8fec-424d-bde5-9ecac6bc332c tempest-UsersV3TestJSON-1123363709 tempest-UsersV3TestJSON-1123363709-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.669579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.670331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.670741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.671122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] PATH_INFO: `/v3/users/ff4de69341c946e8a80ac35955f2283a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.674260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4de69341c946e8a80ac35955f2283a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.676411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.105057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4de69341c946e8a80ac35955f2283a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.106198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4de69341c946e8a80ac35955f2283a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.195445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4de69341c946e8a80ac35955f2283a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.217531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4de69341c946e8a80ac35955f2283a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.223159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7daa1fa5-76a3-4ca6-aeb9-acbb96d524aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4de69341c946e8a80ac35955f2283a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.237908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.240103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:17.261157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c83caa-fd17-484c-825f-b47c42776c8a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.267739 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3403/6791] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:16 2022] DELETE /identity/v3/users/ff4de69341c946e8a80ac35955f2283a => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:17.268381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.269520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.270229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.270815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] PATH_INFO: `/v3/projects/94a0895413fd4bd4b6eef840354b7c03` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.275031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.275326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.275606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.282686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a0895413fd4bd4b6eef840354b7c03)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.285339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.356736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:17.361087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:17.503687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a0895413fd4bd4b6eef840354b7c03', 'request_id': 'req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.633771 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3404/6792] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:17.640089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a0895413fd4bd4b6eef840354b7c03', 'request_id': 'req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.663088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a0895413fd4bd4b6eef840354b7c03', 'request_id': 'req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.686558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.688637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:17.701534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] The token cache is being invalidate because project 94a0895413fd4bd4b6eef840354b7c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:17.702124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.705568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:17.716115 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3389/6793] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:17 2022] DELETE /identity/v3/projects/94a0895413fd4bd4b6eef840354b7c03 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:17.721599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.723280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:17.770427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.854200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34917720-6963-449a-bfab-131cb3cf41e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.940602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.955255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649cf0b-6958-4ee0-bb72-3128a4fdedc3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.970546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.976235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.976644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.977334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] PATH_INFO: `/v3/users/c99c05b4582645f6a091d183bc17a660` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.982015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99c05b4582645f6a091d183bc17a660)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.987397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.988659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.989475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.989916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.990372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.997742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:18.033790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.035742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.061030 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3405/6794] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:18.351839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99c05b4582645f6a091d183bc17a660'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:18.352639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99c05b4582645f6a091d183bc17a660'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:18.519041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99c05b4582645f6a091d183bc17a660'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:18.548091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99c05b4582645f6a091d183bc17a660'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:18.549100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99c05b4582645f6a091d183bc17a660'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:18.573562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3390/6795] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:17 2022] DELETE /identity/v3/users/c99c05b4582645f6a091d183bc17a660 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:19.358244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:19.359939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:19.383684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf76d-5881-424f-aa62-613d0e4165b4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:19.617507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:19.619482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.619905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.620329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] PATH_INFO: `/v3/projects/d05a33fa6a0f47eaa87e869a05441bdb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.623366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05a33fa6a0f47eaa87e869a05441bdb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:19.625660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:19.925001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05a33fa6a0f47eaa87e869a05441bdb', 'request_id': 'req-b13973bf-35dd-4a73-b835-749d972ed179'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.027937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05a33fa6a0f47eaa87e869a05441bdb', 'request_id': 'req-b13973bf-35dd-4a73-b835-749d972ed179'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.035927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05a33fa6a0f47eaa87e869a05441bdb', 'request_id': 'req-b13973bf-35dd-4a73-b835-749d972ed179'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.062590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] The token cache is being invalidate because project d05a33fa6a0f47eaa87e869a05441bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:20.068176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.070806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.078543 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3406/6796] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:19 2022] DELETE /identity/v3/projects/d05a33fa6a0f47eaa87e869a05441bdb => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:20.081572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.084426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:20.099904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80ca4-c987-4071-84e3-87d80f794caf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.187469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.242223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.243266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.243657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.244046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] PATH_INFO: `/v3/users/c1abb5ac227948b0bf9257d4b425a738` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.254880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1abb5ac227948b0bf9257d4b425a738)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.254880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.403852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.577255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1abb5ac227948b0bf9257d4b425a738'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.578099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1abb5ac227948b0bf9257d4b425a738'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.674930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1abb5ac227948b0bf9257d4b425a738'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.698991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1abb5ac227948b0bf9257d4b425a738'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.699823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6f8dc232-550c-4568-b5dd-bb9e2ea64a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1abb5ac227948b0bf9257d4b425a738'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:20.778469 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3391/6797] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:20 2022] DELETE /identity/v3/users/c1abb5ac227948b0bf9257d4b425a738 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:21.252873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.254355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:21.289753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13973bf-35dd-4a73-b835-749d972ed179 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.532529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.533342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.533788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.534200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] PATH_INFO: `/v3/projects/dd45630195c04e20b9b2bdd817795b85` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.538991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd45630195c04e20b9b2bdd817795b85)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.540918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.757715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd45630195c04e20b9b2bdd817795b85', 'request_id': 'req-a000ba07-1ff0-4fa3-8d50-70d84d56b849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:21.856517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd45630195c04e20b9b2bdd817795b85', 'request_id': 'req-a000ba07-1ff0-4fa3-8d50-70d84d56b849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:21.864667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd45630195c04e20b9b2bdd817795b85', 'request_id': 'req-a000ba07-1ff0-4fa3-8d50-70d84d56b849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:21.884825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] The token cache is being invalidate because project dd45630195c04e20b9b2bdd817795b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:21.889512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:21.889512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a000ba07-1ff0-4fa3-8d50-70d84d56b849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:21.892372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3407/6798] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:21 2022] DELETE /identity/v3/projects/dd45630195c04e20b9b2bdd817795b85 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:21.897518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.898018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.898383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.938717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:21.940657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.004778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.120775 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3392/6799] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:22.128707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7af97-4b47-4eaa-9a2c-444bd8cab73b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.129357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7af97-4b47-4eaa-9a2c-444bd8cab73b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.129739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7af97-4b47-4eaa-9a2c-444bd8cab73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.173231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-30b7af97-4b47-4eaa-9a2c-444bd8cab73b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:22.180217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30b7af97-4b47-4eaa-9a2c-444bd8cab73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.200593 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3408/6800] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:22.204449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.221169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654789a8-c34a-4c62-b57d-5a56e6485e49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.229502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.231940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.231940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.231940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.232546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:22.234116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.236542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.256877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.256877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.256877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.302479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3393/6801] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:22.318372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.339182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] MFA Rules not processed for user `27fe59c95f6a45e1ad98d3a85dfe46f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:22.341437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.349530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47e9b5-2c5f-46f5-b6e8-f03030e1227d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.370959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.372377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.372377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.372634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.378084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.378084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.438311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.524935 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3394/6802] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:22.529159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.548793 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3409/6803] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:22.551212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.554007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.586115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e092c3-6334-49a6-a217-63753987dcb3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.734329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.736155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586988b6-15cd-45df-86f6-06002cd17a70 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.776906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.777687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.778061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.778429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.778867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.779375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.780556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.781170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.781816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.782804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.785016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.787440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.892380 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3395/6804] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:22.893556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.910809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.920180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3410/6805] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/projects => generated 373 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:22.921217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.940373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cf9b-51f7-437d-badd-ad022e627013 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.115740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.116433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.116712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.119625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] PATH_INFO: `/v3/projects/e3f291aab56f4c7dafa132de345d2164` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.125476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f291aab56f4c7dafa132de345d2164)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.127623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.291130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a7688-2cfe-4c08-8b7c-687a75dc5835 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.297363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.298175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.310529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.310529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.310529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.310529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.360346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3411/6806] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:23.360346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:23.377330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109b14-92d3-419d-ab71-51217963c242 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.382396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f291aab56f4c7dafa132de345d2164', 'request_id': 'req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:23.463311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.464310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.464693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.465201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.465817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f291aab56f4c7dafa132de345d2164', 'request_id': 'req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:23.466300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.469265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.475315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f291aab56f4c7dafa132de345d2164', 'request_id': 'req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:23.525033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] The token cache is being invalidate because project e3f291aab56f4c7dafa132de345d2164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:23.525334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:23.530536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:23.535450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3396/6807] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:22 2022] DELETE /identity/v3/projects/e3f291aab56f4c7dafa132de345d2164 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:23.536228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:23.545544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:23.573623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1953ea-68cf-44ba-a62f-adb1ce6c9025 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.584010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.584642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.586752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.587066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.587748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.589378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b3377-c5ec-4e8b-8aa9-3629972ec09e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.619513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3397/6808] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:23.620827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.621166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.621441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.624320 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3412/6809] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:23 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:23.625837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:23.637961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5e350-7c35-4afe-9e6d-2a84112e9b79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.646488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.647434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.647773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.649740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] PATH_INFO: `/v3/projects/de3a9e5ce712449c9df3d4c989110163/users/e170e392d8ac4fb38ede787ce3a11c71/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.679197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:23.680922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3a9e5ce712449c9df3d4c989110163, user_id=e170e392d8ac4fb38ede787ce3a11c71, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.682212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:23.688379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.701594 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3398/6810] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:23.702929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:23.708527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:23.739263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54dcb0-dbec-4f79-a7fd-98db3d81b3bb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:23.753312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:23.754121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.761963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.761963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.761963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:23.763789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165bb71-1075-4fad-bd56-aa911ec584e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:23.796809 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3399/6811] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:23.799501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f5d-fb4f-46d5-89b1-3292ce38fd54 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:23.801568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f5d-fb4f-46d5-89b1-3292ce38fd54 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:23.802735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f5d-fb4f-46d5-89b1-3292ce38fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:23.858981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5aaf7f5d-fb4f-46d5-89b1-3292ce38fd54 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:23.877041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3413/6812] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:23 2022] PUT /identity/v3/projects/de3a9e5ce712449c9df3d4c989110163/users/e170e392d8ac4fb38ede787ce3a11c71/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:23.877041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:23.885163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5aaf7f5d-fb4f-46d5-89b1-3292ce38fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:23.999297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfdd6-dc03-4f73-9bc0-94a8974f92ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.008320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.008995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.009275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.009543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] PATH_INFO: `/v3/projects/c4485bbeab8d4c8f87263e03ca641e65/users/1aa5b0358e0b4207bcabd9bccb5701e1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.033862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3400/6813] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:24.035577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4485bbeab8d4c8f87263e03ca641e65, user_id=1aa5b0358e0b4207bcabd9bccb5701e1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.038071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.038352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.038750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.055972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.106287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] MFA Rules not processed for user `e170e392d8ac4fb38ede787ce3a11c71`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:24.107977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:24.174308 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3414/6814] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:23 2022] PUT /identity/v3/projects/c4485bbeab8d4c8f87263e03ca641e65/users/1aa5b0358e0b4207bcabd9bccb5701e1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:24.180517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.292588 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3401/6815] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:24.292588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.312869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d254a-5ef7-48a1-ae17-3d705d72bd45 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.392767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c6685-786e-44ab-8b6c-c4e944c7a629 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.413664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.414303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.414584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.414887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.416112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:24.416112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.428896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.454987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3415/6816] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:24.456008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.481386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c1b0-d70d-4974-9681-68bd399c2ec1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.495174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.495987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.496647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.496956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.497719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.499598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.627821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.628966 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3416/6817] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:24.628966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.665247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.665877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.666155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.666433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.668809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.670798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.693587 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3402/6818] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:24.694322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.715761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8be59-8925-4fe6-935d-0a267387a000 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.757686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540d2e4-fa49-4e15-abc6-038fe8f9bf46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.772614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.773255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.773539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.773815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.774602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.776564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.824972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.825590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.825874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.826150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.826897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.828891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.906571 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3417/6819] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:24.907570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.914214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.927919 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3403/6820] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:24.929308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.973586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c57de-181c-4549-9c4c-67567b52a25d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.142235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f31e-22b4-4c57-bb6d-7c7969bac715 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.156836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.158124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.158816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.159294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] PATH_INFO: `/v3/projects/c4485bbeab8d4c8f87263e03ca641e65/users/1aa5b0358e0b4207bcabd9bccb5701e1/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.161594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4485bbeab8d4c8f87263e03ca641e65, user_id=1aa5b0358e0b4207bcabd9bccb5701e1, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.164640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.182547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.183147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.183147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.183429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.188338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.193522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.196156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3418/6821] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:24 2022] PUT /identity/v3/projects/c4485bbeab8d4c8f87263e03ca641e65/users/1aa5b0358e0b4207bcabd9bccb5701e1/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:25.204585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.309039 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3404/6822] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/users => generated 285 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:25.313668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.350061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be0dd5-eb2a-4681-b070-d9e2ac211289 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.369898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f921fe8-ac99-4afe-babe-d54a103e3974 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.382340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.382340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.382340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.386690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.390792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.391995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.393628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.396270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.396865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.397996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.400503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.408037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.413400 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3419/6823] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:25.419377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.438824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9184479-5192-4585-9b78-58a1e502e8ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.445724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3405/6824] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:25.451030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.457535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.459326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.460501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.461237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] PATH_INFO: `/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81/users/2e1783987227452c9104e338e0ef25e5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.479267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67b0fd-b283-4cd0-8c5f-0d77919758e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.485074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd62a20140ca49ee9f957b9ffaf07a81, user_id=2e1783987227452c9104e338e0ef25e5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.489413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.499947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.499947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.499947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.499947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.500411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.519897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.585108 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3406/6825] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:25.589628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.620831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3420/6826] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:25 2022] PUT /identity/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81/users/2e1783987227452c9104e338e0ef25e5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:25.624501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453feff-eea1-4e55-a9f5-723cc137ea39 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.625067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.813708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bacd-9673-4356-be0a-e40eae5ab25f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.822098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.830285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.831127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.833005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] PATH_INFO: `/v3/projects/71e40512d5f040d1ae094074b55b63e0/users/3d6a9fcf45d64939a778d4524eba04d1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.837743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.837743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.837743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.838218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.838916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.842072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.862109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e40512d5f040d1ae094074b55b63e0, user_id=3d6a9fcf45d64939a778d4524eba04d1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.865713 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3421/6827] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:25.868203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd0172-7a1c-4575-97b3-f4c6d5f50f34 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.875433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.884146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f034572-35ef-4fb9-8017-f276259735e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.890270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.890907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.891182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.891457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] PATH_INFO: `/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81/users/2e1783987227452c9104e338e0ef25e5/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.893581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd62a20140ca49ee9f957b9ffaf07a81, user_id=2e1783987227452c9104e338e0ef25e5, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.900388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8af5-a1fa-4087-ac8a-2b32099ce031 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.911314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3422/6828] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:25 2022] PUT /identity/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81/users/2e1783987227452c9104e338e0ef25e5/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:25.923906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.924274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.924534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.005495 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3407/6829] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:25 2022] PUT /identity/v3/projects/71e40512d5f040d1ae094074b55b63e0/users/3d6a9fcf45d64939a778d4524eba04d1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:26.011754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.012809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.013302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.117712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] MFA Rules not processed for user `2e1783987227452c9104e338e0ef25e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:26.137434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:26.178649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] MFA Rules not processed for user `3d6a9fcf45d64939a778d4524eba04d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:26.191233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:26.323651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3423/6830] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:26.331933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.364175 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3408/6831] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:26.368536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.375828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1faf-e082-490f-aa98-f6d6729cc518 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.399592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.400831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.401271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.406609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.407935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.414669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.554264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0c65-dcf4-452b-a1cf-3c6852bc07a1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.572075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.572823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.573934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.580696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.581582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.583924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.623597 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3424/6832] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 14:48:26 2022] POST /identity/v3/domains => generated 277 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:26.632446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.725857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3409/6833] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:26 2022] POST /identity/v3/projects => generated 369 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:26.730065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.736386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.786139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048840-dfc1-4f27-9ba2-ffadd7051215 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.890911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.891700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.892099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.892511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.893400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.895440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.913292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ef2c-2cea-48f0-826f-9805ee3ee2a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.931786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.932664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.933035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.933572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.934282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.937974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.005946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:27.058585 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3425/6834] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:26 2022] POST /identity/v3/projects => generated 402 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:27.063371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3410/6835] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:26 2022] POST /identity/v3/users => generated 291 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:27.067229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.067627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.084492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5326d-f475-41ce-bd91-f9f4fa357989 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.253320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.254687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.254924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.255243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.259430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.266036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.287400 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3411/6836] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:48:27.296395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.316326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9078-b895-447c-8438-0c2e66f8f9c6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.328690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db61c4-80db-4f0b-9f26-1d70c4b8c895 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.333694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.334326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.334678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.334959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.335593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.337514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.343700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.344633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.345214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.345466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] PATH_INFO: `/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8/users/889df4ee75af45359afec40f353fd3e7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.403205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c041ee3efbce432e9e50cc0d44d7b9f8, user_id=889df4ee75af45359afec40f353fd3e7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.410176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.838576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3426/6837] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Oct 31 14:48:27 2022] POST /identity/v3/groups => generated 302 bytes in 767 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:27.838787 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3412/6838] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:27 2022] PUT /identity/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8/users/889df4ee75af45359afec40f353fd3e7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:27.838915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.839019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.852185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a28c02-7370-4dcb-8132-3ac098975aa7 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.971934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.972595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.972815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.973400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.974236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.976405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.978414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4fb94-4711-4ecf-a5ef-0c3efc72401b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.991900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.992930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.993625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.993912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.994821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.004550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.017124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3413/6839] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:28.022607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.036185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9b9ad-7c4a-4c5f-86d4-8d8308ab1e5f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.041523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.042361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.043720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.044233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] PATH_INFO: `/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8/users/889df4ee75af45359afec40f353fd3e7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.046993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c041ee3efbce432e9e50cc0d44d7b9f8, user_id=889df4ee75af45359afec40f353fd3e7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.051304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8391-b823-4cb0-87c1-7d7c9b175b02 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.118083 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3427/6840] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:27 2022] POST /identity/v3/users => generated 445 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:28.124300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.130794 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3414/6841] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:28 2022] PUT /identity/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8/users/889df4ee75af45359afec40f353fd3e7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:28.145877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791508-125a-48cf-8821-494741d64861 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.145877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791508-125a-48cf-8821-494741d64861 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.148009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791508-125a-48cf-8821-494741d64861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.156208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bb375-bbae-454b-b582-0b35e463b32a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.264693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-67791508-125a-48cf-8821-494741d64861 None None] MFA Rules not processed for user `889df4ee75af45359afec40f353fd3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:28.264693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67791508-125a-48cf-8821-494741d64861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:28.337757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.345018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.345018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.345018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.345018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.345018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.429669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3415/6842] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:28.434691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791508-125a-48cf-8821-494741d64861 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.451790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791508-125a-48cf-8821-494741d64861 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.463915 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3428/6843] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/roles => generated 239 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:28.467997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.468356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.468480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.469228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.469861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.471275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.475819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.503637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e14b-6679-4e6f-8ba2-559949bbe77d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.519058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.519860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.520139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.520515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.541015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=3619c17c6b60423b844fabb3c2d7180b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.544354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.669269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3429/6844] 10.222.0.13 () {60 vars in 1585 bytes} [Mon Oct 31 14:48:28 2022] PUT /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:28.670132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.701943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3416/6845] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/projects => generated 357 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:28.703398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.771025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497dd8-d888-4657-9079-7da293926f6a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.893255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7209c0-2394-4803-a4de-b3aa9fecedab tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.905160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.905898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.906195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.906470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.907321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.907717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.910079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.911038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.911431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.911832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.915221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=3619c17c6b60423b844fabb3c2d7180b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.918735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.927208 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3430/6846] 10.222.0.13 () {58 vars in 1567 bytes} [Mon Oct 31 14:48:28 2022] HEAD /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:28.931130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.954343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327631-2c4e-42c3-9a15-65c0a1d93b8d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.967519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.968374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.968849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.969282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.972225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=3619c17c6b60423b844fabb3c2d7180b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.975735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.022518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 3619c17c6b60423b844fabb3c2d7180b was removed from group be88a0fc79b848a0924ace59b4248fce on project f0b6aeebeee541ccb36f8e1bd7746785. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:29.023170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:29.024912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:29.120739 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3417/6847] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/users => generated 373 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:29.122684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.124757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.147496 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3431/6848] 10.222.0.13 () {58 vars in 1569 bytes} [Mon Oct 31 14:48:28 2022] DELETE /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/groups/be88a0fc79b848a0924ace59b4248fce/roles/3619c17c6b60423b844fabb3c2d7180b/inherited_to_projects => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:29.148380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e42c0-3916-44b4-be62-00ce62416ff3 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.158885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.161169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.308493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.309149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.309448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.309703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.310413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:29.310762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.312841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db96c0-2a8f-473e-a2a5-8ebbd3c66708 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.326408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8b86b-1b28-4938-9371-8e3b219277c9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.350292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.350292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.350292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.354134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/3619c17c6b60423b844fabb3c2d7180b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.354134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3619c17c6b60423b844fabb3c2d7180b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.354428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.386166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3418/6849] 10.222.0.13 () {58 vars in 1157 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/users?domain_id=default => generated 7992 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:29.386166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.386166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.386166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.470982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:29.473056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.496586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 3619c17c6b60423b844fabb3c2d7180b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:29.501174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:29.501174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:29.506319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3432/6850] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:29 2022] DELETE /identity/v3/roles/3619c17c6b60423b844fabb3c2d7180b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:29.507488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.513537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.561627 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3419/6851] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:29.562545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.566024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.584709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41664fd-2e60-4d51-9471-0b905f26469b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.660365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.664607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6673a90-a31c-4064-9b3e-c0b20d91366d tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.672352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.673355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.677373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.677704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/users/bf677ddd39d74dd2ab22590e7ab90643` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.688647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.689800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.690298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.690904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.691830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.693943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.712796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:update_user(user_id=bf677ddd39d74dd2ab22590e7ab90643)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.720118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.768881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.837116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3420/6852] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:29 2022] POST /identity/v3/roles => generated 239 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:29.837116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.838690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.872083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:29.977158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14bec-e293-4b60-a582-48e97d02ba91 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.982999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.984298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.984298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.984668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.999158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invalidating the token cache because user bf677ddd39d74dd2ab22590e7ab90643 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:29.999725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.003582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.007178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3433/6853] 10.222.0.13 () {60 vars in 1244 bytes} [Mon Oct 31 14:48:29 2022] PATCH /identity/v3/users/bf677ddd39d74dd2ab22590e7ab90643 => generated 488 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:30.007178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.007178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:30.044001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba64c-f48e-4dbb-89e1-77bd91827295 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.049416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.050464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.050922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.051304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.068576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.069624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=f89da07c47df442a91e29f374f37927d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.073445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.075268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b211d-50f0-4948-973a-01db1cb4db55 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.091885 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3421/6854] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:48:30.093238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.093582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.094878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.162204 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.auth.plugins.core [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] User is disabled: bf677ddd39d74dd2ab22590e7ab90643: AssertionError: User is disabled: bf677ddd39d74dd2ab22590e7ab90643 Oct 31 14:48:30.165427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3434/6855] 10.222.0.13 () {60 vars in 1582 bytes} [Mon Oct 31 14:48:30 2022] PUT /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:30.172716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.184777 n-d-863055-2 devstack@keystone.service[82163]: WARNING keystone.server.flask.application [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 31 14:48:30.190640 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3422/6856] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:30 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 94 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 31 14:48:30.192354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.196219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:30.340738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072a4e0-21d1-43c6-8940-e729bc05e0b3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.352456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.354300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.356308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.356595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.361797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=f89da07c47df442a91e29f374f37927d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.374586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.393486 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3435/6857] 10.222.0.13 () {58 vars in 1564 bytes} [Mon Oct 31 14:48:30 2022] HEAD /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:30.397722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.425361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5a5f-b377-49b4-a171-d48667f3ff59 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.440127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.442414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.442752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.443007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.449073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=f89da07c47df442a91e29f374f37927d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.459744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.476156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role f89da07c47df442a91e29f374f37927d was removed from user 01c9fa184fd642629ea01e568434ecbd on project f0b6aeebeee541ccb36f8e1bd7746785. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:30.514450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.514450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.516157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00af1de-97f3-4aa7-b6dc-5f3fc5a71cdc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.516157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.516157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.517003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.517003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/users/bf677ddd39d74dd2ab22590e7ab90643` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.556035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bf677ddd39d74dd2ab22590e7ab90643)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.561408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.706677 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3436/6858] 10.222.0.13 () {58 vars in 1566 bytes} [Mon Oct 31 14:48:30 2022] DELETE /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/f89da07c47df442a91e29f374f37927d/inherited_to_projects => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:30.713606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.718933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:30.823672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.826534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.936997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.966082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132a083-2e02-44c8-acb7-1e379397faa9 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.989554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:30.994217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf677ddd39d74dd2ab22590e7ab90643'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:31.002820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.004731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.008100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.010561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/f89da07c47df442a91e29f374f37927d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.014222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f89da07c47df442a91e29f374f37927d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.025153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.047381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3423/6859] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:30 2022] DELETE /identity/v3/users/bf677ddd39d74dd2ab22590e7ab90643 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:31.051731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.062589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:31.252805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role f89da07c47df442a91e29f374f37927d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:31.252805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:31.256563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:31.265756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3437/6860] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:30 2022] DELETE /identity/v3/roles/f89da07c47df442a91e29f374f37927d => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:31.266765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.272650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:31.279475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:31.389791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b1ce7-4f2c-49e0-86d4-393ec1d590ea tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.529575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa0cd-9c2f-426a-9a16-2aba73282545 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.564937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.569680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.571849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.573416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.581531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.587021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.617443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.619234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.619519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.625960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/projects/789c8a9ed21f4a929e20d5a607d4e696` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.627773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:delete_project(project_id=789c8a9ed21f4a929e20d5a607d4e696)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.630456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.734459 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3438/6861] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:31 2022] POST /identity/v3/roles => generated 240 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:31.739781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.759697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396c245-f937-4332-a4e1-e8ef03813707 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.773191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.774899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.775163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.775515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.785752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=16023ac6bc364afa954c26257d5da90d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.812839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.016340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789c8a9ed21f4a929e20d5a607d4e696', 'request_id': 'req-72259c35-3a76-4aa3-a01e-c50b310afc23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.053070 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3439/6862] 10.222.0.13 () {60 vars in 1582 bytes} [Mon Oct 31 14:48:31 2022] PUT /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:32.056473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.198748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789c8a9ed21f4a929e20d5a607d4e696', 'request_id': 'req-72259c35-3a76-4aa3-a01e-c50b310afc23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.208929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789c8a9ed21f4a929e20d5a607d4e696', 'request_id': 'req-72259c35-3a76-4aa3-a01e-c50b310afc23'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.240046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] The token cache is being invalidate because project 789c8a9ed21f4a929e20d5a607d4e696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:32.240343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.241022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.254405 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3424/6863] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:31 2022] DELETE /identity/v3/projects/789c8a9ed21f4a929e20d5a607d4e696 => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:32.256827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.263967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.351020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe5aa-abd4-4ee4-bc39-980203a0baaf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.357400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.358097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.358384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.358764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.361367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, group_id=be88a0fc79b848a0924ace59b4248fce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.364423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.367276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:32.409401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3440/6864] 10.222.0.13 () {58 vars in 1464 bytes} [Mon Oct 31 14:48:32 2022] GET /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/inherited_to_projects => generated 448 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:32.410937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.415305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.455577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253f8b-748c-4fcc-8a2b-452f172e134e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.473906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.474610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.477234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.477547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.484066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=16023ac6bc364afa954c26257d5da90d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.491400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.513789 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3441/6865] 10.222.0.13 () {58 vars in 1564 bytes} [Mon Oct 31 14:48:32 2022] HEAD /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:32.513999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259c35-3a76-4aa3-a01e-c50b310afc23 tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.521341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.549263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097fb16-b7cd-4dcd-b05a-1d8dcf03f56b tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.572141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.572855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.573179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.573457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.581614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, group_id=be88a0fc79b848a0924ace59b4248fce, role_id=16023ac6bc364afa954c26257d5da90d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.593968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.618060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 16023ac6bc364afa954c26257d5da90d was removed from group be88a0fc79b848a0924ace59b4248fce on domain 3cdfe2b5a72b4355b24d2e1bd260602f. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:32.618366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.620503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:32.783690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3442/6866] 10.222.0.13 () {58 vars in 1566 bytes} [Mon Oct 31 14:48:32 2022] DELETE /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/groups/be88a0fc79b848a0924ace59b4248fce/roles/16023ac6bc364afa954c26257d5da90d/inherited_to_projects => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:32.790002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.792947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.814041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889df4ee75af45359afec40f353fd3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.815263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.816572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.816940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.819381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.824407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Could not find domain: f69fabd2f0b045768edcebb6cf304a92.: keystone.exception.DomainNotFound: Could not find domain: f69fabd2f0b045768edcebb6cf304a92. Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f69fabd2f0b045768edcebb6cf304a92. Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:32.857449 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 31 14:48:32.867488 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:32.869016 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f69fabd2f0b045768edcebb6cf304a92. Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3425/6867] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:32 2022] POST /identity/v3/users => generated 112 bytes in 608 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.873192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.973471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226f2c-cb9f-48b1-82d7-79e654852331 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.012645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.017276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.019737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.020041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/16023ac6bc364afa954c26257d5da90d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.023752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=16023ac6bc364afa954c26257d5da90d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.025331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.074897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fb840-fc09-4a60-89b5-55e71b9d82dc tempest-UsersNegativeTest-844436616 tempest-UsersNegativeTest-844436616-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.100649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:33.219775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.220431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.220712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.221626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] PATH_INFO: `/v3/users/3d6a9fcf45d64939a778d4524eba04d1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.223111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6a9fcf45d64939a778d4524eba04d1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.225054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.300504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 16023ac6bc364afa954c26257d5da90d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:33.301467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.302521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.316449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3443/6868] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:32 2022] DELETE /identity/v3/roles/16023ac6bc364afa954c26257d5da90d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:33.318110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:33.325928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:33.550093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e1bcf-85a3-4f6f-89f5-200099712fbf tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.569052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.571779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.571779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.571779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.571779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.574125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.606270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6a9fcf45d64939a778d4524eba04d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.607446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6a9fcf45d64939a778d4524eba04d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.690848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6a9fcf45d64939a778d4524eba04d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.723869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3444/6869] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:33 2022] POST /identity/v3/roles => generated 239 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:33.729593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:33.742712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:33.758105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6a9fcf45d64939a778d4524eba04d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.759044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e2f792f0-0114-462c-9de8-d0191715052a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6a9fcf45d64939a778d4524eba04d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:33.779343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2ba2-14c8-4c23-a868-d8a7aec81148 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.796909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.802440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.802440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.802440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.806426 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3426/6870] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:32 2022] DELETE /identity/v3/users/3d6a9fcf45d64939a778d4524eba04d1 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:33.806601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=7772743f51f342e7ab8186975f171f87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.809083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.809498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.809868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.810376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.845229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:33.847052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:33.933955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3445/6871] 10.222.0.13 () {60 vars in 1579 bytes} [Mon Oct 31 14:48:33 2022] PUT /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:33.954833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.055689 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3427/6872] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:34.107363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.109303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:34.120363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:34.198952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095496-da94-4264-8ae6-f3075952ba70 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.207067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.207859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.208247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.208642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.212237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.216524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.234718 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3446/6873] 10.222.0.13 () {58 vars in 1461 bytes} [Mon Oct 31 14:48:33 2022] GET /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/inherited_to_projects => generated 446 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:34.240916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.286237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737ce47-7f7c-46f3-9658-ccfe36ec60e8 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.303087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.305516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d57b3a-eee9-414b-a349-b2912ff80634 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.305868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.306380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.306820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.316253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=7772743f51f342e7ab8186975f171f87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.321982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.342688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3447/6874] 10.222.0.13 () {58 vars in 1561 bytes} [Mon Oct 31 14:48:34 2022] HEAD /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:34.346549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.359731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:34.366188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c11b-1509-4568-ab6c-b94505a91a8f tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.379426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.380337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.380721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.381623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.390326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=7772743f51f342e7ab8186975f171f87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.396766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.425995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 7772743f51f342e7ab8186975f171f87 was removed from user 01c9fa184fd642629ea01e568434ecbd on domain 3cdfe2b5a72b4355b24d2e1bd260602f. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:34.426289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:34.429910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:34.473009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.474832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.475276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.477955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.488401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:34.581635 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3448/6875] 10.222.0.13 () {58 vars in 1563 bytes} [Mon Oct 31 14:48:34 2022] DELETE /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/7772743f51f342e7ab8186975f171f87/inherited_to_projects => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:34.586106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.588554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:34.654079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.655632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.676629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3428/6876] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:34.764970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d0c0-34e0-4db4-82eb-b68d1acadaca tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.772062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.772852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.773266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.773656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/7772743f51f342e7ab8186975f171f87` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.775213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7772743f51f342e7ab8186975f171f87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.777418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.943130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:34.998646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 7772743f51f342e7ab8186975f171f87 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:35.006405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:35.007540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:35.010862 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3449/6877] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:34 2022] DELETE /identity/v3/roles/7772743f51f342e7ab8186975f171f87 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:35.016324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.030669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2edb5-6814-4f3d-b46c-b57c36fcbb26 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.167349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.168354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.168735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.169106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.170190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.176917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.306799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.308788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3429/6878] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:35 2022] POST /identity/v3/roles => generated 239 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:35.309799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:35.335496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2562f9-d537-46d4-98e0-77a74b89a9ad tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.348723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.349653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.351767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.352435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.353572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.359400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.493953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.502652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3450/6879] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:35 2022] POST /identity/v3/projects => generated 408 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:35.516465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352ef9-d2d4-4b48-8f5b-3629b88839b2 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.559349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.650652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.651851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.653177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.653646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/aad5c0bdba8540358b4addcdacf0e1ce/inherited_to_projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.657327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=aad5c0bdba8540358b4addcdacf0e1ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.664905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.824291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.838530 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3430/6880] 10.222.0.13 () {60 vars in 1579 bytes} [Mon Oct 31 14:48:35 2022] PUT /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/aad5c0bdba8540358b4addcdacf0e1ce/inherited_to_projects => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:35.845554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef629ee-9aea-422b-854b-da39ed0c99e4 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.046994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.047795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.048080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.048356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.049081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=f0b6aeebeee541ccb36f8e1bd7746785, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.049402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.051303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.209225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.212665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3451/6881] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/role_assignments?scope.project.id=f0b6aeebeee541ccb36f8e1bd7746785&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 648 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.213083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.242948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0997-d04e-45ef-be58-b6358dd2dea6 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.284382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.285084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.285501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.285869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.287417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=ee236da0599d437b85c940d9a3490865, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.288137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.296316 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:48:36.296316 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 14:48:36.296316 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 14:48:36.299274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.455037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.466744 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3431/6882] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/role_assignments?scope.project.id=ee236da0599d437b85c940d9a3490865&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 648 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.468618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.489569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a405e-cdf3-4ccc-b6bb-c8d81826b695 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.527991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.527991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.527991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.529542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/aad5c0bdba8540358b4addcdacf0e1ce/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.548084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=aad5c0bdba8540358b4addcdacf0e1ce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.562134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.598915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role aad5c0bdba8540358b4addcdacf0e1ce was removed from user 01c9fa184fd642629ea01e568434ecbd on domain 3cdfe2b5a72b4355b24d2e1bd260602f. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:36.603195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:36.609752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:36.731011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.735122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:36.782430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3452/6883] 10.222.0.13 () {58 vars in 1563 bytes} [Mon Oct 31 14:48:36 2022] DELETE /identity/v3/OS-INHERIT/domains/3cdfe2b5a72b4355b24d2e1bd260602f/users/01c9fa184fd642629ea01e568434ecbd/roles/aad5c0bdba8540358b4addcdacf0e1ce/inherited_to_projects => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:36.786352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.792575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:36.902201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2187-fd04-4d49-bec0-18a62addef04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.049305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.050450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.051334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.051785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] PATH_INFO: `/v3/projects/71e40512d5f040d1ae094074b55b63e0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.064592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e40512d5f040d1ae094074b55b63e0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.064824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae1e1-4b29-49bd-9cc5-13cb0334f8bc tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.064935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:37.066672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.068260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.068569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.068958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.069711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=f0b6aeebeee541ccb36f8e1bd7746785, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:37.071543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.077880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:37.206611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3453/6884] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/role_assignments?scope.project.id=f0b6aeebeee541ccb36f8e1bd7746785&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 228 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:37.207692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:37.228277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572431c-ec81-4705-8104-557ac26b2288 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.252578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e40512d5f040d1ae094074b55b63e0', 'request_id': 'req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:37.357839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e40512d5f040d1ae094074b55b63e0', 'request_id': 'req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:37.369542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e40512d5f040d1ae094074b55b63e0', 'request_id': 'req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:37.405133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] The token cache is being invalidate because project 71e40512d5f040d1ae094074b55b63e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:37.405437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:37.406120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:37.408267 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3432/6885] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:36 2022] DELETE /identity/v3/projects/71e40512d5f040d1ae094074b55b63e0 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:37.412417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:37.413107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:37.423075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:37.426750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.426750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.426750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.427045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.428914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=ee236da0599d437b85c940d9a3490865, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:37.429247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.436300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:37.553350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1df7-48cd-49aa-b748-9db3d0af5d72 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.570858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.572184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.572184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.572184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] PATH_INFO: `/v3/users/889df4ee75af45359afec40f353fd3e7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.573386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=889df4ee75af45359afec40f353fd3e7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.577813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:37.677583 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3454/6886] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:37 2022] GET /identity/v3/role_assignments?scope.project.id=ee236da0599d437b85c940d9a3490865&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 228 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:37.678551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:37.686207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:37.741809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cb35-3f80-45f4-be0e-074bd3cdbc04 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.753174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.753487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:37.755789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.755789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.755789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects/ee236da0599d437b85c940d9a3490865` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.760310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee236da0599d437b85c940d9a3490865)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.765437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.145992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889df4ee75af45359afec40f353fd3e7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.151716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889df4ee75af45359afec40f353fd3e7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.227589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee236da0599d437b85c940d9a3490865', 'request_id': 'req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.283011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889df4ee75af45359afec40f353fd3e7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.319804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889df4ee75af45359afec40f353fd3e7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.324617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889df4ee75af45359afec40f353fd3e7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.377847 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3433/6887] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:37 2022] DELETE /identity/v3/users/889df4ee75af45359afec40f353fd3e7 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:38.471736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee236da0599d437b85c940d9a3490865', 'request_id': 'req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.479147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee236da0599d437b85c940d9a3490865', 'request_id': 'req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.515825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] The token cache is being invalidate because project ee236da0599d437b85c940d9a3490865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:38.522402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.522402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:38.528081 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3455/6888] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:37 2022] DELETE /identity/v3/projects/ee236da0599d437b85c940d9a3490865 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:38.529077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.530626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:38.817679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc79e-701a-41ad-bb15-3b5a96a34a8c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.843446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.844123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.846702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.847034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/aad5c0bdba8540358b4addcdacf0e1ce` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.852500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aad5c0bdba8540358b4addcdacf0e1ce)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.862047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.977102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.056231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role aad5c0bdba8540358b4addcdacf0e1ce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:39.059925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:39.059925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:39.059925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3434/6889] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:38 2022] DELETE /identity/v3/roles/aad5c0bdba8540358b4addcdacf0e1ce => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:39.068838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.070507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:39.264387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fed27-08ed-4bdf-a524-3da276b5ea7e tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.432952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.434118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.434396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.434685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.435361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.440299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.556189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3456/6890] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Oct 31 14:48:39 2022] POST /identity/v3/roles => generated 240 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:39.560851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.564553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:39.585471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f31778-ddb0-4398-8d77-424429d0fb2a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.592634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.594226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.594783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.595310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.596685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.599525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.850564 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3435/6891] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:39 2022] POST /identity/v3/projects => generated 410 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:39.851806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.866377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c111ca-7c53-43a7-9539-5a2a12e2443a tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.875997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.878311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.879959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:40.050859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857aefe-b6f3-4298-ac98-629bed4050be tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.052634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.055355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.055755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.056777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/83e98e7f2a974f47996ec04ec1913c42/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.063090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=83e98e7f2a974f47996ec04ec1913c42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.064544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.066708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.068535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.068894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] PATH_INFO: `/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.070389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.071237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c041ee3efbce432e9e50cc0d44d7b9f8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.077245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.148660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:40.199785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3457/6892] 10.222.0.13 () {60 vars in 1582 bytes} [Mon Oct 31 14:48:39 2022] PUT /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/83e98e7f2a974f47996ec04ec1913c42/inherited_to_projects => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:40.202718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.299570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'request_id': 'req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.401833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1852c1-7613-44a1-ac65-242f5ddc36b5 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.507511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'request_id': 'req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.516222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c041ee3efbce432e9e50cc0d44d7b9f8', 'request_id': 'req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.549082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] The token cache is being invalidate because project c041ee3efbce432e9e50cc0d44d7b9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:40.549349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.550044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d41c9d6f-fcf3-41bf-ac2d-1db6d2e9d992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.552429 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3436/6893] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:39 2022] DELETE /identity/v3/projects/c041ee3efbce432e9e50cc0d44d7b9f8 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:40.560423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76ffda-9811-4782-bc60-9337a13238ad None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.560718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76ffda-9811-4782-bc60-9337a13238ad None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.561001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76ffda-9811-4782-bc60-9337a13238ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.566819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.568446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.571109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.575349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.575349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=45f15ab59b4b43d2bed5681c90d4c56a, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:40.575349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.579117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.597174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e76ffda-9811-4782-bc60-9337a13238ad None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:40.598447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e76ffda-9811-4782-bc60-9337a13238ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:40.767520 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3458/6894] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:40 2022] GET /identity/v3/role_assignments?scope.project.id=45f15ab59b4b43d2bed5681c90d4c56a&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 649 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:40.768457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.781687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:40.820056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f544c-9749-4d01-81e5-df22e6e5d6c0 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.831561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3437/6895] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:40.842197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.842828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.843276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.844089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.844791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.845074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.845355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/83e98e7f2a974f47996ec04ec1913c42/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.851601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f0b6aeebeee541ccb36f8e1bd7746785, user_id=01c9fa184fd642629ea01e568434ecbd, role_id=83e98e7f2a974f47996ec04ec1913c42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.867325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.891197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:40.893362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 83e98e7f2a974f47996ec04ec1913c42 was removed from user 01c9fa184fd642629ea01e568434ecbd on project f0b6aeebeee541ccb36f8e1bd7746785. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:40.893626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.897250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:40.901904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:40.914691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3438/6896] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:40.918261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.940179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d72f-88f1-4a1a-bdca-9eaa0669c1ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.963691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.965664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.966189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.967583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.968607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:40.971582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.974126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:41.015833 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3439/6897] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:41.019933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.062245 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3459/6898] 10.222.0.13 () {58 vars in 1566 bytes} [Mon Oct 31 14:48:40 2022] DELETE /identity/v3/OS-INHERIT/projects/f0b6aeebeee541ccb36f8e1bd7746785/users/01c9fa184fd642629ea01e568434ecbd/roles/83e98e7f2a974f47996ec04ec1913c42/inherited_to_projects => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:41.066402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.066552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887c69-c157-4ef7-b5a5-aa0d950662f1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:41.068159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:41.258169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:41.260320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.260609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.260886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.263368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:41.270085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d0e35-dd56-4f34-91c3-515de21de575 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:41.343803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156700-8221-41f8-89b7-6794d597d798 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:41.360880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:41.363912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:41.364548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.364885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.365096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.365826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Adding query filter params (scope.project.id=45f15ab59b4b43d2bed5681c90d4c56a, user.id=01c9fa184fd642629ea01e568434ecbd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:41.366346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:41.368610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:41.397502 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3440/6899] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:41 2022] POST /identity/v3/projects => generated 377 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:41.402461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.402802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.403078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.489649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] MFA Rules not processed for user `1aa5b0358e0b4207bcabd9bccb5701e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:41.491986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:41.494554 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3460/6900] 10.222.0.13 () {58 vars in 1356 bytes} [Mon Oct 31 14:48:41 2022] GET /identity/v3/role_assignments?scope.project.id=45f15ab59b4b43d2bed5681c90d4c56a&user.id=01c9fa184fd642629ea01e568434ecbd&effective => generated 228 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:41.495490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.520257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbca01c-7d1b-45b0-87b5-9e64163d33d3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:41.650038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:41.651131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.651623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.652694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.653554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:41.655723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:41.663786 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3441/6901] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:41.670535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.711312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:41.791327 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3461/6902] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:41 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:41.792643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.801623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:41.877433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442b874-b8ac-4c57-845b-405b034a0bba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:41.889555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:41.890575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.891090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.891561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects/45f15ab59b4b43d2bed5681c90d4c56a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.903552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45f15ab59b4b43d2bed5681c90d4c56a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:41.906906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:41.994891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba550-35fe-407b-a72a-90b56bd6297f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.002874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.003629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.003918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.004197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.039318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.043269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.069479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3462/6903] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:42.072547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.100677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a3e79-e57d-4234-941b-f0ba5d0a4903 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.114637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.122714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.130286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.130893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.131674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.133285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02033c-c349-43ec-a01e-511758f869b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.137069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f15ab59b4b43d2bed5681c90d4c56a', 'request_id': 'req-d1c68db6-a2c9-4569-baff-449bfa375aa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.164099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3463/6904] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/roles => generated 1651 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:42.174415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.179772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.179772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.244463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f15ab59b4b43d2bed5681c90d4c56a', 'request_id': 'req-d1c68db6-a2c9-4569-baff-449bfa375aa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.254775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f15ab59b4b43d2bed5681c90d4c56a', 'request_id': 'req-d1c68db6-a2c9-4569-baff-449bfa375aa1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.259004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] MFA Rules not processed for user `27fe59c95f6a45e1ad98d3a85dfe46f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:42.260299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.314782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.384439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] The token cache is being invalidate because project 45f15ab59b4b43d2bed5681c90d4c56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:42.384748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.385804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.402563 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3442/6905] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:41 2022] DELETE /identity/v3/projects/45f15ab59b4b43d2bed5681c90d4c56a => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:42.403656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.406248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.444787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.497681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.527303 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3464/6906] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:42.539317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.543982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.592820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c68db6-a2c9-4569-baff-449bfa375aa1 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.613132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.613823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.614230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.614377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] PATH_INFO: `/v3/projects/8e65ecd222ee432b8a6dab51125b5e58/users/a98e0a9e2d81461b8782dde8dea5af3e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.660829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e65ecd222ee432b8a6dab51125b5e58, user_id=a98e0a9e2d81461b8782dde8dea5af3e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.671751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.738279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96186e2-8794-4f8b-aaf5-aa4925d95c2a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.749077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.749963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.750245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.750521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/roles/83e98e7f2a974f47996ec04ec1913c42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.753150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_role(role_id=83e98e7f2a974f47996ec04ec1913c42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.754970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.792658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3443/6907] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:42 2022] PUT /identity/v3/projects/8e65ecd222ee432b8a6dab51125b5e58/users/a98e0a9e2d81461b8782dde8dea5af3e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:42.800193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.837105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.883519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.896963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invalidating the token cache because role 83e98e7f2a974f47996ec04ec1913c42 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:42.897552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.897875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:42.900946 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3465/6908] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:42 2022] DELETE /identity/v3/roles/83e98e7f2a974f47996ec04ec1913c42 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:42.907641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.909240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.947485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763e61-8438-412c-bb99-9bc0fa7a3f16 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.095790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.096582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.096926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.097260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.097996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.099833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.122013 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3444/6909] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:43.125869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.134700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f837-883f-4629-a78d-cc89bef16260 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.140386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:43.158183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.158870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.159152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.159431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/users/01c9fa184fd642629ea01e568434ecbd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.162197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01c9fa184fd642629ea01e568434ecbd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.164647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.171016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d94d02-5b7f-429e-887f-f6770b1643d4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.184890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.186188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.186188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.186188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] PATH_INFO: `/v3/projects/8e65ecd222ee432b8a6dab51125b5e58/users/a98e0a9e2d81461b8782dde8dea5af3e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.189684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e65ecd222ee432b8a6dab51125b5e58, user_id=a98e0a9e2d81461b8782dde8dea5af3e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.193251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8df9e-9c7c-4b8c-8020-2105bcf02afc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.224076 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3445/6910] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:43 2022] PUT /identity/v3/projects/8e65ecd222ee432b8a6dab51125b5e58/users/a98e0a9e2d81461b8782dde8dea5af3e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:43.225785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.226074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.226496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.292049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] MFA Rules not processed for user `a98e0a9e2d81461b8782dde8dea5af3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:43.295166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:43.389810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c9fa184fd642629ea01e568434ecbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:43.390569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c9fa184fd642629ea01e568434ecbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:43.463822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.468242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3446/6911] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:43.476696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.480546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:43.490855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c9fa184fd642629ea01e568434ecbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:43.526749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c9fa184fd642629ea01e568434ecbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:43.527850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c9fa184fd642629ea01e568434ecbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:43.565270 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3466/6912] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:42 2022] DELETE /identity/v3/users/01c9fa184fd642629ea01e568434ecbd => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:43.566418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.572751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:43.604356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.659087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7fdf2-d0f2-441b-9968-4e35da0d7c06 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.783369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f0b6-e020-4373-bab9-528f0b9f3883 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.789652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.794392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.794392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.794392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.794392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.795854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.798162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.799116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.799394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.799666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/groups/be88a0fc79b848a0924ace59b4248fce` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.802967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_group(group_id=be88a0fc79b848a0924ace59b4248fce)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.804711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:44.002607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3447/6913] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:43 2022] POST /identity/v3/projects => generated 379 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:44.006962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:44.081984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3467/6914] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 14:48:43 2022] DELETE /identity/v3/groups/be88a0fc79b848a0924ace59b4248fce => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:44.088104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:44.226263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbbf0f-bf1c-403a-8ba6-3c1ad73302d8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:44.333062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49352153-bc43-43c4-b239-81f033200a63 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:44.346970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:44.356018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:44.356412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:44.356785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/projects/f0b6aeebeee541ccb36f8e1bd7746785` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:44.360625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f0b6aeebeee541ccb36f8e1bd7746785)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:44.364128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:44.388648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:44.389474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:44.396372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:44.396372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:44.396372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:44.405063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:44.523673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:44.581388 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3448/6915] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:44 2022] POST /identity/v3/users => generated 290 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:44.589366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:44.604519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b93d-d9fb-4275-868d-168b702039eb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:44.623721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b6aeebeee541ccb36f8e1bd7746785', 'request_id': 'req-844c5bba-55a8-465b-9b3e-b226574bd2a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:44.728631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:44.787547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b6aeebeee541ccb36f8e1bd7746785', 'request_id': 'req-844c5bba-55a8-465b-9b3e-b226574bd2a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:44.795992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b6aeebeee541ccb36f8e1bd7746785', 'request_id': 'req-844c5bba-55a8-465b-9b3e-b226574bd2a3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:44.813523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] The token cache is being invalidate because project f0b6aeebeee541ccb36f8e1bd7746785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:44.814020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:44.815073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:44.817084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3468/6916] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:44 2022] DELETE /identity/v3/projects/f0b6aeebeee541ccb36f8e1bd7746785 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:44.823881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:44.827789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:44.901225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:44.903179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:44.904606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:44.906138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:44.909630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:44.913467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:44.958948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3449/6917] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:44.989892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:45.005907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c5bba-55a8-465b-9b3e-b226574bd2a3 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:45.020420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:45.033280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:45.038904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.041572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.042053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/domains/3cdfe2b5a72b4355b24d2e1bd260602f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.047346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:45.051630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:45.077556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526debd-ecf6-42f7-83ba-e6221971b9b8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:45.086584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:45.088897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.089451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.090145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.091158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:45.093570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:45.162071 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3450/6918] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:45.169955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:45.180395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.182695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.215127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81a67a-f17b-445a-9dc2-a7ca480c4d97 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:45.309124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.311300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.320354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3469/6919] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 14:48:44 2022] PATCH /identity/v3/domains/3cdfe2b5a72b4355b24d2e1bd260602f => generated 278 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:45.321656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:45.323528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:45.415925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:45.416632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.416914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.418716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] PATH_INFO: `/v3/projects/1322f69eac214512a5226c7120b729b7/users/f12a214df52f4c6a9e93f73a8d891ea7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.488099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556aabc-e026-4257-8ea5-90349d47dcdb tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:45.498594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1322f69eac214512a5226c7120b729b7, user_id=f12a214df52f4c6a9e93f73a8d891ea7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:45.509491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3d42-13a3-4b98-9f67-6e14771379bf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:45.513432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e1783987227452c9104e338e0ef25e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd62a20140ca49ee9f957b9ffaf07a81', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:45.514113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.514397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.514697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] PATH_INFO: `/v3/domains/3cdfe2b5a72b4355b24d2e1bd260602f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.568110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3cdfe2b5a72b4355b24d2e1bd260602f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:45.570760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:45.611661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.617439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.662658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3451/6920] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:45 2022] PUT /identity/v3/projects/1322f69eac214512a5226c7120b729b7/users/f12a214df52f4c6a9e93f73a8d891ea7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:45.664745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.665191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.665621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.743101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] MFA Rules not processed for user `f12a214df52f4c6a9e93f73a8d891ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:45.760849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:45.795513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.933878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.944136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.972207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] The token cache is being invalidate because project 3cdfe2b5a72b4355b24d2e1bd260602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:45.972928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:45.993456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.018407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.024463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.029686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3cdfe2b5a72b4355b24d2e1bd260602f', 'request_id': 'req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.030939 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3452/6921] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:46.054243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.058906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:46.064274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3470/6922] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 14:48:45 2022] DELETE /identity/v3/domains/3cdfe2b5a72b4355b24d2e1bd260602f => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:46.072478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.075426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:46.223557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a5e9-40d6-430f-a419-b5c3a0aaeab4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.233905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.234462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.234879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.239372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9b301-5cdc-4b0b-9d3d-ea97dedd7104 tempest-InheritsV3TestJSON-1941632220 tempest-InheritsV3TestJSON-1941632220-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.245288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.251507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:46.252552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.253264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.253725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.254012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] PATH_INFO: `/v3/users/e170e392d8ac4fb38ede787ce3a11c71` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.258394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e170e392d8ac4fb38ede787ce3a11c71)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:46.262828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:46.401160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:46.406291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fdc7e-5c3d-4cdc-b621-7910543f553e service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:46.429093 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3453/6923] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:46.516886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:46.606447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e170e392d8ac4fb38ede787ce3a11c71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.610090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e170e392d8ac4fb38ede787ce3a11c71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.700735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e170e392d8ac4fb38ede787ce3a11c71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.704026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:46.747353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e170e392d8ac4fb38ede787ce3a11c71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.748176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e170e392d8ac4fb38ede787ce3a11c71'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:46.782839 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3471/6924] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:46 2022] DELETE /identity/v3/users/e170e392d8ac4fb38ede787ce3a11c71 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:46.787605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.788082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.788541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.858553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:46.866321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:47.096423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3454/6925] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:47.106525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.111008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:47.363612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5301b4-fc2f-490f-ad58-71999a98bab5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.383459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.384372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.384811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.385263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.422714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.429916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.478106 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3472/6926] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:47.541762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.306126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.388093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:48.389861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:48.428623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5f8b-9456-42d1-bf4d-346e41f6de44 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.451451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.452771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.454948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.455403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] PATH_INFO: `/v3/users/a98e0a9e2d81461b8782dde8dea5af3e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.461280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98e0a9e2d81461b8782dde8dea5af3e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.465421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.576685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:48.578245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:48.616962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cd7c7-e968-4c38-9a6a-2095b1050ea5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.647356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.648006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.648286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.648560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] PATH_INFO: `/v3/projects/de3a9e5ce712449c9df3d4c989110163` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.655489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3a9e5ce712449c9df3d4c989110163)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.670241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.894111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98e0a9e2d81461b8782dde8dea5af3e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:48.898237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98e0a9e2d81461b8782dde8dea5af3e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:48.898369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3a9e5ce712449c9df3d4c989110163', 'request_id': 'req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:48.983394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3a9e5ce712449c9df3d4c989110163', 'request_id': 'req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:48.991084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3a9e5ce712449c9df3d4c989110163', 'request_id': 'req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.021341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] The token cache is being invalidate because project de3a9e5ce712449c9df3d4c989110163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:49.021637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.022983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.030524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3473/6927] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:48 2022] DELETE /identity/v3/projects/de3a9e5ce712449c9df3d4c989110163 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:49.031548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.036860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:49.068203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98e0a9e2d81461b8782dde8dea5af3e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.100518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98e0a9e2d81461b8782dde8dea5af3e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.103871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de55a871-030c-470a-8a66-b52cd4ea0901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98e0a9e2d81461b8782dde8dea5af3e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.141573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3455/6928] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:48 2022] DELETE /identity/v3/users/a98e0a9e2d81461b8782dde8dea5af3e => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:49.146118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800326a-59da-47f0-9053-75331c33020d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.146602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800326a-59da-47f0-9053-75331c33020d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.147074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800326a-59da-47f0-9053-75331c33020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.173338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.235334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c800326a-59da-47f0-9053-75331c33020d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:49.235334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c800326a-59da-47f0-9053-75331c33020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:49.266737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d3b0-c2aa-497b-9778-6a2b1c7d74b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.405296 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3456/6929] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:49.430975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800326a-59da-47f0-9053-75331c33020d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.436825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c800326a-59da-47f0-9053-75331c33020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:49.450099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.450870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.451296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.451673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] PATH_INFO: `/v3/users/2e1783987227452c9104e338e0ef25e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.453893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1783987227452c9104e338e0ef25e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.457211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.521553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800326a-59da-47f0-9053-75331c33020d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.525774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.526389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.526721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.527637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.537855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.540437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.542332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.558805 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3457/6930] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:49.850236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1783987227452c9104e338e0ef25e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.867195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1783987227452c9104e338e0ef25e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:49.987155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1783987227452c9104e338e0ef25e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:50.019334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1783987227452c9104e338e0ef25e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:50.023011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1783987227452c9104e338e0ef25e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:50.068217 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3474/6931] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:49 2022] DELETE /identity/v3/users/2e1783987227452c9104e338e0ef25e5 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:50.461896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:50.626605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:51.482993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:51.506138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:51.508302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:51.532953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eef93-ec3f-4d90-ac8c-218590838cc5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:51.603852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:51.606842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:51.697847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:51.698507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:51.698921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:51.699415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] PATH_INFO: `/v3/projects/8e65ecd222ee432b8a6dab51125b5e58` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:51.701794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e65ecd222ee432b8a6dab51125b5e58)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:51.706084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:51.764868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:51.815187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc221c9-c245-41b5-93a9-b62ecc954a48 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:51.826557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:51.828546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:51.828751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:51.830200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] PATH_INFO: `/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:51.832723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd62a20140ca49ee9f957b9ffaf07a81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:51.837767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:51.872496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e65ecd222ee432b8a6dab51125b5e58', 'request_id': 'req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:51.982076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e65ecd222ee432b8a6dab51125b5e58', 'request_id': 'req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:51.989207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e65ecd222ee432b8a6dab51125b5e58', 'request_id': 'req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.024663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] The token cache is being invalidate because project 8e65ecd222ee432b8a6dab51125b5e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:52.027660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.027660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.033604 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3458/6932] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:51 2022] DELETE /identity/v3/projects/8e65ecd222ee432b8a6dab51125b5e58 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:52.037875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.046663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:52.082763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd62a20140ca49ee9f957b9ffaf07a81', 'request_id': 'req-174d7838-3b3b-4aec-8682-4039ca81649e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.197322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd62a20140ca49ee9f957b9ffaf07a81', 'request_id': 'req-174d7838-3b3b-4aec-8682-4039ca81649e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.203977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd62a20140ca49ee9f957b9ffaf07a81', 'request_id': 'req-174d7838-3b3b-4aec-8682-4039ca81649e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.212431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1abc-74cd-4827-92d3-b6797ee7c9c3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.216419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:52.249079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] The token cache is being invalidate because project dd62a20140ca49ee9f957b9ffaf07a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:52.251654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.255103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-174d7838-3b3b-4aec-8682-4039ca81649e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.266919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3475/6933] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:51 2022] DELETE /identity/v3/projects/dd62a20140ca49ee9f957b9ffaf07a81 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:52.275190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607fc5-4147-441b-ac64-1e4315c22395 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.278426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607fc5-4147-441b-ac64-1e4315c22395 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.282162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607fc5-4147-441b-ac64-1e4315c22395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.326478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.327166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.327447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.327723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] PATH_INFO: `/v3/users/f12a214df52f4c6a9e93f73a8d891ea7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.331052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12a214df52f4c6a9e93f73a8d891ea7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:52.333010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:52.389389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71607fc5-4147-441b-ac64-1e4315c22395 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:52.390735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71607fc5-4147-441b-ac64-1e4315c22395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:52.403418 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3476/6934] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:52.425246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.431391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.431792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.523521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:52.534466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:52.588482 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3477/6935] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:52.590077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.619449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e507e-1212-4ba9-991c-2d155684f361 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.644790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.645421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.645908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.646338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.647236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:52.647698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:52.649554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:52.659960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12a214df52f4c6a9e93f73a8d891ea7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.666143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12a214df52f4c6a9e93f73a8d891ea7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.697162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3478/6936] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:52.703328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.715882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:52.734377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12a214df52f4c6a9e93f73a8d891ea7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.747751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ac9e-e28f-47a7-9e2c-23dff88bcb4f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.761850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.762777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.763216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.772282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.772282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:52.772282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:52.773091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12a214df52f4c6a9e93f73a8d891ea7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.775918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12a214df52f4c6a9e93f73a8d891ea7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:52.811061 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3459/6937] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:48:52 2022] DELETE /identity/v3/users/f12a214df52f4c6a9e93f73a8d891ea7 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:52.879827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:52.920340 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3479/6938] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:52 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:52.925137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.105812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4e193-7e37-4c60-a992-267f7a796f37 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.247340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.248232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.248689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.249123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.249917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.254864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.264176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:53.393923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3460/6939] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:52 2022] POST /identity/v3/users => generated 285 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:53.394841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.410961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30ab5-4d10-4e0e-b59e-661af32dfe37 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.426674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.427848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.428345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.428863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.429807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.433537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.458396 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3480/6940] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:48:53.463837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.479434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f927f8-8fd7-40ac-a28c-4ea233a199b5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.494192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.494849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.495135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.495410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.496101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.497715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb9aaa-f25f-43d4-b849-68054a5f030a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.529630 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3461/6941] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:53.531197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.549939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a0b1-2576-4285-be61-daf72172b71e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.565051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.566001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.566437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.566858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] PATH_INFO: `/v3/projects/06d57b8b4772443bb635c442ed554d8b/users/2bcf5260f1804556bb4c58333babfa9f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.604626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d57b8b4772443bb635c442ed554d8b, user_id=2bcf5260f1804556bb4c58333babfa9f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.625752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.708430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3481/6942] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:53 2022] PUT /identity/v3/projects/06d57b8b4772443bb635c442ed554d8b/users/2bcf5260f1804556bb4c58333babfa9f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:53.720097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.720379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.720835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.735998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:53.780563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] MFA Rules not processed for user `2bcf5260f1804556bb4c58333babfa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:53.781812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:53.880354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:53.904791 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3462/6943] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:53.909128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.050886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31996c1-e1a7-4cbf-a2ba-fd1333a1bd3d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.068630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.072724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.077008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.077518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.079249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.088605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.209569 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3482/6944] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:53 2022] POST /identity/v3/projects => generated 367 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:54.214246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.231470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a8c1-b94e-4d9f-9319-ec08a0c095af None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.290408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:54.364128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.366544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.367034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.367569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.368443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.371554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.469709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.472977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:54.498513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3463/6945] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:54 2022] POST /identity/v3/users => generated 284 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:54.501500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694aa24-8c80-40d6-856c-9c48e9f15ddf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.503817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.511063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.513224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.513658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.514354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] PATH_INFO: `/v3/projects/1322f69eac214512a5226c7120b729b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.516113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1322f69eac214512a5226c7120b729b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.518789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.521676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f8648-3987-4d10-a653-90c27797fdca admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.534869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.535608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.535950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.538155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.539207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.540836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.564802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3464/6946] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:54.566247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.595469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667098c-7ec6-4774-8da2-e98f28dcbbb3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.613747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.613747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.613747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.613747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.614404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.616134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.646668 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3465/6947] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:54.649814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:54.663933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2b19-3b51-49a1-8ec4-950bc34df32f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:54.676360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:54.677162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.679901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.679901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] PATH_INFO: `/v3/projects/40c5ecd4aa944ae59d3f27411d6f446d/users/704bd2883297497eb6348e89b6eb6622/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.721028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1322f69eac214512a5226c7120b729b7', 'request_id': 'req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:54.731322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c5ecd4aa944ae59d3f27411d6f446d, user_id=704bd2883297497eb6348e89b6eb6622, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:54.736885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4803bb-c209-4d73-a147-17a5048ffbdb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:54.814423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1322f69eac214512a5226c7120b729b7', 'request_id': 'req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:54.821641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1322f69eac214512a5226c7120b729b7', 'request_id': 'req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:54.861485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3466/6948] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:54 2022] PUT /identity/v3/projects/40c5ecd4aa944ae59d3f27411d6f446d/users/704bd2883297497eb6348e89b6eb6622/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:54.868506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.868942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.871784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.874863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] The token cache is being invalidate because project 1322f69eac214512a5226c7120b729b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:48:54.875339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:54.876481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb57e1e6-36c7-4fcd-affb-dd25ae09dee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:48:54.878528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3483/6949] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:48:54 2022] DELETE /identity/v3/projects/1322f69eac214512a5226c7120b729b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:54.884970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462fb55-1b84-4b5f-abe5-57dc986e8b75 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:54.887291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462fb55-1b84-4b5f-abe5-57dc986e8b75 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:54.889861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462fb55-1b84-4b5f-abe5-57dc986e8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:54.930123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:54.967772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1462fb55-1b84-4b5f-abe5-57dc986e8b75 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:54.974176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1462fb55-1b84-4b5f-abe5-57dc986e8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:54.993814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] MFA Rules not processed for user `704bd2883297497eb6348e89b6eb6622`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:54.998029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:55.208951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:55.250340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3467/6950] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:55.267235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:55.267235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:55.324354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3484/6951] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:55.419401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.420052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.420507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.445021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:55.449142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:55.457473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4676b-d43b-4ac0-ac3d-6943db8bd6d3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:55.469471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:55.470057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3485/6952] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:55.470202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.470380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.470868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.472197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:55.476128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:55.503661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084a0d6-b0a4-413f-8b92-0c5550140af5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:55.518570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:55.520298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.520580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.520852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.524700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:55.525513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:55.532353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:55.537810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:55.565518 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3486/6953] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:55.575585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:55.606495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3716-f0f4-4422-bb56-e71bcca909c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:55.641062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:55.641829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.641960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.642220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.648817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:55.657984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:55.688205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:55.690140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:55.717129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3468/6954] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:48:55.819401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3487/6955] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:48:55 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:55.823722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:55.840320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a8a7-14d7-43c9-ac0e-425f53d8044a service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:55.996528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:55.999765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.000494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.001401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.003061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.007778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.166726 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3469/6956] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:55 2022] POST /identity/v3/users => generated 286 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:56.170727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:56.200617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d1383-0ca9-4d6f-af01-8d509ab1c56d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:56.215007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:56.217574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.218999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.219494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.223961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.231217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.272229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3488/6957] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:56.276521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:56.330799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea46d2-1c80-49f8-a222-b846e67e7d3b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:56.350526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:56.355547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.356112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.356635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.359141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.367365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.397783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:56.412032 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3470/6958] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:56.421241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:56.478271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34f99c-2ea1-4df8-b507-a2b2cce03f5b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:56.498931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:56.501895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.502233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.504305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] PATH_INFO: `/v3/projects/105e26ee2d944709870d0a3b2c607f88/users/132dde43979f4432ae238289f788601f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.556233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=105e26ee2d944709870d0a3b2c607f88, user_id=132dde43979f4432ae238289f788601f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.563948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253dae-bbf2-40b1-af55-ec857bba25fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.571933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:56.648942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3129f9-00a5-4445-a28d-b604f76b62ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:56.652484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3471/6959] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:48:56 2022] PUT /identity/v3/projects/105e26ee2d944709870d0a3b2c607f88/users/132dde43979f4432ae238289f788601f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:56.662817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2703-dda5-45c7-9cc6-a6cd0d1d12e2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.663102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2703-dda5-45c7-9cc6-a6cd0d1d12e2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.663664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2703-dda5-45c7-9cc6-a6cd0d1d12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.766022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-140b2703-dda5-45c7-9cc6-a6cd0d1d12e2 None None] MFA Rules not processed for user `132dde43979f4432ae238289f788601f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:56.773302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-140b2703-dda5-45c7-9cc6-a6cd0d1d12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:56.782217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:56.783188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.783627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.784084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.918838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.919887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.940810 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3489/6960] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:48:56.971082 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3472/6961] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:48:57.088904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:57.104569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890ba4b-3e6f-4f10-9158-a11960f18165 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:57.116642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:57.117279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:57.117562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:57.118212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:57.137997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:57.139490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:57.170368 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3490/6962] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:48:58.109394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.111460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.111990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.168466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:58.170979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:58.252453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3473/6963] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:48:58.265328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:58.266910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:58.272412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:58.354425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bee8-5d5c-4093-a5df-1e121dbf1010 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:58.360307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:58.360923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.361198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.365712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.370575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:58.372383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3b1dd-3aaf-4a4f-9fd0-8e7b695edc35 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:58.381495 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3491/6964] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:48:58.718476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:58.720169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:58.931487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38313-767f-40d3-9e9f-3c59fb14657e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:58.958006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:58.959033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.959033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.959266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.968413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:59.024137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:59.025784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:59.071278 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3474/6965] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:48:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:00.035653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b63a-02c4-49f9-9894-79a99ca28dc4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:00.036847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b63a-02c4-49f9-9894-79a99ca28dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:00.037204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08b63a-02c4-49f9-9894-79a99ca28dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:00.071134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e08b63a-02c4-49f9-9894-79a99ca28dc4 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:00.074343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e08b63a-02c4-49f9-9894-79a99ca28dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:00.096990 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3492/6966] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:00.150043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:00.172163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dee0b-585f-4a98-ae68-9b2b78d9cbb9 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:00.189680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:00.191662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:00.191662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:00.191662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:00.218130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:00.219761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:00.246575 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3475/6967] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:02.095832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b270d8-d1d6-466a-a803-842bb21f1311 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.096373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b270d8-d1d6-466a-a803-842bb21f1311 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.096373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b270d8-d1d6-466a-a803-842bb21f1311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.137903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4b270d8-d1d6-466a-a803-842bb21f1311 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:02.139950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4b270d8-d1d6-466a-a803-842bb21f1311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:02.173260 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3493/6968] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:02.185871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.192315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:02.210412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9937-3740-460b-9935-32eb66f841e2 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.220332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.221197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.221722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.222179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.234362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.236711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31584a04-4743-486e-a23e-41a032aaa799 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.249942 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3476/6969] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:03.275947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:03.277959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:03.278246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:03.330044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] MFA Rules not processed for user `27fe59c95f6a45e1ad98d3a85dfe46f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:03.331331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:03.488986 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3494/6970] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:03.664888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9b938-ec72-4800-a0ba-af66b98120a7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:03.665409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9b938-ec72-4800-a0ba-af66b98120a7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:03.665409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9b938-ec72-4800-a0ba-af66b98120a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:03.702776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f9c9b938-ec72-4800-a0ba-af66b98120a7 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:03.704131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f9c9b938-ec72-4800-a0ba-af66b98120a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:03.732640 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3477/6971] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:03.746111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:03.778457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450cf3b-b981-429b-a869-209ee6f06f68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:03.812334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:03.815031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:03.819539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:03.819980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:03.884687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:03.895584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:03.946791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3495/6972] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:05.616572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302549e-5c3b-4b9b-bb70-e8bf34555e62 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.617046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302549e-5c3b-4b9b-bb70-e8bf34555e62 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.617046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302549e-5c3b-4b9b-bb70-e8bf34555e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.659905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e302549e-5c3b-4b9b-bb70-e8bf34555e62 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:05.661643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e302549e-5c3b-4b9b-bb70-e8bf34555e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:05.689519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3478/6973] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:05.731765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:05.768353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e315d-acfb-49b5-bba0-1f5538f5a06f service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:05.790604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:05.791264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.791552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.791830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.834682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:05.838180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:05.877950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3496/6974] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:07.453814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:07.454348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:07.454556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:07.499873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:07.501493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:07.520265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3479/6975] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:07.536989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:07.557047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7acd6-53ae-4fb1-88aa-778119711a62 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:07.575534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:07.577011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:07.577675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:07.578244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:07.599596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:07.602352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935bd80-a61a-4594-b85d-441d68d080af service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:07.628378 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3497/6976] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:10.299394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:10.308762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:10.489649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d54b0-845c-4319-9a8b-836805f3fbaa None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:10.499109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:10.500447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:10.501254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:10.501829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] PATH_INFO: `/v3/users/b897e329282b42039b87c9da71c38aaf` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:10.503292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b897e329282b42039b87c9da71c38aaf)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:10.505755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:10.850700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b897e329282b42039b87c9da71c38aaf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:10.851467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b897e329282b42039b87c9da71c38aaf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:10.951715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b897e329282b42039b87c9da71c38aaf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:11.002101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b897e329282b42039b87c9da71c38aaf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:11.003037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b897e329282b42039b87c9da71c38aaf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:11.026171 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3480/6977] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:10 2022] DELETE /identity/v3/users/b897e329282b42039b87c9da71c38aaf => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:11.027531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.028992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.029886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.075199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:11.076757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:11.188505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:11.247543 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3498/6978] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:11.263336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.265114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:11.427286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:11.447125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570eed-8a14-46ea-8054-111a4b20d091 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.466975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.467841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.468304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.468966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.509310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:11.520906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:11.562021 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3481/6979] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:12.809372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:12.811087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:12.830194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087e0d-72cb-419f-99c3-7eab70f68dca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:12.861662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:12.865241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:12.866082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:12.868965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] PATH_INFO: `/v3/projects/355a8d25ae754150a1fce02e33d02896` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:12.873128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] RBAC: Authorizing `identity:delete_project(project_id=355a8d25ae754150a1fce02e33d02896)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:12.877910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:12.970591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:12.972261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:12.990848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157979d4-e246-4c31-bcbc-14b3807fdaaf service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:13.019357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:13.022940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.023855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.024387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] PATH_INFO: `/v3/users/2bcf5260f1804556bb4c58333babfa9f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.027663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bcf5260f1804556bb4c58333babfa9f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:13.031150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:13.195732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355a8d25ae754150a1fce02e33d02896', 'request_id': 'req-8804cd9c-09c8-4b19-8c75-975c465c707e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.307416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355a8d25ae754150a1fce02e33d02896', 'request_id': 'req-8804cd9c-09c8-4b19-8c75-975c465c707e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.315370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355a8d25ae754150a1fce02e33d02896', 'request_id': 'req-8804cd9c-09c8-4b19-8c75-975c465c707e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.355316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] The token cache is being invalidate because project 355a8d25ae754150a1fce02e33d02896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:13.359634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.362363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8804cd9c-09c8-4b19-8c75-975c465c707e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.365140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3499/6980] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:12 2022] DELETE /identity/v3/projects/355a8d25ae754150a1fce02e33d02896 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:13.369892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d31c-432a-4667-9df8-0ccde82abc6c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.372586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d31c-432a-4667-9df8-0ccde82abc6c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.373076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d31c-432a-4667-9df8-0ccde82abc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.376993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcf5260f1804556bb4c58333babfa9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.378421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcf5260f1804556bb4c58333babfa9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.454128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a732d31c-432a-4667-9df8-0ccde82abc6c None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:13.455331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a732d31c-432a-4667-9df8-0ccde82abc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:13.467529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcf5260f1804556bb4c58333babfa9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.493662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcf5260f1804556bb4c58333babfa9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.496721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-240999dc-aab7-41cc-8ea6-00620a0828f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcf5260f1804556bb4c58333babfa9f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:13.550087 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3482/6981] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:12 2022] DELETE /identity/v3/users/2bcf5260f1804556bb4c58333babfa9f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:13.555111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2bf8-8c17-4a0f-8ddb-1c36390caa87 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.555575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2bf8-8c17-4a0f-8ddb-1c36390caa87 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.555856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e2bf8-8c17-4a0f-8ddb-1c36390caa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.675993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f14e2bf8-8c17-4a0f-8ddb-1c36390caa87 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:13.675993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f14e2bf8-8c17-4a0f-8ddb-1c36390caa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:13.734226 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3483/6982] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:13.735935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.736389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.736813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.737944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3500/6983] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:13.748126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.748488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.748835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.798441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:13.799907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:13.810890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3484/6984] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:13.825190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:13.825190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:13.825431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:13.825431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:13.858831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3501/6985] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:13.873083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:13.933355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:13.942246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29f2d8-5f43-42c6-9ed1-a2d894d9f4eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:13.955019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:13.955940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.956476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.956985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.957963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:13.958494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:13.960554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:13.965931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87d68-05ea-4302-a2f1-a3b293af22a7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:13.984217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:13.984217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:13.984217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:13.984217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:13.986183 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3502/6986] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:13.987481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:13.989489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:14.164267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.164267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.164267 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3485/6987] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:14.164267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.164267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830750-af03-4994-81dc-964b75846a7e service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.173292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.173292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.173292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.173292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.202887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.202887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.224658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382553a4-e0c6-4578-a7a4-897dfcc8d04f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.229007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.230647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.230647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.230647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.248596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:14.252335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.254389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.269563 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3503/6988] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:14.506731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3486/6989] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:14 2022] POST /identity/v3/projects => generated 381 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:14.507941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.518366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741c63-8758-436f-964f-32f2b8c806d6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.598865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.599982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.600515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.601126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.602221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.604887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.745013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.745550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3504/6990] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:14 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:14.767799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ead3b-1930-486a-b6a4-48db337f8efe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.793576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.795687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.796369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.796369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.796875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.808107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.856285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.861130 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3487/6991] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:14.871997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3233-3693-4f90-a90d-d8a2a3f81cd3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.894915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.896812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.897094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.900266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.905155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:14.914002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331a238-fd3f-4d2a-82f9-85154ab92713 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:14.961808 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3505/6992] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:14.965241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.981617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791566d-5c20-4c2f-b1ac-34d8de73ad94 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.014247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.020344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.020637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.020921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] PATH_INFO: `/v3/projects/3dbd61c6f9084e90a3e30ae8c9dbdb05/users/57e7b5ca415b4678a969751d458eb7b6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.085986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbd61c6f9084e90a3e30ae8c9dbdb05, user_id=57e7b5ca415b4678a969751d458eb7b6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.093140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.100200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a155-7da1-4bab-8e0b-fe9d9a76477e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.103410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a155-7da1-4bab-8e0b-fe9d9a76477e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.104014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a155-7da1-4bab-8e0b-fe9d9a76477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.190758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3488/6993] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:14 2022] PUT /identity/v3/projects/3dbd61c6f9084e90a3e30ae8c9dbdb05/users/57e7b5ca415b4678a969751d458eb7b6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:15.190758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.202123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6657a155-7da1-4bab-8e0b-fe9d9a76477e None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:15.204346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.206541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6657a155-7da1-4bab-8e0b-fe9d9a76477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.390289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da17f2-5b12-4d4e-aec7-15f18c4c52f3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.415799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.416768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.417600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.417877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] PATH_INFO: `/v3/projects/06d57b8b4772443bb635c442ed554d8b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.421533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d57b8b4772443bb635c442ed554d8b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.424110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.426516 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3506/6994] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:15.433385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.433385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.433385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.466674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:15.468006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.480977 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3507/6995] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:15.480977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.640153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:15.656200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d57b8b4772443bb635c442ed554d8b', 'request_id': 'req-8a137f41-0a4b-4642-b86c-d104a5aef25b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:15.672822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754a62f-ae93-4ee4-a16d-6f2b08b809ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.691135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:15.746999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d57b8b4772443bb635c442ed554d8b', 'request_id': 'req-8a137f41-0a4b-4642-b86c-d104a5aef25b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:15.754024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d57b8b4772443bb635c442ed554d8b', 'request_id': 'req-8a137f41-0a4b-4642-b86c-d104a5aef25b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:15.786274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] The token cache is being invalidate because project 06d57b8b4772443bb635c442ed554d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:15.787992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:15.789658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:15.793415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3489/6996] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:15 2022] DELETE /identity/v3/projects/06d57b8b4772443bb635c442ed554d8b => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:15.794976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.796104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.797003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.797629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.798321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.799146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.803181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.891495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137f41-0a4b-4642-b86c-d104a5aef25b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.898765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.898986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.899573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.899704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.900137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.901583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.901985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:15.922581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3508/6997] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:15.926472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.928329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:16.042578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:16.042578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ea94-07f2-4d68-86a5-0b36456b354e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:16.043222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1e13-1fc3-4538-97d9-0f7703e2c72f service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:16.048025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:16.049057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:16.049364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:16.049808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] PATH_INFO: `/v3/users/704bd2883297497eb6348e89b6eb6622` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:16.051111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=704bd2883297497eb6348e89b6eb6622)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:16.054142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:16.063134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3490/6998] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:16.432158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704bd2883297497eb6348e89b6eb6622'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:16.433453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704bd2883297497eb6348e89b6eb6622'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:16.534303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:16.534590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:16.535052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:16.557119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:16.559054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:16.569035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704bd2883297497eb6348e89b6eb6622'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:16.573348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:16.592445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3491/6999] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:49:16.602451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704bd2883297497eb6348e89b6eb6622'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:16.602451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704bd2883297497eb6348e89b6eb6622'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:16.611092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:16.613204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:16.623561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3509/7000] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:15 2022] DELETE /identity/v3/users/704bd2883297497eb6348e89b6eb6622 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:16.627789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:16.629243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:16.721693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b541f0-15f0-43a9-adf4-47a21b3600f7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:16.735072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:16.755061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebed9-e767-4bf4-a48c-682450e5dbb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:16.767927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:16.769251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:16.769536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:16.769812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:16.816246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:16.816977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:16.817324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:16.817668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:16.820436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:16.836575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:16.838362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:16.840647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:16.842324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50883447-909d-49e5-81b4-2a5fc371389a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:16.851707 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3510/7001] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:16.859672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3492/7002] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:49:17.373105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:17.373700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:17.373700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:17.409237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:17.410504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:17.420617 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3511/7003] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:17.441811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:17.463283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16715-fd13-4ea1-a09b-d8fa2ca7f36c service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:17.470586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:17.471430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:17.473456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:17.473456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:17.501892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:17.503777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d2f6-1bd6-4112-8a19-9426b7f84d8b service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:17.514227 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3493/7004] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:17.841706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:17.843456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.015385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f19a-f9e5-45b5-88b1-75bf114bb9e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:18.037499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:18.038145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.038433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.038741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] PATH_INFO: `/v3/projects/40c5ecd4aa944ae59d3f27411d6f446d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.060444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c5ecd4aa944ae59d3f27411d6f446d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:18.069295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:18.083127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:18.092646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.093149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.093619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.121869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:18.123933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.153512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3494/7005] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:18.154538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.172837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4989e3-b46c-4d14-ac0e-c77c57c1a494 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:18.178439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:18.179093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.179373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.179647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.189789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:18.191895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31940526-a896-4450-9030-b58b744b3bfc service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:18.202676 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3495/7006] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:18.246406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c5ecd4aa944ae59d3f27411d6f446d', 'request_id': 'req-c171fbe6-03e8-4813-975c-5fdebe5fb735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:18.339423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c5ecd4aa944ae59d3f27411d6f446d', 'request_id': 'req-c171fbe6-03e8-4813-975c-5fdebe5fb735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:18.362513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c5ecd4aa944ae59d3f27411d6f446d', 'request_id': 'req-c171fbe6-03e8-4813-975c-5fdebe5fb735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:18.391801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] The token cache is being invalidate because project 40c5ecd4aa944ae59d3f27411d6f446d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:18.392953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:18.398864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c171fbe6-03e8-4813-975c-5fdebe5fb735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:18.412285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.421533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.421533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.421743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3512/7007] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:17 2022] DELETE /identity/v3/projects/40c5ecd4aa944ae59d3f27411d6f446d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:18.435966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:18.438298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.587947 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3496/7008] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:49:18.599392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58729-5b65-49b5-b7c1-9f072ac23dd4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.599392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58729-5b65-49b5-b7c1-9f072ac23dd4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.599392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae58729-5b65-49b5-b7c1-9f072ac23dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.640287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ae58729-5b65-49b5-b7c1-9f072ac23dd4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:18.642028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ae58729-5b65-49b5-b7c1-9f072ac23dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.663457 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3513/7009] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:18.676191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.708846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aabf59-3388-4c67-92f9-710b0df1ca60 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:18.727103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:18.727918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.728973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.730084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.731312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:18.737661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:18.739423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:18.775312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198a9-7214-4d1f-b6bc-96564d52d14b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.775815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198a9-7214-4d1f-b6bc-96564d52d14b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.776256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a198a9-7214-4d1f-b6bc-96564d52d14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.791056 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3497/7010] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:18.795269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.810095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3a198a9-7214-4d1f-b6bc-96564d52d14b None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:18.815626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8241-f732-4337-a495-9a2faecd2afa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:18.815772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3a198a9-7214-4d1f-b6bc-96564d52d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.818997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:18.819982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.821118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.821472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.822243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:18.825299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:18.879886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3514/7011] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:49:18.881136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.881418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.881690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.901155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:18.905533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.918407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3515/7012] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:18.919334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.920630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:18.973147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3498/7013] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:49:18.974242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.978951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:19.060672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c387-71ee-4560-b79c-2d32c3c661b9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.065128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:19.115964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1c3f9-0bc1-4a72-94db-20931e50cfec admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.133820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.137143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.137420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.137700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.175073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.175073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.175073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.175073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.220597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.226646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.240934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3499/7014] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:19.241874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:19.264096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.266487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.276016 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3516/7015] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:49:19.388223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baee67-518f-4c21-ae84-85c1ca02186e service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.401245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.402435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.402708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.402985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.403637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.410094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.506664 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3500/7016] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:19 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:19.512162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:19.550851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890de465-ce3b-4f5c-a3af-531dbb5dd13c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.560734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.561465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.561954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.562566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.564862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.569889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.587785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:19.590450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:19.594809 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3517/7017] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:19.603306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d58aa-9b8a-4f0c-9b61-3b1df43a53d4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.611103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.611724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.612001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.612271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.612922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.614538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaca260-fb70-49e3-8bb9-390e28e3bff8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.632541 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3501/7018] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:19.632804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:19.647601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031fc99-926d-49b6-b434-f92ac66de2bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.654347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.655461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.655971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.656406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] PATH_INFO: `/v3/projects/c4d61e42719a44a2b62526af02f6c91c/users/b372095d1c63441d9ea54a488a8a173f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.677656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d61e42719a44a2b62526af02f6c91c, user_id=b372095d1c63441d9ea54a488a8a173f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.683764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:19.811498 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3518/7019] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:19 2022] PUT /identity/v3/projects/c4d61e42719a44a2b62526af02f6c91c/users/b372095d1c63441d9ea54a488a8a173f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:19.813272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.813650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.814772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.827482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:19.829535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:19.851757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] MFA Rules not processed for user `b372095d1c63441d9ea54a488a8a173f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:19.853088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:19.942046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a029fc-710b-48aa-b0ef-07d383f2877f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:19.957501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:19.957501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:19.957501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:19.957501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] PATH_INFO: `/v3/users/132dde43979f4432ae238289f788601f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:19.957839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132dde43979f4432ae238289f788601f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:19.959602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:20.001754 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3502/7020] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:20.016251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:20.019697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:20.123824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441f6e3-a92e-4b9b-b2f9-8482d88a0eb7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:20.127477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:20.128203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.128485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.128754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.138061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:20.139513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a49d1-dac8-45f2-9d15-ea98dfeaf96a service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:20.150117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3503/7021] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:20.211888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132dde43979f4432ae238289f788601f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:20.212547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132dde43979f4432ae238289f788601f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:20.364762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132dde43979f4432ae238289f788601f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:20.394271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132dde43979f4432ae238289f788601f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:20.398751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-860fba15-e109-4de0-9c97-7016d1202462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132dde43979f4432ae238289f788601f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:20.413743 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3519/7022] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:19 2022] DELETE /identity/v3/users/132dde43979f4432ae238289f788601f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:20.418583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.418899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.419205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.440442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:20.441675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:20.514458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.515040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.515040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.560831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] MFA Rules not processed for user `45a9564cb2e2487d87f9d7f0d75f80b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:20.562371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:20.600439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3504/7023] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:49:20.611299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:20.612853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:20.648815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3520/7024] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:20.753698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceba5b-733f-4962-9a89-d20eb3ff25cf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:20.758335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:20.758996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.759280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.759564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.774189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:20.776112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd7c55-eaf2-4633-a719-7481f5b0f8a6 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:20.788517 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3505/7025] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:49:20.799706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:21.272483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:21.273953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:21.299267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890c79-7abb-430c-944f-123f7bab1802 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:21.310280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:21.310973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:21.311259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:21.311540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] PATH_INFO: `/v3/users/b372095d1c63441d9ea54a488a8a173f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:21.319423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b372095d1c63441d9ea54a488a8a173f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:21.323618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:21.607297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b372095d1c63441d9ea54a488a8a173f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:21.608122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b372095d1c63441d9ea54a488a8a173f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:21.715995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b372095d1c63441d9ea54a488a8a173f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:21.740170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b372095d1c63441d9ea54a488a8a173f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:21.741029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b372095d1c63441d9ea54a488a8a173f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:21.798288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3521/7026] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:21 2022] DELETE /identity/v3/users/b372095d1c63441d9ea54a488a8a173f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:21.803792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:21.804337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:21.804337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:21.853598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:21.860163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:22.002105 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3506/7027] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:22.039081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:22.040670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:22.116280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.198981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:22.200437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:22.222507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ac1b9-b812-4d6a-8e2f-984e2f118c86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:22.233101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80278f4-839f-4325-a8c1-26019cade059 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:22.239263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:22.239827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:22.240113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:22.240390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:22.243800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:22.244448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:22.244728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:22.245536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] PATH_INFO: `/v3/projects/105e26ee2d944709870d0a3b2c607f88` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:22.256727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105e26ee2d944709870d0a3b2c607f88)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:22.262189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:22.286559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:22.288087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141d9f4-ec81-4833-ba3d-801b8aaaab73 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:22.291121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:22.316864 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3522/7028] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:22.497343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105e26ee2d944709870d0a3b2c607f88', 'request_id': 'req-4bb2d888-8184-427b-8716-073836dbce19'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:22.605637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105e26ee2d944709870d0a3b2c607f88', 'request_id': 'req-4bb2d888-8184-427b-8716-073836dbce19'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:22.614269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105e26ee2d944709870d0a3b2c607f88', 'request_id': 'req-4bb2d888-8184-427b-8716-073836dbce19'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:22.637911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] The token cache is being invalidate because project 105e26ee2d944709870d0a3b2c607f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:22.639775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:22.643892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4bb2d888-8184-427b-8716-073836dbce19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:22.648182 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3507/7029] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:22 2022] DELETE /identity/v3/projects/105e26ee2d944709870d0a3b2c607f88 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:22.653586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:22.654449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:22.657188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:22.691201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:22.693247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:22.845359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3523/7030] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:22.852798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:22.853885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:22.854918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:22.891693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:22.893023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:22.913984 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3508/7031] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:22.918679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:22.939574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5ef7-e911-4547-81fd-665600927fd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:22.954447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:22.955148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:22.955614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:22.955903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:22.956669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:22.956856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:22.961712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:22.993843 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3524/7032] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:22.999101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.011592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cc0cf-fa20-4624-b77b-84dccb916716 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:23.019322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:23.019964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.027138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.027426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.028141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:23.030117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:23.186456 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3509/7033] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:22 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:23.190531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.241992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9e12-f7b5-42fe-ab4a-6fb197a012b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:23.364402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.367520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:23.533100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:23.538492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.539713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.540544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.543482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:23.546650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:23.586024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60107-fe7f-44ec-9722-5cddfdb605e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:23.593880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:23.594929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.595450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.595953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] PATH_INFO: `/v3/projects/c4d61e42719a44a2b62526af02f6c91c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.597363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d61e42719a44a2b62526af02f6c91c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:23.600256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:23.643876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:23.704524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3525/7034] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:23 2022] POST /identity/v3/users => generated 293 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:23.710907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.777427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d971386-5751-4ac5-9e7a-6cca1713886b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:23.800083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d61e42719a44a2b62526af02f6c91c', 'request_id': 'req-de96e735-3bf3-46c3-a568-889892694fd9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:23.902576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d61e42719a44a2b62526af02f6c91c', 'request_id': 'req-de96e735-3bf3-46c3-a568-889892694fd9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:23.917056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d61e42719a44a2b62526af02f6c91c', 'request_id': 'req-de96e735-3bf3-46c3-a568-889892694fd9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:23.934281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] The token cache is being invalidate because project c4d61e42719a44a2b62526af02f6c91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:23.934964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:23.935865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-de96e735-3bf3-46c3-a568-889892694fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:23.942001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:23.942001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.942001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.942001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.942419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:23.942847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:23.944127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3510/7035] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:23 2022] DELETE /identity/v3/projects/c4d61e42719a44a2b62526af02f6c91c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:23.947006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac126-d83e-4b13-8c60-48a2a118f534 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.948873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac126-d83e-4b13-8c60-48a2a118f534 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.949395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac126-d83e-4b13-8c60-48a2a118f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.962479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3526/7036] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:23.966404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.971327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:24.006051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286425-c375-4304-a07f-05e86b78f1de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.021088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.021967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.022257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.022585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.024358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.027944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.038556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-039ac126-d83e-4b13-8c60-48a2a118f534 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:24.041590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-039ac126-d83e-4b13-8c60-48a2a118f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:24.056802 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3511/7037] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:24.066435 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3527/7038] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:24.068082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.068933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.069465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.070362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.093334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ab2ea-1479-4c47-ae4a-b8fedadb742b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.096550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:24.099360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:24.100677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.101418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.101706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.101982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] PATH_INFO: `/v3/projects/d716ff0765d1471abbc89b259067f02a/users/b8a2e1699bcd4023b81a6235b1505203/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.115129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3512/7039] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:24.121235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.136265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d716ff0765d1471abbc89b259067f02a, user_id=b8a2e1699bcd4023b81a6235b1505203, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.137297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe346-f299-4a9f-ad70-3cc7fd67f6b8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.138932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c7797-b0a5-4ad1-b32e-1f15b65c53b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.148909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.149656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.153125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.153125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.153125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:24.153125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.154386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.198676 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3513/7040] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:24.201308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.217742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6783d3-e959-4c0b-a84b-9c89b5e19cff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.227855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.229138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.245852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.250384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.250384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.250637 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3528/7041] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:24 2022] PUT /identity/v3/projects/d716ff0765d1471abbc89b259067f02a/users/b8a2e1699bcd4023b81a6235b1505203/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:24.253056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.263069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.263441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.263632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.331052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] MFA Rules not processed for user `b8a2e1699bcd4023b81a6235b1505203`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:24.332553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:24.380129 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3514/7042] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:24.384095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.500107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:24.515506 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3529/7043] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:24.528900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.642326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6c401-731a-4973-b6eb-1ce2861f8c0f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.668071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.668071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.668403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.668502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.669083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.679724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.707755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf1b0-e55e-4784-8dd4-c5f07f56a403 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.721257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.721892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.722354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.723478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.726247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.736461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.804769 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3515/7044] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/users => generated 296 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:24.809712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.837187 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3530/7045] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/projects => generated 383 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:24.841061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.856081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99185c3-3e6f-4ff2-97e9-3ffa2a36aacb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.997887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db2a81-f1e4-4a9b-b311-c06ba73d87a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.021197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.023449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.025126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.025659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.027844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.035233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.057204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.060605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.061885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.062410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.065401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.088109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.110286 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3516/7046] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:25.113705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.127350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834c98a-c560-4c56-8c75-553ccd19dae2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.133786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.134312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.134733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.135197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.135898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.137998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.154094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3517/7047] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:25.158854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.191230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7d35e-0296-4001-8c3a-f7ccfe3defde admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.198969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.200061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.200674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.201096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] PATH_INFO: `/v3/projects/650a0cbd64a84918981881a2858516f2/users/965d5fe0b22c45218ee87e5b7fae24c7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.215129 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3531/7048] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/users => generated 298 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:49:25.219698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.227840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650a0cbd64a84918981881a2858516f2, user_id=965d5fe0b22c45218ee87e5b7fae24c7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.231198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616326aa-f58f-4be5-aa32-0b59784d7970 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.252481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e068a-94c7-42af-ab59-3122d0267535 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.257946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.258784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.259166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.259539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.260343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.262738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.320484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3532/7049] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:25.325028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.387670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3518/7050] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:25 2022] PUT /identity/v3/projects/650a0cbd64a84918981881a2858516f2/users/965d5fe0b22c45218ee87e5b7fae24c7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:25.387984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a05498-71ca-40b1-9d13-3338f222827f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.390128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.390478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.390783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.457154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:25.509803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] MFA Rules not processed for user `965d5fe0b22c45218ee87e5b7fae24c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:25.516256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:25.624779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.625496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.626001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.626315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] PATH_INFO: `/v3/projects/66f70432009445d89d99d8f0f91715db/users/c1894314ac3f46a78f1d9f9bc4d75f87/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.672968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f70432009445d89d99d8f0f91715db, user_id=c1894314ac3f46a78f1d9f9bc4d75f87, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.675677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.720658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3519/7051] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:25.728450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.756702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da06a4-c97e-4a89-b8bf-a56a10f02520 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:25.770045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:25.770361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:25.772693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:25.772962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:25.774409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:25.782570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:25.789847 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3533/7052] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:25 2022] PUT /identity/v3/projects/66f70432009445d89d99d8f0f91715db/users/c1894314ac3f46a78f1d9f9bc4d75f87/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:25.794656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:25.910420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3520/7053] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:25 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:25.911501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.059837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3eee-9d61-4e5c-8e80-ca9cfaa89a15 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.133036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.169225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955024ec-c19e-49e5-8c8f-42f53dcefcf4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.189356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.189984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.190269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.190537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.192720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:26.194819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.194989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:26.195842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.196335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.196833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.197703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:26.199925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:26.247390 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3534/7054] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:26.250948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.280514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb58c-d434-4220-864e-fddc44295786 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.290573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.293005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.293515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.294009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] PATH_INFO: `/v3/projects/66f70432009445d89d99d8f0f91715db/users/c1894314ac3f46a78f1d9f9bc4d75f87/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.297130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f70432009445d89d99d8f0f91715db, user_id=c1894314ac3f46a78f1d9f9bc4d75f87, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:26.300902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600a6db-4c3e-406a-99d6-e8e2e053e719 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:26.329392 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3521/7055] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:25 2022] POST /identity/v3/users => generated 302 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:26.339079 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3535/7056] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:26 2022] PUT /identity/v3/projects/66f70432009445d89d99d8f0f91715db/users/c1894314ac3f46a78f1d9f9bc4d75f87/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:26.341654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.344851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.345150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.345431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.363507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a144-8d6e-458f-970c-50ab8b57c1c0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.420006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] MFA Rules not processed for user `c1894314ac3f46a78f1d9f9bc4d75f87`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:26.422993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:26.446603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.447444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.447723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.447991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.449466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:26.451814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:26.482694 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3522/7057] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:26.484786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.524497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe3d6e-9cc5-47ba-8042-07fe774c018e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.532039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.533123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.533631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.534117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] PATH_INFO: `/v3/projects/3fb18f9125294f97a12c5179d655afc4/users/a40fe88787814e74b0c15d76960dd213/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.571608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb18f9125294f97a12c5179d655afc4, user_id=a40fe88787814e74b0c15d76960dd213, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:26.576493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:26.617465 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3536/7058] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:26.639857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.641962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:26.729154 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3523/7059] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:26 2022] PUT /identity/v3/projects/3fb18f9125294f97a12c5179d655afc4/users/a40fe88787814e74b0c15d76960dd213/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:26.732717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.940101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9a91-3905-459f-a0c4-5165f241c596 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.035680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da841d46-5c45-41ea-80ad-d778cd5460e3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.057178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.058602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.059580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.059873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.060546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.065369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.100460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3524/7060] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:27.101790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.113631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.114471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.114802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.115132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.134667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d80b9f-0a41-46aa-abeb-ca0dac799246 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.144989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.146326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.146668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.146899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] PATH_INFO: `/v3/projects/3fb18f9125294f97a12c5179d655afc4/users/a40fe88787814e74b0c15d76960dd213/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.150287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb18f9125294f97a12c5179d655afc4, user_id=a40fe88787814e74b0c15d76960dd213, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.157233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4d51-4840-4673-9f9a-664958a3bc54 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.205679 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3525/7061] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:27 2022] PUT /identity/v3/projects/3fb18f9125294f97a12c5179d655afc4/users/a40fe88787814e74b0c15d76960dd213/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:27.207400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.207692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.207966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.286862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] MFA Rules not processed for user `a40fe88787814e74b0c15d76960dd213`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:27.301874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:27.302006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.303801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.322178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3537/7062] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:49:27.322730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.384041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.547360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3526/7063] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:27.758069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.787488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.791107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:27.810904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.820728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef808fa-51f5-4e9b-a933-da7d7ebeb2f8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.967074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.967701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.968030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.968244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:28.082202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:28.084157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:28.102052 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3538/7064] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:28.361744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:28.363811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:28.433986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:28.536159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2801d78-c9e5-499c-888e-ed4c6801dfcc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:28.548849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:28.549526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:28.554167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:28.554167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] PATH_INFO: `/v3/users/5a86d0498c7740d796d0f85e97bcb42c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:28.555756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a86d0498c7740d796d0f85e97bcb42c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:28.557825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:28.824501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a86d0498c7740d796d0f85e97bcb42c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:28.825674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a86d0498c7740d796d0f85e97bcb42c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:28.919544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a86d0498c7740d796d0f85e97bcb42c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:28.941553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a86d0498c7740d796d0f85e97bcb42c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:28.943003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-586b58ed-02b1-4323-a9ae-e2c7f966c12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a86d0498c7740d796d0f85e97bcb42c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:28.978687 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3527/7065] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:28 2022] DELETE /identity/v3/users/5a86d0498c7740d796d0f85e97bcb42c => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:29.184564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:29.211463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60eff9-da39-4278-a105-c62db56ef0be service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:29.314010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:29.315610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:29.316045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:29.316506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:29.325096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:29.392631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:29.446996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:29.449639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:29.461795 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3539/7066] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:29.623558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:29.624476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:29.625511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:29.675263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] MFA Rules not processed for user `57e7b5ca415b4678a969751d458eb7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:29.677197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:29.820796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:29.835671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3528/7067] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:29.840432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:29.841979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:29.925438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:29.927342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:29.976450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894ad5-71e6-472e-8f58-17e33cd77088 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:29.983179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:29.984018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:29.984994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:29.985608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:29.986551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:29.991004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.062054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e453bc-256e-4d05-ba8b-b9e74de5ef3d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.067832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.069257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.069819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.070306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] PATH_INFO: `/v3/projects/fa02250cc09843a5b5c303a97a515358` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.073550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa02250cc09843a5b5c303a97a515358)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.075878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.117320 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3540/7068] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:29 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:30.121293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.223349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c9a65-6101-4d13-98c9-aac3576250bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.224947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa02250cc09843a5b5c303a97a515358', 'request_id': 'req-8d129436-a134-4f25-add0-f03705cce370'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:30.307412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa02250cc09843a5b5c303a97a515358', 'request_id': 'req-8d129436-a134-4f25-add0-f03705cce370'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:30.315000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa02250cc09843a5b5c303a97a515358', 'request_id': 'req-8d129436-a134-4f25-add0-f03705cce370'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:30.327912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.339452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] The token cache is being invalidate because project fa02250cc09843a5b5c303a97a515358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:30.339870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:30.341499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.342121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.342400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.342752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.343662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d129436-a134-4f25-add0-f03705cce370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:30.344118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.350209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3529/7069] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:29 2022] DELETE /identity/v3/projects/fa02250cc09843a5b5c303a97a515358 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:30.350370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.352473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8253-5200-471e-9ebb-a0b45c1b3892 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.353299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8253-5200-471e-9ebb-a0b45c1b3892 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.353756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8253-5200-471e-9ebb-a0b45c1b3892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.402951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c6cd8253-5200-471e-9ebb-a0b45c1b3892 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:30.404408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c6cd8253-5200-471e-9ebb-a0b45c1b3892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:30.420995 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3530/7070] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:49:30.429336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.429757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.430133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.457552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:30.459622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:30.469434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3531/7071] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:30.473871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.498286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839287b-888b-4560-b7bb-26ff9b59d46a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.502598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3541/7072] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:30 2022] POST /identity/v3/users => generated 297 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:30.506782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.507600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.508851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:30.509693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.510543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.511634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.512483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:30.512967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.515707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.535692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db1bc-af6e-4ca1-a81d-398f45924b80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.546986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.547738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.548075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.548550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.559837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.559837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.569646 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3532/7073] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:30.572680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.578347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3542/7074] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:30.591920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.608271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4348-4ed5-450c-98d9-9f51e9c19587 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.625052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43695be-dd38-40ab-b87b-a753aeedf8c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.625678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.631843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.632109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.632811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.633098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.633291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.633571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.633854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] PATH_INFO: `/v3/projects/a2dc4e291df64e1990980ec66609a075/users/c300162f199341cda39c94f6e758e7ee/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.638595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.646269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.676183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dc4e291df64e1990980ec66609a075, user_id=c300162f199341cda39c94f6e758e7ee, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.679568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.796987 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3543/7075] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:30 2022] PUT /identity/v3/projects/a2dc4e291df64e1990980ec66609a075/users/c300162f199341cda39c94f6e758e7ee/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:30.800557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.825325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3533/7076] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:30 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:30.826272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.934408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2302b-067b-4d03-8ee3-61e1ea6a8cb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.991219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f0e33-8894-458d-8522-966bd912dc22 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.008210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.009164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.009661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.010149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.011100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.013999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.058205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.059284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.059778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.060252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.061239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.063576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.078401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3544/7077] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:31.083318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.103175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371014-a2b4-4a22-9a65-8db177d903eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.127902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.129532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.129532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.129766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] PATH_INFO: `/v3/projects/a2dc4e291df64e1990980ec66609a075/users/c300162f199341cda39c94f6e758e7ee/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.143842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dc4e291df64e1990980ec66609a075, user_id=c300162f199341cda39c94f6e758e7ee, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.144491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3534/7078] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:30 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:31.148356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.157470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.177120 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3545/7079] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:31 2022] PUT /identity/v3/projects/a2dc4e291df64e1990980ec66609a075/users/c300162f199341cda39c94f6e758e7ee/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:31.201712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4989b1-0db5-4639-bdce-77e215dc5b7e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.286083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:31.356240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.357274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.357697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.358094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.358919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.362469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.387861 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3535/7080] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:31.392479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.405539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776b640-4e7e-4715-8099-a948512e1a31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.413227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.414187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.414575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.414978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.415740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.417489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f41b6-ba22-4b64-8a15-56f1aa595a59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.434661 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3546/7081] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:31.436007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.449748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b48ae-46fd-4e2b-a0f2-af0e31fe0b80 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.461675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.462776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.463346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.463776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] PATH_INFO: `/v3/projects/389dee36f2c34cea9171eb29e6987b9e/users/63d2bcde29ae4421aae1533bef37f4d1/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.486448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=389dee36f2c34cea9171eb29e6987b9e, user_id=63d2bcde29ae4421aae1533bef37f4d1, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.487281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.610206 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3536/7082] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:31 2022] PUT /identity/v3/projects/389dee36f2c34cea9171eb29e6987b9e/users/63d2bcde29ae4421aae1533bef37f4d1/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:31.622813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d1e6-74f2-4246-9dd3-c94689dc035f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.623297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d1e6-74f2-4246-9dd3-c94689dc035f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.623725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209d1e6-74f2-4246-9dd3-c94689dc035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.702358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e209d1e6-74f2-4246-9dd3-c94689dc035f None None] MFA Rules not processed for user `63d2bcde29ae4421aae1533bef37f4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:31.705077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e209d1e6-74f2-4246-9dd3-c94689dc035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:31.768416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:31.913925 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3547/7083] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:31.924511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.926566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:32.065852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40cc2-fa53-4ae8-86f5-407a9eadbf9d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:32.070025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:32.070755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:32.071108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:32.071456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:32.094997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:32.096638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:32.114828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3537/7084] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:35.350135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:35.352004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:35.356409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:35.429521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] MFA Rules not processed for user `63d2bcde29ae4421aae1533bef37f4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:35.430981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:35.445318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3548/7085] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:35.664968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:35.671397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:35.810748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:35.832045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ab09-ef37-4514-9a9d-82a0852ce420 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:35.843233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:35.847007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:35.847007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:35.847007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:35.850094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:35.992567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:35.996860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:36.025660 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3538/7086] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:41.132630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:41.135093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:41.250234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebc54e-63aa-4844-8e9f-f8e4ed61d2ea None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:41.263032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:41.266660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:41.267303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:41.267895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:41.270020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:41.290395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:41.293635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ba2a3-e06d-4217-9eba-e3f116f09e54 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:41.330633 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3549/7087] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:45.627102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:45.629295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:45.747792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f6e2-2381-42dd-8181-3b679653d696 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:45.763332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:45.765106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:45.765106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:45.765106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] PATH_INFO: `/v3/users/965d5fe0b22c45218ee87e5b7fae24c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:45.766551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965d5fe0b22c45218ee87e5b7fae24c7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:45.770044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:46.056147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965d5fe0b22c45218ee87e5b7fae24c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:46.057606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965d5fe0b22c45218ee87e5b7fae24c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:46.169124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965d5fe0b22c45218ee87e5b7fae24c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:46.184550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965d5fe0b22c45218ee87e5b7fae24c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:46.185599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965d5fe0b22c45218ee87e5b7fae24c7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:46.202610 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3539/7088] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:45 2022] DELETE /identity/v3/users/965d5fe0b22c45218ee87e5b7fae24c7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:46.204412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:46.205390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:46.205929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:46.230858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:46.232494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:46.375944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3550/7089] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:46.376433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:46.377942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:46.409142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:46.510839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abea5-4ed2-421f-8a6b-5972396d0890 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:46.515943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:46.516577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:46.517458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:46.519054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:46.537341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:46.539284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:46.552291 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3540/7090] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:47.038018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:47.040819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:47.063462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac166-7624-4002-8ba1-ab8543093513 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:47.073939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:47.074580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:47.074907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:47.078366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] PATH_INFO: `/v3/projects/650a0cbd64a84918981881a2858516f2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:47.078366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650a0cbd64a84918981881a2858516f2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:47.081647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:47.217585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:47.238180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650a0cbd64a84918981881a2858516f2', 'request_id': 'req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.381420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650a0cbd64a84918981881a2858516f2', 'request_id': 'req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.389947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650a0cbd64a84918981881a2858516f2', 'request_id': 'req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.404421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] The token cache is being invalidate because project 650a0cbd64a84918981881a2858516f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:47.405087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.406077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.408121 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3551/7091] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:47 2022] DELETE /identity/v3/projects/650a0cbd64a84918981881a2858516f2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:47.412791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:47.422835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d668ec-777a-4f1f-b143-feba912c6ca4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:47.498466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:47.499142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:47.510910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:47.510910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] PATH_INFO: `/v3/users/a40fe88787814e74b0c15d76960dd213` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:47.510910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40fe88787814e74b0c15d76960dd213)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:47.510910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:47.884083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40fe88787814e74b0c15d76960dd213'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.884772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40fe88787814e74b0c15d76960dd213'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:47.982791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40fe88787814e74b0c15d76960dd213'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:48.011192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40fe88787814e74b0c15d76960dd213'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:48.011998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57b4cc84-c4ce-4cdc-8efe-107ac670ae45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40fe88787814e74b0c15d76960dd213'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:48.038231 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3541/7092] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:47 2022] DELETE /identity/v3/users/a40fe88787814e74b0c15d76960dd213 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:49.182807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:49.185812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:49.229020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91fc9-6fe1-4e16-8dc1-a65215fba751 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:49.337693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:49.339344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:49.340201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:49.340888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] PATH_INFO: `/v3/projects/3fb18f9125294f97a12c5179d655afc4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:49.343479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb18f9125294f97a12c5179d655afc4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:49.345856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:49.581240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb18f9125294f97a12c5179d655afc4', 'request_id': 'req-f2700fa6-233f-41c2-8c1c-1afd37241b90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:49.724422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb18f9125294f97a12c5179d655afc4', 'request_id': 'req-f2700fa6-233f-41c2-8c1c-1afd37241b90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:49.732628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb18f9125294f97a12c5179d655afc4', 'request_id': 'req-f2700fa6-233f-41c2-8c1c-1afd37241b90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:49.764421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] The token cache is being invalidate because project 3fb18f9125294f97a12c5179d655afc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:49.765178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:49.766471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2700fa6-233f-41c2-8c1c-1afd37241b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:49.771096 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3552/7093] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:49 2022] DELETE /identity/v3/projects/3fb18f9125294f97a12c5179d655afc4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:49.776325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:49.776842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:49.776950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:49.832124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:49.833794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:49.958761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:50.072508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3542/7094] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:50.076632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.078715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.079343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.142235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:50.145932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:50.172530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3553/7095] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:50.176947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.200621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a99c55-b8e6-4bc1-a6df-f41cb12c0822 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.214937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.216020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.216538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.217138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.218068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:50.218771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:50.221044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:50.246059 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3543/7096] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:50.252464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.263951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028acccb-dfdf-41f0-a5c9-1613afa0f612 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.275221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.275867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.276416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.276898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.277953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:50.281011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:50.435827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3554/7097] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:50 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:50.439245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.461930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85871f5-1f52-43c5-82c3-b44d3d755dfa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.598203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.598865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.599148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.599423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.600065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:50.602025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eb5fb-ceff-4d0c-8925-055ed78171e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:50.756419 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3544/7098] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:50 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:50.761653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.780518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5cd69-ed57-43e5-a086-088433fe107b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.788993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.789989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.790445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.792116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.793755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:50.801668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:50.822811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.823644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.823929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.835195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3555/7099] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:50.841216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.866773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92103a-ef95-4b9f-a431-52c75a2ca2a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.880279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.882728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.882728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.882728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:50.882728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:50.886064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:50.888877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] MFA Rules not processed for user `c300162f199341cda39c94f6e758e7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:50.894545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:50.913162 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3556/7100] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:49:50.918246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:50.932276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:50.944300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39562eae-734f-4ae2-a405-6d55ab2c0ee8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:50.959650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:50.963011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:50.964415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:50.964914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] PATH_INFO: `/v3/projects/9637f99907194c9297b4b56e453fba9e/users/adb557d4552445cd9605e221348a38b3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:51.001813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9637f99907194c9297b4b56e453fba9e, user_id=adb557d4552445cd9605e221348a38b3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:51.004765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3693-7f14-4734-bb46-77fe0db99ff4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:51.078209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3545/7101] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:51.086422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:51.088157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:51.114596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3557/7102] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:50 2022] PUT /identity/v3/projects/9637f99907194c9297b4b56e453fba9e/users/adb557d4552445cd9605e221348a38b3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:51.126376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:51.127351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:51.127846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:51.212679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] MFA Rules not processed for user `adb557d4552445cd9605e221348a38b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:51.215758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:51.268406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e8e0-79b1-4aea-a0e4-b59a7815d494 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:51.328530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3558/7103] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:51.404841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:51.405486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:51.405765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:51.406036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:51.413334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:51.417179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:51.526779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:51.528492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:51.546426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf26a2-f531-4d2d-b97c-0f10d9c788dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:51.555161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:51.555724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:51.558254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:51.558254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:51.561929 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3546/7104] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:51.579532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:51.583725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:51.609793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:51.613332 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3559/7105] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:49:52.142344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:52.144457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:52.402648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190016-7205-4ebc-ac1b-5dfc6700dfe2 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:52.423662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:52.424324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:52.424608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:52.424889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:52.430921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:52.461483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:52.464986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20b0b-3264-4974-8151-9aa87c438aa6 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:52.493966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3547/7106] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:52.930757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:52.948221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:52.950354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:53.112233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174a921-39af-4346-abb4-ec93bdfd09d7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:53.118440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:53.120042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:53.120880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:53.120880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] PATH_INFO: `/v3/users/b8a2e1699bcd4023b81a6235b1505203` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:53.122519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a2e1699bcd4023b81a6235b1505203)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:53.124865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:53.147887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:53.377964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a2e1699bcd4023b81a6235b1505203'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:53.378840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a2e1699bcd4023b81a6235b1505203'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:53.527307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a2e1699bcd4023b81a6235b1505203'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:53.547154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a2e1699bcd4023b81a6235b1505203'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:53.547969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a2e1699bcd4023b81a6235b1505203'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:53.601769 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3560/7107] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:52 2022] DELETE /identity/v3/users/b8a2e1699bcd4023b81a6235b1505203 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:53.606861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:53.607475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:53.607980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:53.633821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:53.635334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:53.759197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3548/7108] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:53.799970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:53.801495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:53.911376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf1aa-50a7-4ae1-97fa-f05f57840e4f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:53.916260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:53.916904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:53.917218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:53.917556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:53.929649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:53.931571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:53.944460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3561/7109] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:49:55.005039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:55.007012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:55.043249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c84f4-11dc-442e-931f-add3ca21a869 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:55.052645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:55.053326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:55.053611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:55.053893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] PATH_INFO: `/v3/projects/d716ff0765d1471abbc89b259067f02a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:55.056778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d716ff0765d1471abbc89b259067f02a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:55.059389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:55.265094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd716ff0765d1471abbc89b259067f02a', 'request_id': 'req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.348962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd716ff0765d1471abbc89b259067f02a', 'request_id': 'req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.363432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd716ff0765d1471abbc89b259067f02a', 'request_id': 'req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.391447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] The token cache is being invalidate because project d716ff0765d1471abbc89b259067f02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:55.397776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.397776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.397776 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3549/7110] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:55 2022] DELETE /identity/v3/projects/d716ff0765d1471abbc89b259067f02a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:55.400371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:55.416655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d480556-ff78-4636-8f08-ae80613343d7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:55.524919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:55.525940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:55.526994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:55.527679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] PATH_INFO: `/v3/users/c1894314ac3f46a78f1d9f9bc4d75f87` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:55.529276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1894314ac3f46a78f1d9f9bc4d75f87)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:55.532468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:55.802009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1894314ac3f46a78f1d9f9bc4d75f87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.809809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1894314ac3f46a78f1d9f9bc4d75f87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.941517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1894314ac3f46a78f1d9f9bc4d75f87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.969658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1894314ac3f46a78f1d9f9bc4d75f87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:55.970438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efe906b6-65c1-4162-acc5-f6dcb4b66518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1894314ac3f46a78f1d9f9bc4d75f87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:56.051919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3562/7111] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:49:55 2022] DELETE /identity/v3/users/c1894314ac3f46a78f1d9f9bc4d75f87 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:49:56.192256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:57.222813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:57.224827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:57.248538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7ae48-1b78-42db-8ccd-c8e5ddeff3fe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:57.357284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:57.358285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:57.358415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:57.358716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] PATH_INFO: `/v3/projects/66f70432009445d89d99d8f0f91715db` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:57.360409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f70432009445d89d99d8f0f91715db)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:57.364069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:57.557135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:57.583331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f70432009445d89d99d8f0f91715db', 'request_id': 'req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:57.680956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f70432009445d89d99d8f0f91715db', 'request_id': 'req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:57.690247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f70432009445d89d99d8f0f91715db', 'request_id': 'req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:57.731751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] The token cache is being invalidate because project 66f70432009445d89d99d8f0f91715db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:49:57.731894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:57.733202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8192b41b-382b-4d82-8b7a-68bd9ee88b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:49:57.737224 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3550/7112] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:49:57 2022] DELETE /identity/v3/projects/66f70432009445d89d99d8f0f91715db => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:57.743984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:57.745509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:57.746735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:57.778277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:57.779816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:58.025301 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3563/7113] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:58.026595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.029198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.029198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.055270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:58.057366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:58.076982 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3551/7114] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:58.082665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.119116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685c4e-e67b-470e-836d-4538ae76cdbc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.126472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.128768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.129052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.129320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.130048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:58.130355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.132529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.154717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.161869 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3564/7115] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:58.167763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833985a-a246-45ff-8975-5ed73fac3029 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.175669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.177360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.177814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.178246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.179140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.182441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.344987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3552/7116] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:49:58 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:58.348260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.362498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e859c5-904c-48da-b275-ef8e16fab192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.463692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.464493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.464778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.465050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.466467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.469029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.618463 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3565/7117] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:49:58 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:58.623617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.640948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92331c-213a-4b03-b6d0-877b323f7539 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.653764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.655293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.655820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.656702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.657652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.659820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.680624 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3553/7118] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:58.685265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.697108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68a06-6626-46b0-95f2-752400699b35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.702836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.703463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.703742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.704018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.710647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.710647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11f326-17cc-42c9-9570-33af94958a0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.734528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3566/7119] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:49:58.738990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:58.753946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aa1c1-6dda-4556-9df2-1d0248e32bdc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:58.793547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:58.794478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.795559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.796048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] PATH_INFO: `/v3/projects/b91e78d220f7403eb479cf33b194a5e8/users/7a9608e51f7a413baee06dcf57662ff5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:58.860773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91e78d220f7403eb479cf33b194a5e8, user_id=7a9608e51f7a413baee06dcf57662ff5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:58.864799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:58.962638 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3554/7120] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:49:58 2022] PUT /identity/v3/projects/b91e78d220f7403eb479cf33b194a5e8/users/7a9608e51f7a413baee06dcf57662ff5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:58.975417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:58.976338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:58.977426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:59.021107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] MFA Rules not processed for user `7a9608e51f7a413baee06dcf57662ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:59.023473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:59.031721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:59.115417 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3567/7121] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:49:59.126778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:59.128710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:59.211593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a80c0-ea4f-4400-ba4b-ced2c68287ff admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:59.220512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:59.221591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:59.221872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:59.222143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:59.242113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:59.245018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:59.257871 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3555/7122] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:07.354848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:07.357413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:07.541832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a343-b550-4fc3-9b36-1767664e3d05 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:07.555638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:07.556604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:07.559144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:07.564944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:07.566784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:07.598050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:07.601583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153740f5-6f00-42a5-90a5-3b163cbc0e44 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:07.647445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3568/7123] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:08.306976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:08.309092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:08.414482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:08.469126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c2ec5-52b2-4187-9aa6-15d5bc870ed2 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:08.480156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:08.481735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:08.482735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:08.483405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] PATH_INFO: `/v3/users/27fe59c95f6a45e1ad98d3a85dfe46f9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:08.487205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fe59c95f6a45e1ad98d3a85dfe46f9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:08.497372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:08.891505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fe59c95f6a45e1ad98d3a85dfe46f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:08.892512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fe59c95f6a45e1ad98d3a85dfe46f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:08.959049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fe59c95f6a45e1ad98d3a85dfe46f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:08.983194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fe59c95f6a45e1ad98d3a85dfe46f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:08.983987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fe59c95f6a45e1ad98d3a85dfe46f9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:09.014147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3556/7124] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:08 2022] DELETE /identity/v3/users/27fe59c95f6a45e1ad98d3a85dfe46f9 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:09.662953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:09.663832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:09.664328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:09.700422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:09.702202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:09.821366 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3569/7125] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:09.857698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:09.860276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:09.926817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:09.928965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:10.016188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946559-ba32-4641-bcc2-96391104d65b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:10.053508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:10.054675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:10.055613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:10.055893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:10.061575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:10.097055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:10.104478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:10.112448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc46a-0d61-42a5-a36b-1be93e2f76f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:10.139749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:10.140808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:10.141313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:10.142367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] PATH_INFO: `/v3/users/adb557d4552445cd9605e221348a38b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:10.142506 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3557/7126] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:50:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:50:10.143487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:10.145885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb557d4552445cd9605e221348a38b3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:10.147474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:10.148794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:10.190481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc784-b33c-4d18-b614-0f468c932c85 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:10.197907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:10.198833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:10.199185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:10.199700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] PATH_INFO: `/v3/projects/088796f54dae4011ab52c9af5cae9a06` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:10.201438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] RBAC: Authorizing `identity:delete_project(project_id=088796f54dae4011ab52c9af5cae9a06)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:10.206264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:10.591528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb557d4552445cd9605e221348a38b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.592409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb557d4552445cd9605e221348a38b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.598137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088796f54dae4011ab52c9af5cae9a06', 'request_id': 'req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.771140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb557d4552445cd9605e221348a38b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.793524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb557d4552445cd9605e221348a38b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.794446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb557d4552445cd9605e221348a38b3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.838656 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3570/7127] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:09 2022] DELETE /identity/v3/users/adb557d4552445cd9605e221348a38b3 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:50:10.840389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:10.842183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:10.887462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088796f54dae4011ab52c9af5cae9a06', 'request_id': 'req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.890775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:10.898928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088796f54dae4011ab52c9af5cae9a06', 'request_id': 'req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.924794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] The token cache is being invalidate because project 088796f54dae4011ab52c9af5cae9a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:10.925087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.931098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4ac0679f-5055-4a5e-9d3d-b5fe24a3472d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:10.933916 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3558/7128] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:10 2022] DELETE /identity/v3/projects/088796f54dae4011ab52c9af5cae9a06 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:10.935760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:10.936220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:10.936946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:10.990825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:10.993175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:10.997614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c219a5-fc72-4db6-9730-a397785f3721 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:11.005717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:11.007740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:11.007740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:11.007740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:11.010337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:11.035115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:11.042243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:11.111017 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3571/7129] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:11.142393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:11.149630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:11.241672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3559/7130] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:11.252368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:11.266949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:11.451110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:11.504248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04ef82-eeeb-436e-962c-13be84c7e1d8 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:11.532675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:11.533675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:11.534800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:11.536839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] PATH_INFO: `/v3/users/1aa5b0358e0b4207bcabd9bccb5701e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:11.541857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa5b0358e0b4207bcabd9bccb5701e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:11.548810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:11.643358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5ab6f-1d9e-4e43-beee-b9fc831ddfa5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:11.655035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:11.661448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:11.661448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:11.661448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:11.727964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:11.731911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04874230-4560-4b4a-a9cb-bee40d7d847a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:11.773554 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3560/7131] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:11.803173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa5b0358e0b4207bcabd9bccb5701e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:11.804066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa5b0358e0b4207bcabd9bccb5701e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:11.922708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa5b0358e0b4207bcabd9bccb5701e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:11.969089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa5b0358e0b4207bcabd9bccb5701e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:11.975682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa5b0358e0b4207bcabd9bccb5701e1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:12.016066 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3572/7132] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:11 2022] DELETE /identity/v3/users/1aa5b0358e0b4207bcabd9bccb5701e1 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:12.342938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:12.343549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:12.343655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:12.384341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:12.385552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:12.493378 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3561/7133] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:12.508417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:12.514270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:12.584635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:12.587087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:12.636806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70d21-9a68-4cc3-8e30-ccbf5f147120 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:12.659210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:12.660299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:12.660583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:12.660858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:12.678838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:12.680216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:12.684953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:12.703389 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3573/7134] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:50:12.705591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:12.707904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:12.788247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0f740-9cda-4bfa-8bcd-b8d57f2b9305 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:12.819065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:12.819740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:12.820026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:12.820807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] PATH_INFO: `/v3/projects/9637f99907194c9297b4b56e453fba9e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:12.822106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9637f99907194c9297b4b56e453fba9e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:12.824692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:12.896166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b364-91cf-486f-9c13-7349eec58ff3 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:12.914737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:12.915904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:12.916721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:12.919418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] PATH_INFO: `/v3/projects/c4485bbeab8d4c8f87263e03ca641e65` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:12.938038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4485bbeab8d4c8f87263e03ca641e65)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:12.947097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:12.949533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:13.034290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9637f99907194c9297b4b56e453fba9e', 'request_id': 'req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.119026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9637f99907194c9297b4b56e453fba9e', 'request_id': 'req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.120615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4485bbeab8d4c8f87263e03ca641e65', 'request_id': 'req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.126088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9637f99907194c9297b4b56e453fba9e', 'request_id': 'req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.141121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] The token cache is being invalidate because project 9637f99907194c9297b4b56e453fba9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:13.141337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.142004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ce26a1de-96f0-49fc-b9f9-b33fd9b863b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.143857 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3562/7135] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:12 2022] DELETE /identity/v3/projects/9637f99907194c9297b4b56e453fba9e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:50:13.149098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9601fc-9cdb-4438-9fd5-512ea86345a6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.149613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9601fc-9cdb-4438-9fd5-512ea86345a6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.150085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9601fc-9cdb-4438-9fd5-512ea86345a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.176852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2c9601fc-9cdb-4438-9fd5-512ea86345a6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:13.178166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c9601fc-9cdb-4438-9fd5-512ea86345a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:13.226870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4485bbeab8d4c8f87263e03ca641e65', 'request_id': 'req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.248939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4485bbeab8d4c8f87263e03ca641e65', 'request_id': 'req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.301271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] The token cache is being invalidate because project c4485bbeab8d4c8f87263e03ca641e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:13.301858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.302734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc4fcd7a-43de-4d8a-8ee5-496aa9350344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:13.306076 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3574/7136] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:12 2022] DELETE /identity/v3/projects/c4485bbeab8d4c8f87263e03ca641e65 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:13.315714 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3563/7137] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:13.327761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc91ee-6784-4a23-969e-c3a11d457845 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.330029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc91ee-6784-4a23-969e-c3a11d457845 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.330029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc91ee-6784-4a23-969e-c3a11d457845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.333442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.333880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.335474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.383202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:13.387670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:13.403049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85cc91ee-6784-4a23-969e-c3a11d457845 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:13.406877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85cc91ee-6784-4a23-969e-c3a11d457845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:13.410552 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3564/7138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:13.420013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:13.428612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ff99-3df8-45f2-8c13-456fefe9145a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:13.429537 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3575/7139] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:13.443394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.443936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.444314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:13.444485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.445726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.446174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.446647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.449881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:13.451046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:13.453175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:13.480315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3565/7140] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:13.484665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:13.503637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cedb5a-9455-4fd4-8f43-c385b3f01574 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:13.518713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:13.529749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:13.531405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:13.531564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.532031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.532453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.535605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:13.537840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414f6e-1a3b-46c7-9d59-785e8f9356fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:13.563919 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3576/7141] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:13.568720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:13.587562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045ae75-6310-4a5d-a4c5-36aa5fed302a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:13.593397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:13.594372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.595127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.595566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.596472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:13.596941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:13.598998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:13.625034 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3577/7142] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:13.630688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:13.655412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb0db5-96a5-447a-be95-76fbeb242114 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:13.687685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:13.687685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.687685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.687685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.688009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:13.692643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:13.768595 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3566/7143] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:50:13.771290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:13.771911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:13.772508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:13.808986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:13.810258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:13.849890 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3578/7144] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:13.853367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:13.882665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:13.968569 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3567/7145] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:13.988225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.032273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5c45c-0ef0-4f12-b7c6-ea38d82307b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.032930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.033793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.034134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.034435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.035128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.037614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.108023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5177-2e83-42d2-aaea-c64f339260d3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.114044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.114700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.115116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.116653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.117314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.119764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.183662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3579/7146] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:14.183662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.184157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:14.268126 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3568/7147] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:13 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:14.269165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.290112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1426e4-3294-48f3-a80f-454f94df189e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.304338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.304976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.305256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.305530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.306204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.310319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.313242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144a0b-5015-4daf-b379-3ba111a83a13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.336235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.337214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.337715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.338756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.339998 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3569/7148] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:14.343098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.363677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed4a5-b0fa-4e64-9453-0f7a8b56add4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.379195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.380142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.380588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.381056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.382028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.383970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.389440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:14.408553 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3570/7149] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:14.412949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.430069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688dd9-0ada-428f-ae05-24663a60527a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.437650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.438556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.440336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.440887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.442058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.444742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.446101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.446873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.463556 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3571/7150] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:14.463556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.466126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3580/7151] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:50:14.468691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.487904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13855c2-85ac-4f38-aa59-ac27e58cd979 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.489743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9f316-33df-40ed-9614-89b5fc39065b service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.496093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.496781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.497246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.497675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] PATH_INFO: `/v3/projects/6fcc90548b264d3b985f8fe42b856967/users/f6ceec4548f147928550a60165191242/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.505343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.506320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.506800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.507233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.508638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.510851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.518438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcc90548b264d3b985f8fe42b856967, user_id=f6ceec4548f147928550a60165191242, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.521829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70bc7-ddc0-4943-9d27-6b0935b929d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.532073 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3572/7152] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:14.539757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.554591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac088b-6832-4035-9679-6b6caec6f997 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:14.574724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:14.575354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.575631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.575904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] PATH_INFO: `/v3/projects/39fe4d501c4347d1a15c95926035e4cc/users/48118e993f724d93a15ec0636bf27517/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.595121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fe4d501c4347d1a15c95926035e4cc, user_id=48118e993f724d93a15ec0636bf27517, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:14.597918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117be7c8-4c61-4ff1-ab7d-ac5e29e49168 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:14.705813 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3573/7153] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:14 2022] PUT /identity/v3/projects/39fe4d501c4347d1a15c95926035e4cc/users/48118e993f724d93a15ec0636bf27517/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:14.710814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.711199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.711567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.722475 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3581/7154] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:14 2022] PUT /identity/v3/projects/6fcc90548b264d3b985f8fe42b856967/users/f6ceec4548f147928550a60165191242/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:14.725156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:14.729404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:14.729404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:14.742146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:14.743568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:14.765112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] MFA Rules not processed for user `f6ceec4548f147928550a60165191242`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:14.766335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:14.890714 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3574/7155] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:14.926518 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3582/7156] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:14.961791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.963872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:14.983570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:14.986495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:15.107982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1da48-445f-4fb2-bb12-6e0b5b01c177 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:15.134946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:15.135724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:15.136062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:15.136338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:15.156064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:15.157703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ff96-2c87-4884-9c9a-63a1bb29ccdd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:15.160354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05a362-7992-4ef1-a962-89419b0c3b7e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:15.171663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:15.172281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:15.172560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:15.180233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:15.199930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:15.223982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:15.241333 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3575/7157] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:15.263132 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3583/7158] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:15.405642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:15.406300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:15.406300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:15.440034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:15.456556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:15.604462 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3576/7159] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:15.621853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:15.776008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73f4b9-5373-4a43-827f-d0cc178b44da service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:15.787385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:15.788911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:15.789439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:15.790822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:15.814082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:15.817507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:15.833268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3584/7160] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:50:16.629494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:16.631064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:16.652733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d448a-dcc2-4e79-ba4c-fc4f2dff7fc2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:16.661594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:16.663200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:16.663702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:16.663973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] PATH_INFO: `/v3/users/57e7b5ca415b4678a969751d458eb7b6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:16.665269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e7b5ca415b4678a969751d458eb7b6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:16.667620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:16.680257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:16.975825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e7b5ca415b4678a969751d458eb7b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:16.977548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e7b5ca415b4678a969751d458eb7b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:17.101046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e7b5ca415b4678a969751d458eb7b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:17.119087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e7b5ca415b4678a969751d458eb7b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:17.120237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e7b5ca415b4678a969751d458eb7b6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:17.137485 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3577/7161] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:16 2022] DELETE /identity/v3/users/57e7b5ca415b4678a969751d458eb7b6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:17.553669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:17.859250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:17.873361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ebb5-642d-4f06-abb2-60669702fa0c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:18.049629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:18.063513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:18.065310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:18.065771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] PATH_INFO: `/v3/projects/3dbd61c6f9084e90a3e30ae8c9dbdb05` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:18.069079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbd61c6f9084e90a3e30ae8c9dbdb05)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:18.073159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:18.232419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbd61c6f9084e90a3e30ae8c9dbdb05', 'request_id': 'req-80379e2b-b70d-4ee4-8199-29b9e20177c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:18.393436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbd61c6f9084e90a3e30ae8c9dbdb05', 'request_id': 'req-80379e2b-b70d-4ee4-8199-29b9e20177c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:18.403864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbd61c6f9084e90a3e30ae8c9dbdb05', 'request_id': 'req-80379e2b-b70d-4ee4-8199-29b9e20177c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:18.444199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] The token cache is being invalidate because project 3dbd61c6f9084e90a3e30ae8c9dbdb05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:18.444496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:18.445711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:18.450670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3585/7162] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:17 2022] DELETE /identity/v3/projects/3dbd61c6f9084e90a3e30ae8c9dbdb05 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:18.454553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:18.456622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:18.480179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12340b2f-198c-4a9c-aa7b-9ce7aa748624 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:18.623021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:18.623976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:18.627356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:18.639068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] PATH_INFO: `/v3/users/c300162f199341cda39c94f6e758e7ee` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:18.639068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c300162f199341cda39c94f6e758e7ee)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:18.639068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:19.079594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c300162f199341cda39c94f6e758e7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:19.084018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c300162f199341cda39c94f6e758e7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:19.197773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c300162f199341cda39c94f6e758e7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:19.217386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c300162f199341cda39c94f6e758e7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:19.218910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c300162f199341cda39c94f6e758e7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:19.251015 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3578/7163] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:18 2022] DELETE /identity/v3/users/c300162f199341cda39c94f6e758e7ee => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:19.872976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:20.326858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:20.329060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:20.369970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80379e2b-b70d-4ee4-8199-29b9e20177c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:20.568331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:20.580019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:20.580834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:20.581118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:20.581396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] PATH_INFO: `/v3/projects/a2dc4e291df64e1990980ec66609a075` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:20.583146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dc4e291df64e1990980ec66609a075)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:20.585118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:20.805834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dc4e291df64e1990980ec66609a075', 'request_id': 'req-87aaa923-c912-4b90-817e-4d9ca3547331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:21.004845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dc4e291df64e1990980ec66609a075', 'request_id': 'req-87aaa923-c912-4b90-817e-4d9ca3547331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:21.015705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dc4e291df64e1990980ec66609a075', 'request_id': 'req-87aaa923-c912-4b90-817e-4d9ca3547331'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:21.048776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] The token cache is being invalidate because project a2dc4e291df64e1990980ec66609a075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:21.049168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:21.051240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-87aaa923-c912-4b90-817e-4d9ca3547331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:21.078854 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3586/7164] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:20 2022] DELETE /identity/v3/projects/a2dc4e291df64e1990980ec66609a075 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:22.987202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:22.989347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:23.004746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b913ddf-251d-4023-a114-0a45b1990831 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:23.094076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:23.095925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:23.096395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:23.096826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] PATH_INFO: `/v3/users/63d2bcde29ae4421aae1533bef37f4d1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:23.098290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d2bcde29ae4421aae1533bef37f4d1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:23.100640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:23.331603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:23.367905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d2bcde29ae4421aae1533bef37f4d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:23.368773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d2bcde29ae4421aae1533bef37f4d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:23.485211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d2bcde29ae4421aae1533bef37f4d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:23.515681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d2bcde29ae4421aae1533bef37f4d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:23.517932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d2bcde29ae4421aae1533bef37f4d1'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:23.547944 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3579/7165] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:22 2022] DELETE /identity/v3/users/63d2bcde29ae4421aae1533bef37f4d1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:23.552396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:23.552913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:23.552913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:23.591859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:23.593102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:23.732369 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3587/7166] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:23.805832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:23.810764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:23.963962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f79fe-fd4c-40e1-94dd-05233eedefa2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:23.976393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:23.977254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:23.977606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:23.978084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:24.005390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:24.010580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d7889-f8a0-448b-bbfd-01f2a40c6057 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:24.024748 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3580/7167] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:25.100917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:25.104227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:25.125895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d01c8-7e9e-4f8a-ae17-76385cf8722e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:25.136583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:25.137289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:25.137526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:25.137805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] PATH_INFO: `/v3/projects/389dee36f2c34cea9171eb29e6987b9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:25.141272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389dee36f2c34cea9171eb29e6987b9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:25.148675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:25.286407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:25.317168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389dee36f2c34cea9171eb29e6987b9e', 'request_id': 'req-4038e243-e8ae-4b91-b906-8abdc2374d51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:25.433033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389dee36f2c34cea9171eb29e6987b9e', 'request_id': 'req-4038e243-e8ae-4b91-b906-8abdc2374d51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:25.454776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389dee36f2c34cea9171eb29e6987b9e', 'request_id': 'req-4038e243-e8ae-4b91-b906-8abdc2374d51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:25.473078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] The token cache is being invalidate because project 389dee36f2c34cea9171eb29e6987b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:25.473481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:25.474371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4038e243-e8ae-4b91-b906-8abdc2374d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:25.476645 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3588/7168] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:25 2022] DELETE /identity/v3/projects/389dee36f2c34cea9171eb29e6987b9e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:25.483114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:25.483715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:25.483715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:25.545321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:25.546686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:25.710127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3581/7169] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:25.711660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:25.711970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:25.714407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:25.772682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:25.780567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:25.830422 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3589/7170] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:25.830671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:25.849026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf9ca-e503-4a16-9a21-df2983e5eda2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:25.869971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:25.870586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:25.870768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:25.871044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:25.876021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:25.876350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:25.878084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:25.925177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3582/7171] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:50:25.930279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:25.952263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20576393-3ae4-43fe-b7d9-ecdd472c99c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:25.958805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:25.959495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:25.959772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:25.960052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:25.960753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:25.965647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:26.138377 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3590/7172] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:25 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:26.143725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:26.160104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172de44-3058-49d1-9132-4bb4875c8a10 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:26.236942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:26.278860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:26.280415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:26.280911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:26.281362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:26.282555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:26.287461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:26.416282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3583/7173] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:26 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:26.418695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:26.434761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaa540-4af6-48b7-b32f-942cca3317a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:26.446296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:26.447796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:26.448172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:26.448808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:26.450207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:26.452194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:26.524721 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3591/7174] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:26.530289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:26.553954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca956f-2cbf-4e7e-9ecd-1183d23cdf13 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:26.563633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:26.565939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:26.566508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:26.567158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:26.569524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:26.571964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376df93-89f2-4f57-95e0-ccfb5de3b982 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:26.586653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3584/7175] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:50:26.590993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:26.617841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0524c-2f4c-48d5-b5d1-6529e0b654dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:26.625335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:26.626370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:26.626915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:26.627633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] PATH_INFO: `/v3/projects/06de869412a34daaacdf1e72de7971e9/users/cb1efcbda6484a28b11a721d6184b324/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:26.672235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06de869412a34daaacdf1e72de7971e9, user_id=cb1efcbda6484a28b11a721d6184b324, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:26.677662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:26.790726 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3592/7176] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:26 2022] PUT /identity/v3/projects/06de869412a34daaacdf1e72de7971e9/users/cb1efcbda6484a28b11a721d6184b324/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:26.796908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:26.797207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:26.797462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:26.861457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] MFA Rules not processed for user `cb1efcbda6484a28b11a721d6184b324`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:26.863139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:26.996756 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3585/7177] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:27.001767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:27.099635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c22f-3e5c-416c-b957-c163c12ec44e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:27.106831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:27.107749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:27.108271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:27.108781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:27.109594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:27.111815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:27.257109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3593/7178] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:26 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:27.260936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:27.284466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64d7d5-250f-4abb-a5a4-c4e07693524e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:27.500350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:27.500975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:27.501253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:27.501933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:27.502653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:27.504726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:27.634934 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3586/7179] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:27 2022] POST /identity/v3/users => generated 293 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:27.639009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:27.657669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd01ab-5b9a-4569-ae32-ba1f601ad688 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:27.672258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:27.673058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:27.673479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:27.673806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:27.674461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:27.677054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:27.734581 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3594/7180] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:27.742317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:27.757373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7cb7-3773-4d5e-96cc-13e7f245979d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:27.767004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:27.772407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:27.772407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:27.772407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] PATH_INFO: `/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023/users/233a8a7950ca47c5b199c1152dffd343/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:27.789778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b1d57f4a5d43e9b40cc2f2e8f38023, user_id=233a8a7950ca47c5b199c1152dffd343, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:27.801058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:27.937878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3587/7181] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:27 2022] PUT /identity/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023/users/233a8a7950ca47c5b199c1152dffd343/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:27.942364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:27.972559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21ae8-8245-43f0-ba18-2bf91dad1a07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:28.034222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:28.109734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:28.116170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.116170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.116170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.116170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:28.116170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f61a0-a460-4e92-896a-bc7f6f6c4e04 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:28.132507 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3595/7182] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:28.133181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:28.147963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b1c7b-494e-4abb-92b8-4d1af34adb2c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:28.157185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:28.158841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.159585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.160086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] PATH_INFO: `/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023/users/233a8a7950ca47c5b199c1152dffd343/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.163017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b1d57f4a5d43e9b40cc2f2e8f38023, user_id=233a8a7950ca47c5b199c1152dffd343, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:28.166859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:28.195104 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3588/7183] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:28 2022] PUT /identity/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023/users/233a8a7950ca47c5b199c1152dffd343/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:50:28.206983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.207266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.207737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.270977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] MFA Rules not processed for user `233a8a7950ca47c5b199c1152dffd343`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:28.272460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:28.274176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:28.383478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:28.386341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:28.407895 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3596/7184] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:28.435503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:28.437527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:28.605631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b268c4-919c-44be-bf78-2deddf1a13de admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:28.611650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b24e-a696-4230-ae02-ff75eff1a3e0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:28.616891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:28.617753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.618371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.619062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.621482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:28.622430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.624185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.624710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] PATH_INFO: `/v3/users/7a9608e51f7a413baee06dcf57662ff5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.628175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9608e51f7a413baee06dcf57662ff5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:28.632612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:28.729563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:28.731447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6229dbc-7e65-489d-8555-f5caf433d662 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:28.742499 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3597/7185] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:28.743668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.744097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.744371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.808292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:28.810143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:28.928011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9608e51f7a413baee06dcf57662ff5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:28.931886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9608e51f7a413baee06dcf57662ff5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:28.940586 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3598/7186] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:28.944813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:28.949287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:28.967115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de140ef-fac2-4022-a05e-c55932439e32 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:28.972847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:28.973647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:28.974055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:28.974733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:28.975500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:28.980746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:29.052070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9608e51f7a413baee06dcf57662ff5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:29.094255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9608e51f7a413baee06dcf57662ff5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:29.105231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1a1c88a1-a2e9-4e8f-a00a-6faa55fbbe7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9608e51f7a413baee06dcf57662ff5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:29.126654 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3589/7187] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:28 2022] DELETE /identity/v3/users/7a9608e51f7a413baee06dcf57662ff5 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:50:29.131273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.132278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.133166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.157136 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3599/7188] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:28 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:29.159024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.163843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:29.183639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:29.184902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:29.321535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed567-1930-4ff4-a846-bd93c1548139 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:29.334483 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3590/7189] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:29.344186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.347021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:29.348002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:29.348864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.349336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.349781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.350598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:29.352867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:29.474970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae15745-7117-434c-bce8-dafd52854c07 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:29.480157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:29.481235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.481405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.481980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.513114 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3600/7190] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:29 2022] POST /identity/v3/users => generated 296 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:29.513611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.517118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:29.527450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:29.539834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555aa38-84d8-4801-89b4-484e62ade570 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:29.545632 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3591/7191] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:29.553130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:29.554692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.555912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.563004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.563004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:29.563004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:29.580354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3601/7192] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:29.587062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.608833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a70a-e176-4e58-812b-4a09c566a2db service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:29.619268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:29.620642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.620934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.621213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] PATH_INFO: `/v3/projects/d75e7617beff49d0b16c7a3ead0986ff/users/265a5c993e724e1cbaf81fd8f92b5db9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.653236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75e7617beff49d0b16c7a3ead0986ff, user_id=265a5c993e724e1cbaf81fd8f92b5db9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:29.656761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:29.799008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:29.856343 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3592/7193] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:29 2022] PUT /identity/v3/projects/d75e7617beff49d0b16c7a3ead0986ff/users/265a5c993e724e1cbaf81fd8f92b5db9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:29.860435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.874650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfeb30-2d63-4400-a8c3-da7bdf6016e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:29.923320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:29.925536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:29.985308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:29.986252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:29.986777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:29.987215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:29.988045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:29.990291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:30.007058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3602/7194] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:30.007977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:30.020510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5eab-5f24-49ca-8ad8-7462ff46e394 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:30.026683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:30.027477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.027786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b8bb3-926c-4c89-9fb3-ca6e60bdb01e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:30.028249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.028249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] PATH_INFO: `/v3/projects/d75e7617beff49d0b16c7a3ead0986ff/users/265a5c993e724e1cbaf81fd8f92b5db9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.030877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75e7617beff49d0b16c7a3ead0986ff, user_id=265a5c993e724e1cbaf81fd8f92b5db9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:30.034163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5069a21-55c7-46c9-8df6-5c550884fbcf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:30.035047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:30.036008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.036651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.037251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] PATH_INFO: `/v3/projects/b91e78d220f7403eb479cf33b194a5e8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.042230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91e78d220f7403eb479cf33b194a5e8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:30.042230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:30.048971 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3603/7195] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:30 2022] PUT /identity/v3/projects/d75e7617beff49d0b16c7a3ead0986ff/users/265a5c993e724e1cbaf81fd8f92b5db9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:30.096775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:30.195525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91e78d220f7403eb479cf33b194a5e8', 'request_id': 'req-bbf7d6bc-b536-460d-99ee-317e2085582c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:30.337252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91e78d220f7403eb479cf33b194a5e8', 'request_id': 'req-bbf7d6bc-b536-460d-99ee-317e2085582c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:30.345490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91e78d220f7403eb479cf33b194a5e8', 'request_id': 'req-bbf7d6bc-b536-460d-99ee-317e2085582c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:30.361263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] The token cache is being invalidate because project b91e78d220f7403eb479cf33b194a5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:30.361553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:30.362303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-bbf7d6bc-b536-460d-99ee-317e2085582c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:30.363855 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3593/7196] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:29 2022] DELETE /identity/v3/projects/b91e78d220f7403eb479cf33b194a5e8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:30.369412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.369937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.369937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.407356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:30.407356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:30.553289 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3604/7197] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:30.563020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.563482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.563857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.606220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:30.607642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:30.618253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3594/7198] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:30.622459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:30.632861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516969f-a1b5-4db5-9741-668422a27e4b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:30.638817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:30.642376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.642376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.642376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.642376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:30.642376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:30.643792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:30.657178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3605/7199] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:30.661618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:30.679106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcaeed-496e-4c01-a658-9135e0af339b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:30.686274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:30.687120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.687501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.687875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.688786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:30.691284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:30.882002 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3595/7200] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:30 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:50:30.883682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:30.896102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c580-625c-4003-b738-ce514d8c1d2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:30.981480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:30.982525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:30.982907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:30.983261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:30.984456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:30.986898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:31.143108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3606/7201] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:30 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:50:31.147373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:31.160262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010706-5b22-4220-9a1d-eb02caf99e18 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:31.165633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:31.167009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.167368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.167719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.168468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:31.170283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:31.185831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3596/7202] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:31.187218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:31.200034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:31.204922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4db41-ee21-4d9a-92a4-b3eb95777f16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:31.210548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:31.211465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.211754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.212032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.213249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:31.215182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f621f69-0210-46a3-8bce-5a8651a7e323 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:31.232959 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3607/7203] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:31.234549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:31.245749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8e71a-c49f-4179-801d-30c269c3f291 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:31.251807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:31.252765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.253117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.253472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] PATH_INFO: `/v3/projects/c69e8143f7d14836abe26294de137810/users/2ac306c8aa1e478b93ee8ee11ee5db95/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.272446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69e8143f7d14836abe26294de137810, user_id=2ac306c8aa1e478b93ee8ee11ee5db95, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:31.276127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:31.458700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3597/7204] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:31 2022] PUT /identity/v3/projects/c69e8143f7d14836abe26294de137810/users/2ac306c8aa1e478b93ee8ee11ee5db95/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:31.469964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0b74-d13f-4562-9c9f-05e67f9bf563 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.471754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0b74-d13f-4562-9c9f-05e67f9bf563 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.472255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0b74-d13f-4562-9c9f-05e67f9bf563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.516111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-744c0b74-d13f-4562-9c9f-05e67f9bf563 None None] MFA Rules not processed for user `2ac306c8aa1e478b93ee8ee11ee5db95`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:31.517239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-744c0b74-d13f-4562-9c9f-05e67f9bf563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:31.675651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3608/7205] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:31.722790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:31.729062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:31.882176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb503ba5-e254-4cbd-9792-9c5c00950ecf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:31.887014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:31.888045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.888581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.889075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.899667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:31.901930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:31.916153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3598/7206] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:31.964218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:31.964545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:31.966646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:31.989302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] MFA Rules not processed for user `45a9564cb2e2487d87f9d7f0d75f80b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:31.991691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:32.105444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3609/7207] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:32.880988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:32.983485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:33.018778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e2a23-f17b-48a5-a5fd-b2cf3c989cba service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:33.032128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:33.033454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:33.033967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:33.034993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] PATH_INFO: `/v3/users/2ac306c8aa1e478b93ee8ee11ee5db95` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:33.036633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac306c8aa1e478b93ee8ee11ee5db95)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:33.039099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:33.086102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:33.101820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fbabc-631b-45bf-94f1-f70022df602e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:33.106841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:33.107972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:33.108729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:33.109858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:33.112077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:33.132488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:33.135014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f131df-2405-4354-af1b-624f3d4eec48 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:33.150748 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3610/7208] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:33.368044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac306c8aa1e478b93ee8ee11ee5db95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:33.371038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac306c8aa1e478b93ee8ee11ee5db95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:33.502734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac306c8aa1e478b93ee8ee11ee5db95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:33.536403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac306c8aa1e478b93ee8ee11ee5db95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:33.539323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac306c8aa1e478b93ee8ee11ee5db95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:33.543296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:33.586809 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3599/7209] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:32 2022] DELETE /identity/v3/users/2ac306c8aa1e478b93ee8ee11ee5db95 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:33.589514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:33.589811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:33.590096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:33.617425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:33.619690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:33.764023 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3611/7210] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:33.796017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:33.805476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:33.917511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4549b-2071-42ac-a6b2-a5466345e440 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:33.927598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:33.933470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:33.933470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:33.933470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:33.961528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:33.963112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d7a4c-3dc5-4fbb-b273-e2b3936b39ef service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:33.982587 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3600/7211] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:35.685913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:35.882352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:35.884489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:35.904605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46363d5-19ee-44b4-b548-b27bb0bd132d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:35.913617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:35.914651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:35.916258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:35.917645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] PATH_INFO: `/v3/projects/c69e8143f7d14836abe26294de137810` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:35.920071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69e8143f7d14836abe26294de137810)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:35.924581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:36.135442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69e8143f7d14836abe26294de137810', 'request_id': 'req-a6fd1b48-5756-4b81-b31a-47b7219cccf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:36.143086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:36.257237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69e8143f7d14836abe26294de137810', 'request_id': 'req-a6fd1b48-5756-4b81-b31a-47b7219cccf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:36.272322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69e8143f7d14836abe26294de137810', 'request_id': 'req-a6fd1b48-5756-4b81-b31a-47b7219cccf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:36.298386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] The token cache is being invalidate because project c69e8143f7d14836abe26294de137810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:50:36.302433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:36.305169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6fd1b48-5756-4b81-b31a-47b7219cccf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:36.307453 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3612/7212] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:50:35 2022] DELETE /identity/v3/projects/c69e8143f7d14836abe26294de137810 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:36.312267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:36.312555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:36.312831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:36.338274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:36.340173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:36.407990 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3601/7213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:36.416314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:36.416634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:36.416905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:36.439682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:36.440925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:36.450294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3613/7214] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:36.455074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:36.467557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfcc1-a822-4fcd-adec-3dde7ca750e5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:36.473962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:36.474656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:36.475792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:36.476013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:36.478940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:36.479752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:36.481814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:36.500451 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3602/7215] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:36.505599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:36.522253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77c70-c848-42ba-bb9f-2f5dfe6196d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:36.534274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:36.535407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:36.536217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:36.536801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:36.538205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:36.540895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:36.718579 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3614/7216] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:50:36 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:36.725514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:36.747458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7234-2f1f-466a-a8a3-25fa68c7c8b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:36.862197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:36.863697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:36.864317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:36.864770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:36.865636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:36.868376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:36.999525 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3603/7217] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:50:36 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:50:37.000580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:37.022742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace13c3-6f4e-4870-8b30-62bb1c70a728 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:37.037316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:37.041829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.042335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.042841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.043781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:37.049291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:37.088679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3615/7218] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:50:37.093492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:37.117169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c9bb9-1d17-4f0e-99b7-86a684391214 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:37.137071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:37.137856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.138251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.138648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.139412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:37.141367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:37.169052 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3604/7219] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:50:37.173350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:37.187207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12840b-3a03-49d7-9680-4de1790d9038 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:37.204388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:37.205167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.205513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.205639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:37.206543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] PATH_INFO: `/v3/projects/d60de6f3aca5437d9b44c1379b165f76/users/dddff0c1c6f644f2adcb882098308074/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.207861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:37.243227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60de6f3aca5437d9b44c1379b165f76, user_id=dddff0c1c6f644f2adcb882098308074, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:37.249047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96d0c-b4b7-42ba-be6e-376fc9b3b8d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:37.334820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1217cda-f0b5-48db-adc7-ebe08e242b0c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:37.340914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:37.341730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.342111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.342535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.344806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:37.392060 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3616/7220] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:50:37 2022] PUT /identity/v3/projects/d60de6f3aca5437d9b44c1379b165f76/users/dddff0c1c6f644f2adcb882098308074/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:37.395745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f1e-6397-4228-8852-945c64f3690e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.396267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f1e-6397-4228-8852-945c64f3690e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.396902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f1e-6397-4228-8852-945c64f3690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.431031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-092e2f1e-6397-4228-8852-945c64f3690e None None] MFA Rules not processed for user `dddff0c1c6f644f2adcb882098308074`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:37.432615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-092e2f1e-6397-4228-8852-945c64f3690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:37.446336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:37.448473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:37.484987 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3605/7221] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:37.552276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3617/7222] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:37.592147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:37.594543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:37.616646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe610-1f8f-4e10-b075-d2b19e77e964 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:37.774222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:37.777350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:37.778028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:37.778543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:37.793952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:37.796624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:37.864925 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3606/7223] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:38.531192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:49.030704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835910-7966-4240-aa04-38c259d34665 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:49.031931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835910-7966-4240-aa04-38c259d34665 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:49.032475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca835910-7966-4240-aa04-38c259d34665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:49.122096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca835910-7966-4240-aa04-38c259d34665 None None] MFA Rules not processed for user `265a5c993e724e1cbaf81fd8f92b5db9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:49.123706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca835910-7966-4240-aa04-38c259d34665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:49.324383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:49.375508 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3618/7224] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:49.441475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:49.445281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:49.600225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:49.611091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606641a-4de3-44dc-bfbd-5e927290e983 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:49.618107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:49.624538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:49.625440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:49.625792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:49.641303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:49.643719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbecd7-325f-4cb6-85e5-d0782a2fc943 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:49.681092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3607/7225] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:50:50.056507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca835910-7966-4240-aa04-38c259d34665 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:50.077339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca835910-7966-4240-aa04-38c259d34665 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:50.082566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:50.083575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:50.084043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:50.085452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:50.096537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:50.238607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:50.241248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455b45-36b7-4770-ae4d-e3f578daa612 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:50.271251 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3619/7226] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:54.392558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.393105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.393105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.461452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] MFA Rules not processed for user `cb1efcbda6484a28b11a721d6184b324`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:54.468152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:54.564771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3608/7227] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:55.319112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.320379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.322520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.351246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:55.353671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:55.365992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3620/7228] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:50:56.069910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:56.089211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac02ae-f245-4afd-9e6f-ead423c85b90 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:56.099395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:56.100191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:56.100576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:56.100970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:56.103219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:56.134850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:56.138676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56af0-03bc-4baf-962c-ee8b422f77ea service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:56.161752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3609/7229] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:50:58.513180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:58.515135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:58.626067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3b6c-1337-4a21-a2a0-d1552e127156 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:58.631971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:58.632721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.633134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.633505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] PATH_INFO: `/v3/users/075833c954804fa0b5943c91bd7d6953` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.635086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075833c954804fa0b5943c91bd7d6953)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:58.637091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.195732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075833c954804fa0b5943c91bd7d6953'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:59.198986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075833c954804fa0b5943c91bd7d6953'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:59.395266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075833c954804fa0b5943c91bd7d6953'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:59.423835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075833c954804fa0b5943c91bd7d6953'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:59.424906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075833c954804fa0b5943c91bd7d6953'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:50:59.446286 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3621/7230] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:50:58 2022] DELETE /identity/v3/users/075833c954804fa0b5943c91bd7d6953 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:50:59.448686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.449396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.449747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.474704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:59.476028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:59.550045 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3610/7231] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:50:59.565064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.567356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:59.575188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.655791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3178d-7b02-4e0f-a089-fb91d84dd511 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.660649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.661358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.661759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.662110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.677570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.677858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bf004-44f6-4c53-b24a-eaa63aae133b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.693764 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3622/7232] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:00.066453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:00.068533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:00.090387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a05d-b370-4a47-a403-5a3ab1e2da00 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:00.122927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.126335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.129585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.132182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] PATH_INFO: `/v3/projects/6dbaa2c9613648ceadbdbc49a218a2c8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.138539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbaa2c9613648ceadbdbc49a218a2c8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.142850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.452201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbaa2c9613648ceadbdbc49a218a2c8', 'request_id': 'req-8373335e-8747-40f7-82d4-5b480d15a129'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:00.564992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbaa2c9613648ceadbdbc49a218a2c8', 'request_id': 'req-8373335e-8747-40f7-82d4-5b480d15a129'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:00.572423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbaa2c9613648ceadbdbc49a218a2c8', 'request_id': 'req-8373335e-8747-40f7-82d4-5b480d15a129'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:00.600080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] The token cache is being invalidate because project 6dbaa2c9613648ceadbdbc49a218a2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:00.600818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:00.604922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8373335e-8747-40f7-82d4-5b480d15a129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:00.617201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.618136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.619238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.620850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3611/7233] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:00 2022] DELETE /identity/v3/projects/6dbaa2c9613648ceadbdbc49a218a2c8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:00.664323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:00.669552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:00.797798 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3623/7234] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:00.807254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.807529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.807799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.818174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:00.833669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:00.835496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:00.876102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3612/7235] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:00.880712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:00.910509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27fe85-8c87-4b87-a51c-6ba79f950bc5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:00.929006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.932043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.932639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.935260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.940408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:00.943375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.946128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.987744 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3624/7236] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:00.992153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:01.008648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a4369-3e5e-4486-a4e1-adc0e9f9d4c2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:01.017987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:01.019378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:01.019881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:01.020545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:01.021600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:01.023837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:01.230713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3613/7237] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:00 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:01.234937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:01.250863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb109f8d-87ba-48fe-bb12-5dda3889929b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:01.362956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:01.363230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:01.363493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:01.363790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:01.364500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:01.366534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:01.526529 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3625/7238] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:01 2022] POST /identity/v3/users => generated 284 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:01.533414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:01.555023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4949-b224-4462-802d-0c46f8f6bdf7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:01.573928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:01.575098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:01.575276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:01.575507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:01.576171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:01.578228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:01.603190 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3614/7239] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:01.607616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:01.620363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070abb6-e397-4203-85a4-4babecd8de5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:01.636022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:01.637328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:01.638057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:01.638807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:01.639707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:01.641773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffafa29-ce76-4690-bbda-027d40aca894 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:01.677887 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3626/7240] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:01.682119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:01.736381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb00ca-9afa-476a-b82e-35d701f7bf1c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:01.756225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:01.757106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:01.757506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:01.757885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] PATH_INFO: `/v3/projects/7b622f2d47384931a570db411c947fb5/users/a17d76b7e754413185cf70f3103bc2dd/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:01.797793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b622f2d47384931a570db411c947fb5, user_id=a17d76b7e754413185cf70f3103bc2dd, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:01.800874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:02.012236 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3615/7241] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:01 2022] PUT /identity/v3/projects/7b622f2d47384931a570db411c947fb5/users/a17d76b7e754413185cf70f3103bc2dd/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:02.018104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:02.018460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:02.020238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:02.078871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] MFA Rules not processed for user `a17d76b7e754413185cf70f3103bc2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:02.080174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:02.231142 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3627/7242] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:02.274898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:02.279158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:02.493921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0552e-3bfb-4853-8223-17567c224938 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:02.496555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:02.497191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:02.497473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:02.497748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:02.507953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:02.510210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee1d2d-358f-4af7-86ec-170e2d7a6922 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:02.549607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3616/7243] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:02.804971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:02.936572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:02.939654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:03.047878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfc45c-e872-40f6-8055-c9f0538bcf85 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.054366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.055540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.056347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.056813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] PATH_INFO: `/v3/users/dddff0c1c6f644f2adcb882098308074` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.058283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddff0c1c6f644f2adcb882098308074)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.067985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.402483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddff0c1c6f644f2adcb882098308074'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:03.403361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddff0c1c6f644f2adcb882098308074'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:03.524966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddff0c1c6f644f2adcb882098308074'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:03.552461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddff0c1c6f644f2adcb882098308074'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:03.555372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddff0c1c6f644f2adcb882098308074'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:03.590231 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3628/7244] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:51:02 2022] DELETE /identity/v3/users/dddff0c1c6f644f2adcb882098308074 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:03.594713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.595994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.596590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.682579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:03.690842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:03.852492 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3617/7245] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:03.864842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.866375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:03.964698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d2109-0c96-41c6-a1de-0a2ac7eb8610 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.972400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.973292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.984729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.984729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.987138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.988959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43e12-4efc-42bc-a18b-81cf0046f67e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.003221 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3629/7246] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:04.889900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.894113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:04.907272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36902f57-4b7c-446a-a439-f21fe8ec95dd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.924175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.925232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.925749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.926264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] PATH_INFO: `/v3/projects/d60de6f3aca5437d9b44c1379b165f76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.929127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60de6f3aca5437d9b44c1379b165f76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.934201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:05.199046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:05.214563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60de6f3aca5437d9b44c1379b165f76', 'request_id': 'req-2f878b6b-f647-4e06-b113-d6ac32cedbf7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:05.315293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60de6f3aca5437d9b44c1379b165f76', 'request_id': 'req-2f878b6b-f647-4e06-b113-d6ac32cedbf7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:05.326577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60de6f3aca5437d9b44c1379b165f76', 'request_id': 'req-2f878b6b-f647-4e06-b113-d6ac32cedbf7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:05.349203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] The token cache is being invalidate because project d60de6f3aca5437d9b44c1379b165f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:05.349924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:05.350970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2f878b6b-f647-4e06-b113-d6ac32cedbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:05.359633 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3618/7247] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:04 2022] DELETE /identity/v3/projects/d60de6f3aca5437d9b44c1379b165f76 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:05.360129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:05.360528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:05.360679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:05.409495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:05.416823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:05.573492 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3630/7248] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:05.584448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:05.584749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:05.585372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:05.617986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:05.620094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:05.645458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:05.659798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3619/7249] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:05.662448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f3537-637f-412d-9e5e-6fce3acfbc9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:05.674424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:05.676043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:05.676776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:05.677762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:05.678791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:05.680032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:05.684516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:05.744178 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3631/7250] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:05.749350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:05.784396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d105-4d35-409d-a746-5f22f73473e3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:05.796749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:05.797391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:05.797673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:05.797948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:05.799006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:05.800986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:05.891117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:06.001611 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3620/7251] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:06.005667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:06.026268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96592-d52f-4a0e-8c09-a102a2e4a2d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:06.192374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:06.193103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.193533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.195332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.196160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:06.207121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:06.366844 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3632/7252] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:06 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:06.367537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:06.383779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63930e0e-c40b-4694-8ed5-35a2697cb8af admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:06.411473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:06.412169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.414144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.414441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.415321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:06.422438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:06.456307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:06.471971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f722-dc5e-469f-9fe7-8bfe81602da0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:06.472760 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3621/7253] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:06.477196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:06.479461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.479943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.481681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.482605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:06.484691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d39c5-e9fa-4a65-b39c-68aa959fb39f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:06.526318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:06.528020 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3633/7254] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:51:06.543067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec18645-2d6b-4e9b-ad4c-b8938fac6d84 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:06.548421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:06.549361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.550446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.550446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] PATH_INFO: `/v3/projects/84eee6dc89bb477886770749ad704bc6/users/da08aa882f9b49c0b7fe30280162b11f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.577988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eee6dc89bb477886770749ad704bc6, user_id=da08aa882f9b49c0b7fe30280162b11f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:06.587148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:06.814391 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3622/7255] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:06 2022] PUT /identity/v3/projects/84eee6dc89bb477886770749ad704bc6/users/da08aa882f9b49c0b7fe30280162b11f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:06.830881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.830881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.830881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.940141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] MFA Rules not processed for user `da08aa882f9b49c0b7fe30280162b11f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:06.943075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:07.082059 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3634/7256] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:07.106854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.116883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:07.189949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168fb83-0a60-4372-9efd-91ca9759df96 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.194253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.195017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.195401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.195761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.211064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:07.214968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6d2db-543f-4ff8-8b80-aad046d31815 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:07.226890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3623/7257] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:07.354759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.468845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e8f0-23da-4a61-9464-c4f1fc5a0768 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.474481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.475547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.477184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.477948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] PATH_INFO: `/v3/users/da08aa882f9b49c0b7fe30280162b11f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.479465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da08aa882f9b49c0b7fe30280162b11f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:07.482017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:07.927246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da08aa882f9b49c0b7fe30280162b11f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:07.928185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da08aa882f9b49c0b7fe30280162b11f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:08.074227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da08aa882f9b49c0b7fe30280162b11f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:08.098489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da08aa882f9b49c0b7fe30280162b11f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:08.098489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da08aa882f9b49c0b7fe30280162b11f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:08.137726 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3635/7258] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:51:07 2022] DELETE /identity/v3/users/da08aa882f9b49c0b7fe30280162b11f => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:08.139534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.140005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.140542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.192410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:08.195094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:08.401210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3624/7259] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:51:08.450233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.452689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:08.616679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afc2e2-bd79-42c2-8544-196fc9e05c91 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.624965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.625609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.626073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.627723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.643187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.645661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bd40c-6964-46dc-88ee-1b4a42c67e1a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.662372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3636/7260] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:09.832600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:09.836049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:09.882228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358307-ac71-4c5e-aab7-6c36c21c0c1f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:09.904786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:09.907354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:09.917569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:09.917569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] PATH_INFO: `/v3/projects/84eee6dc89bb477886770749ad704bc6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:09.921894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eee6dc89bb477886770749ad704bc6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:09.938609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:09.947766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:10.202313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eee6dc89bb477886770749ad704bc6', 'request_id': 'req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:10.342168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eee6dc89bb477886770749ad704bc6', 'request_id': 'req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:10.344448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:10.349333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eee6dc89bb477886770749ad704bc6', 'request_id': 'req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:10.363767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] The token cache is being invalidate because project 84eee6dc89bb477886770749ad704bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:10.364378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:10.365298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f6b5d41c-b060-4fc0-964a-ffc66c2f7721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:10.373251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:10.374015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:10.374488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:10.378142 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3625/7261] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:09 2022] DELETE /identity/v3/projects/84eee6dc89bb477886770749ad704bc6 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:10.397038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:10.402017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:10.491269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3637/7262] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:10.496122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:10.496541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:10.496936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:10.524924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:10.528078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:10.542382 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3626/7263] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:10.546500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:10.561755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc876e3-31c0-4d09-a2b0-bf880010d4f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:10.564490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:10.565271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:10.565563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:10.565836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:10.566916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:10.567471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:10.569519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:10.606909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3638/7264] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:51:10.611947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:10.627632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13785c65-25dd-4ee8-a7e2-3fbf43a16068 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:10.642411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:10.643061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:10.643342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:10.643618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:10.644263 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:10.646182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:10.839116 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3627/7265] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:10 2022] POST /identity/v3/projects => generated 405 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:10.845934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:10.877578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7cc7-9791-4a6c-b98d-fbe9d7f2f08b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.007323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.008242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.009415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.009870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.010825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.014119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.160903 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3639/7266] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:10 2022] POST /identity/v3/users => generated 303 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:11.170120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:11.189063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df1e1-bf88-47f2-99b2-332e18426a20 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.207168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.207168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.207168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.207168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.208294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.213629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.230852 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3628/7267] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:11.234163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:11.256156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827838-b538-4d70-989c-c8d27bd917b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.261788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.262743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.264903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.265429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.266166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.268843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec925-3842-49f4-a8c8-063d89cfea40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.303322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3640/7268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:11.308220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:11.325141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5d03-2ff3-44eb-b7c4-66355509f09f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.344148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.347070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.349027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.349547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] PATH_INFO: `/v3/projects/ab608da26b654a54b949a1ec8d75a88c/users/79d150f2134c4f8f8ba434126d2fb68b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.385725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab608da26b654a54b949a1ec8d75a88c, user_id=79d150f2134c4f8f8ba434126d2fb68b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.392762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.547957 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3629/7269] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:11 2022] PUT /identity/v3/projects/ab608da26b654a54b949a1ec8d75a88c/users/79d150f2134c4f8f8ba434126d2fb68b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:11.552885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e8f4-85cd-4421-ac28-d372bdadd34b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.553829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e8f4-85cd-4421-ac28-d372bdadd34b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.554323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e8f4-85cd-4421-ac28-d372bdadd34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.596614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5614e8f4-85cd-4421-ac28-d372bdadd34b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:11.599234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5614e8f4-85cd-4421-ac28-d372bdadd34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:11.745050 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3641/7270] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:11.779784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:11.781783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:11.869556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9481-2e62-4c18-94f3-b4643664f9d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.888730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.889857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.889857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.889857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.904738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.906355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.919922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3630/7271] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:13.508042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:16.104126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6b91-df47-4064-9167-69823afa3363 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.104798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6b91-df47-4064-9167-69823afa3363 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.105415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6b91-df47-4064-9167-69823afa3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.145899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-551d6b91-df47-4064-9167-69823afa3363 None None] MFA Rules not processed for user `79d150f2134c4f8f8ba434126d2fb68b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:16.147342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-551d6b91-df47-4064-9167-69823afa3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:16.272196 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3642/7272] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:16.277022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.291984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6965c8-09d9-4413-a400-2b27ca1a634c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:16.298262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:16.299384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.299909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.300183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.300891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:16.302906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:16.414840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3631/7273] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:16 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:16.419329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d6b91-df47-4064-9167-69823afa3363 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.431780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d6b91-df47-4064-9167-69823afa3363 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:16.524927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:16.524927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.524927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.526120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.527359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:16.530219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:16.647251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.647548 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3643/7274] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:16 2022] POST /identity/v3/users => generated 309 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:16.663618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79667bb-65f8-4483-b61c-a100fd2bd8ae admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:16.670655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:16.671741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.672345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.672784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.673628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:16.675513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:16.677237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:16.692921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3632/7275] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:16.693782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.705844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0458e-4f2d-4beb-ad68-5e1f3badf834 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:16.712844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:16.714074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.714918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.715432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] PATH_INFO: `/v3/projects/361c6d5a20f0485994a2468bce3a4fd1/users/38702a71d35b4b50bad45f40a2522192/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.736463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c6d5a20f0485994a2468bce3a4fd1, user_id=38702a71d35b4b50bad45f40a2522192, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:16.741258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:16.788455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:16.842421 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3644/7276] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:16 2022] PUT /identity/v3/projects/361c6d5a20f0485994a2468bce3a4fd1/users/38702a71d35b4b50bad45f40a2522192/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:16.843733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.855283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770a98-1da5-4870-bf31-5f9d858a8eea admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:16.971812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:16.971812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:16.971812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:16.971812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:16.972917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:16.972917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71509fb2-8219-4c1d-a2e1-4cd94d3a1c69 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:16.997945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:16.998109 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3633/7277] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:17.022344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11aff6-d704-4760-94a6-9643e6a5193c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:17.039374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:17.040107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:17.040419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:17.040717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] PATH_INFO: `/v3/projects/361c6d5a20f0485994a2468bce3a4fd1/users/38702a71d35b4b50bad45f40a2522192/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:17.047652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c6d5a20f0485994a2468bce3a4fd1, user_id=38702a71d35b4b50bad45f40a2522192, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:17.050417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:17.077515 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3645/7278] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:16 2022] PUT /identity/v3/projects/361c6d5a20f0485994a2468bce3a4fd1/users/38702a71d35b4b50bad45f40a2522192/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:19.570904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:19.570904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:19.570904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:19.605330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] MFA Rules not processed for user `38702a71d35b4b50bad45f40a2522192`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:19.606561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:19.702924 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3634/7279] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:19.991779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:19.993971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:20.049904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:20.107066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f056c10-bc63-4478-87e9-7afb453b2d8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:20.117109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:20.124972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:20.124972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:20.124972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] PATH_INFO: `/v3/users/45a9564cb2e2487d87f9d7f0d75f80b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:20.124972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a9564cb2e2487d87f9d7f0d75f80b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:20.124972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:20.454364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a9564cb2e2487d87f9d7f0d75f80b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:20.456327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a9564cb2e2487d87f9d7f0d75f80b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:20.565523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a9564cb2e2487d87f9d7f0d75f80b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:20.588599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a9564cb2e2487d87f9d7f0d75f80b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:20.591010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a18c2aa-199a-4df6-bcea-4e856680b0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a9564cb2e2487d87f9d7f0d75f80b7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:20.614701 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3646/7280] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:51:19 2022] DELETE /identity/v3/users/45a9564cb2e2487d87f9d7f0d75f80b7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:21.060451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:21.079074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501a0a0-ba3e-42db-9b02-9891df85c633 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:21.159715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:21.160697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:21.161200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:21.161650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] PATH_INFO: `/v3/projects/ff5cbc15bdbb4bbaa47b192be7296301` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:21.163085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5cbc15bdbb4bbaa47b192be7296301)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:21.165279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:21.202579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:21.442234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5cbc15bdbb4bbaa47b192be7296301', 'request_id': 'req-1094a56d-2c1c-4251-888a-fca9dcc76a2d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:21.565107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5cbc15bdbb4bbaa47b192be7296301', 'request_id': 'req-1094a56d-2c1c-4251-888a-fca9dcc76a2d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:21.580554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5cbc15bdbb4bbaa47b192be7296301', 'request_id': 'req-1094a56d-2c1c-4251-888a-fca9dcc76a2d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:21.621011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] The token cache is being invalidate because project ff5cbc15bdbb4bbaa47b192be7296301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:21.621270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:21.625134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1094a56d-2c1c-4251-888a-fca9dcc76a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:21.627629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3635/7281] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:21 2022] DELETE /identity/v3/projects/ff5cbc15bdbb4bbaa47b192be7296301 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:21.639772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:21.639772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:21.639772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:21.665677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:21.667765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:21.839884 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3647/7282] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:21.841603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36061-abef-4d02-aea9-977b117d637f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:21.841872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36061-abef-4d02-aea9-977b117d637f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:21.842144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f36061-abef-4d02-aea9-977b117d637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:21.880561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-24f36061-abef-4d02-aea9-977b117d637f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:21.882589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-24f36061-abef-4d02-aea9-977b117d637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:21.895856 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3636/7283] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:21.901205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:21.918770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ec125-d899-4692-a7f7-f3c3033ed6b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:21.927526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:21.928715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:21.929272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:21.929782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:21.931104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:21.931936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:21.934386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:21.957725 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3648/7284] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:51:21.964033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f36061-abef-4d02-aea9-977b117d637f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:21.986075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f36061-abef-4d02-aea9-977b117d637f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:22.001650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:22.004746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.005143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.005443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.006102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:22.008159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:22.191471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3637/7285] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:21 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:22.195845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.207976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4258e-5d4a-4ca0-9a17-c6977824c057 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:22.246742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:22.279119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:22.279939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.280941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.281329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.282955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:22.285499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:22.438972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3649/7286] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:22 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:51:22.439895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.456508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4b043-13bf-427d-97e7-58017f952825 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:22.461495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:22.462257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.462767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.463049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.463709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:22.465330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:22.476812 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3638/7287] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:22.481256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.494367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd6ad5-e365-4dd5-b735-e985d5a97cea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:22.499478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:22.500206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.500597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.501702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.502539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:22.504857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe25b7-5999-4fc1-83f6-b1903e45f290 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:22.519604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3650/7288] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:22.521698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.535944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55fc9e-f78b-4682-80a7-35d13f28bc9a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:22.540756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:22.541434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.541917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.542194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] PATH_INFO: `/v3/projects/70328f5f1b934c87b0b266216f2da904/users/43845ab6f1bf4ec392c598ca28edb799/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.559311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70328f5f1b934c87b0b266216f2da904, user_id=43845ab6f1bf4ec392c598ca28edb799, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:22.562035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:22.735806 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3639/7289] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:22 2022] PUT /identity/v3/projects/70328f5f1b934c87b0b266216f2da904/users/43845ab6f1bf4ec392c598ca28edb799/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:22.740212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:22.742096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:22.742655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:22.785499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:22.787127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:22.857711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.861315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:22.884505 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3651/7290] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:22.903759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:22.906839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:23.050404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548f6f0-fbdf-4063-aa55-02d59699c045 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:23.055569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:23.059444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:23.059444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:23.059444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:23.069673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:23.071328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:23.092482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908089-cc25-4335-be8e-7adac0a7042c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:23.092794 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3652/7291] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:51:23.101308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:23.102896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:23.103379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:23.104857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] PATH_INFO: `/v3/users/79d150f2134c4f8f8ba434126d2fb68b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:23.108045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d150f2134c4f8f8ba434126d2fb68b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:23.110904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:23.437552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:23.452714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d150f2134c4f8f8ba434126d2fb68b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:23.457915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d150f2134c4f8f8ba434126d2fb68b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:23.588192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d150f2134c4f8f8ba434126d2fb68b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:23.627339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d150f2134c4f8f8ba434126d2fb68b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:23.630003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d150f2134c4f8f8ba434126d2fb68b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:23.651675 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3640/7292] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:51:22 2022] DELETE /identity/v3/users/79d150f2134c4f8f8ba434126d2fb68b => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:24.312055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:24.326850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89457b4b-a9bb-42b5-9ee8-750ae076911d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:24.465415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:24.466686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:24.467242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:24.467801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] PATH_INFO: `/v3/projects/ab608da26b654a54b949a1ec8d75a88c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:24.470443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab608da26b654a54b949a1ec8d75a88c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:24.475702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:24.683542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab608da26b654a54b949a1ec8d75a88c', 'request_id': 'req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:24.794237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab608da26b654a54b949a1ec8d75a88c', 'request_id': 'req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:24.810957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab608da26b654a54b949a1ec8d75a88c', 'request_id': 'req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:24.842279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] The token cache is being invalidate because project ab608da26b654a54b949a1ec8d75a88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:24.842601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:24.844303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:24.852101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3653/7293] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:24 2022] DELETE /identity/v3/projects/ab608da26b654a54b949a1ec8d75a88c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:24.859433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:24.859433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:24.876106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed8ca-c615-4c87-afd9-2d532e94bc1d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:24.977697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:24.979069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:24.979604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:24.980121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] PATH_INFO: `/v3/users/38702a71d35b4b50bad45f40a2522192` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:24.983369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38702a71d35b4b50bad45f40a2522192)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:24.988746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:25.345693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38702a71d35b4b50bad45f40a2522192'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:25.348539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38702a71d35b4b50bad45f40a2522192'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:25.702209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38702a71d35b4b50bad45f40a2522192'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:25.752714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38702a71d35b4b50bad45f40a2522192'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:25.755919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-33362897-f020-4e15-81c0-6c73421de589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38702a71d35b4b50bad45f40a2522192'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:25.787428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3641/7294] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:51:24 2022] DELETE /identity/v3/users/38702a71d35b4b50bad45f40a2522192 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:25.970853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:26.846045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:26.847808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:26.993712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad4eaf-e801-4bb6-91ee-df5d5082daf4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:27.108927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:27.109651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:27.111576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:27.111869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] PATH_INFO: `/v3/projects/361c6d5a20f0485994a2468bce3a4fd1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:27.114032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=361c6d5a20f0485994a2468bce3a4fd1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:27.118092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:27.326454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361c6d5a20f0485994a2468bce3a4fd1', 'request_id': 'req-5a1bdee7-d847-43ed-8694-9ebbc614d88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:27.427416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361c6d5a20f0485994a2468bce3a4fd1', 'request_id': 'req-5a1bdee7-d847-43ed-8694-9ebbc614d88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:27.435365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361c6d5a20f0485994a2468bce3a4fd1', 'request_id': 'req-5a1bdee7-d847-43ed-8694-9ebbc614d88c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:27.459387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] The token cache is being invalidate because project 361c6d5a20f0485994a2468bce3a4fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:51:27.460372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:27.464298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a1bdee7-d847-43ed-8694-9ebbc614d88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:51:27.473128 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3654/7295] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:51:26 2022] DELETE /identity/v3/projects/361c6d5a20f0485994a2468bce3a4fd1 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:27.473719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:27.474578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:27.475140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:27.502224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:27.504022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:27.593622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:27.636530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:27.651225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3642/7296] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:27.652537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:27.652913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:27.653500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:27.688767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:27.691147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:27.705827 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3655/7297] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:27.707393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:27.729333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144c7c-5bb4-449d-9609-c3c909e17ce2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:27.735281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:27.736276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:27.736729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:27.737281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:27.738301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:27.739314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:27.741555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:27.762978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3643/7298] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:27.767937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:27.787904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f795f-9480-4799-bbc7-f1ccb2a6e67a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:27.796441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:27.797893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:27.798680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:27.799171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:27.800780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:27.803477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:27.941278 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3656/7299] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:27 2022] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:27.946423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:27.964558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a76835-2276-410c-ba6a-a4bfc33af81f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:28.056945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:28.057200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.057763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.058060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.058934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:28.060951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:28.205431 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3644/7300] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:27 2022] POST /identity/v3/users => generated 278 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:28.210237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:28.236752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69f19a-5851-4340-b857-6f6ad499d0f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:28.244365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:28.245430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.246174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.246784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.247644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:28.249837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:28.268866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3657/7301] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:28.273555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:28.294319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0575-48bc-471f-bd3c-036b5f6ae96a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:28.299937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:28.301413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.301922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.302392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.303114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:28.304816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6dcd9-ea68-4e70-8453-abe72bab715f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:28.318462 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3645/7302] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:28.326288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:28.351973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244745-3352-4ef2-8c46-5acdbb41e655 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:28.357680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:28.359742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.360275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.360909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] PATH_INFO: `/v3/projects/812948831cce439a829de6eb2d27d9ca/users/aa3860b970934de7a40ca9e14ecec4e9/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.392233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=812948831cce439a829de6eb2d27d9ca, user_id=aa3860b970934de7a40ca9e14ecec4e9, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:28.396503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:28.524590 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3658/7303] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:28 2022] PUT /identity/v3/projects/812948831cce439a829de6eb2d27d9ca/users/aa3860b970934de7a40ca9e14ecec4e9/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:51:28.529337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.530881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.531939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.597366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] MFA Rules not processed for user `aa3860b970934de7a40ca9e14ecec4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:28.612803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:28.783144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:28.784602 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3646/7304] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:28.907258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630268-3c73-4512-a253-b1dd78ae5d8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:28.916010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:28.917063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:28.917605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:28.918275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:28.919204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:28.921704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.035307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3659/7305] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:51:28 2022] POST /identity/v3/projects => generated 355 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:51:29.040513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:29.057964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36a17-e58a-4868-a353-cef084d0286a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:29.163577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:29.164304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.165210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.165876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:29.166655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:29.168710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.332490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:29.333586 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3647/7306] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:29 2022] POST /identity/v3/users => generated 284 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:29.371483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60021962-d002-4217-b0c2-9dbf5827153d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:29.391661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:29.393573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.396950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.397334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:29.400929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:29.403742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.420671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3660/7307] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:51:29.425880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:29.456180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaed79-4ee0-4849-bc2a-10e57031349a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:29.463465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:29.464258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.464857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.465441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] PATH_INFO: `/v3/projects/aa7751aec8a5463493e7e3f9f736af09/users/a5716afd994d452f9f509648b185ecfb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:29.498007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7751aec8a5463493e7e3f9f736af09, user_id=a5716afd994d452f9f509648b185ecfb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:29.503717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.665047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3648/7308] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:29 2022] PUT /identity/v3/projects/aa7751aec8a5463493e7e3f9f736af09/users/a5716afd994d452f9f509648b185ecfb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:29.669462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:29.688682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30edacb-1cf9-48e3-9ef8-ebe25cd3fb3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:29.849618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:29.859317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:29.860047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.860520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.860919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:29.861779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:29.863939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ce14e-a36e-4bb6-ac83-df1569ea704e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.882670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3661/7309] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:29.887611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:29.900835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2d75c-61ea-41a7-96de-44957c9594f7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:29.907870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:29.912722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.912722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.912722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] PATH_INFO: `/v3/projects/aa7751aec8a5463493e7e3f9f736af09/users/a5716afd994d452f9f509648b185ecfb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:29.912722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7751aec8a5463493e7e3f9f736af09, user_id=a5716afd994d452f9f509648b185ecfb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:29.915798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:29.933652 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3649/7310] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:51:29 2022] PUT /identity/v3/projects/aa7751aec8a5463493e7e3f9f736af09/users/a5716afd994d452f9f509648b185ecfb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:29.951820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:29.953385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:29.953744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:30.160367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] MFA Rules not processed for user `a5716afd994d452f9f509648b185ecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:30.160367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:30.341291 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3662/7311] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:30.355880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:30.357990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:30.390883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:30.490437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e16e-4021-4f76-81d0-201d4e21f94c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:30.497742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:30.498653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:30.499138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:30.499702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:30.525667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:30.530784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec669235-a538-4cb0-975a-6c36a7342134 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:30.562828 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3650/7312] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:31.030409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:31.049542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fb940-2f02-4b6c-adca-e9c4121cbda0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:31.065694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:31.066408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:31.066714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:31.066984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:31.265545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:31.270671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a687ff-18d7-4963-b343-2a8bbf292877 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:31.331994 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3663/7313] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:34.339334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:34.341959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:34.342338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:34.403171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] MFA Rules not processed for user `43845ab6f1bf4ec392c598ca28edb799`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:34.405907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:34.575423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:34.598139 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3651/7314] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:34.601705 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:34.602258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:34.602923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:34.639552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] MFA Rules not processed for user `43845ab6f1bf4ec392c598ca28edb799`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:34.640946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:34.674424 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3664/7315] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:51:34.686384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:34.688432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:34.816008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9abc45-abe9-4dd2-9988-ca28a039bb3f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:34.828405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:34.829543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:34.830204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:34.830891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:34.869898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:34.884342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c602-5c8d-46e2-a9b2-1eb119cf8c9e service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:34.896697 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3652/7316] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:44.632404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:46.302249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=34 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:51.128127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:51.137624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:51.265855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5e200-7268-47a8-b1d1-abd69756551c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:51.299990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:51.300606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:51.300606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:51.304666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:51.306557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:51.307482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:51.309423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:51.317389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:51.340349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:51.343113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:51.368071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:51.370695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b74cb-8fe9-4cad-9c8c-447402834658 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:51.410694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3665/7317] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:51:51.498834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3653/7318] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:01.396148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:01.488324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=25 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:04.755818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:04.756652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:04.756652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:04.822265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] MFA Rules not processed for user `cb1efcbda6484a28b11a721d6184b324`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:04.827232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:04.974291 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3666/7319] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:09.625163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:09.636758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:09.786049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d16fa-2664-4d07-af3d-e901b9fc0972 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:09.786186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:09.786990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:09.787829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:09.788293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:09.788745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:09.794822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:09.806525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b145cc-5b10-43d8-ab41-03a3f870e6d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:09.815808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:09.825946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:09.825946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:09.825946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:09.825946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:09.831802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:09.834001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:09.854333 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3654/7320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:09.856855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:09.858480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc3b92-cabf-4ff2-8191-1518c23ff8b5 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:09.882984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3667/7321] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:10.084338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:10.086037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:10.224465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4831-643f-49b6-af6f-01b6e5ca93e1 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:10.266429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:10.267284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:10.267569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:10.267843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] PATH_INFO: `/v3/users/a17d76b7e754413185cf70f3103bc2dd` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:10.269740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17d76b7e754413185cf70f3103bc2dd)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:10.273923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:10.605374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17d76b7e754413185cf70f3103bc2dd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:10.608155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17d76b7e754413185cf70f3103bc2dd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:10.782793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17d76b7e754413185cf70f3103bc2dd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:10.801668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17d76b7e754413185cf70f3103bc2dd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:10.802813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17d76b7e754413185cf70f3103bc2dd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:10.842248 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3655/7322] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:10 2022] DELETE /identity/v3/users/a17d76b7e754413185cf70f3103bc2dd => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:10.849062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:10.854480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:10.855149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:10.961820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:10.963082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:11.143520 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3668/7323] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:11.161051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:11.163643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:11.194020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:11.291392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e819-8e10-47fe-990a-2050dcaee58c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:11.300400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:11.308873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:11.308873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:11.308873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:11.325511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:11.329773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:11.387874 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3656/7324] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:12.124462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:12.128968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:12.173738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855697b1-be59-48fb-aa79-fc4a32a79ed7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:12.191587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:12.192651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:12.193152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:12.193682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] PATH_INFO: `/v3/users/aa3860b970934de7a40ca9e14ecec4e9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:12.195833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3860b970934de7a40ca9e14ecec4e9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:12.199724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:12.452627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:12.454937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:12.472859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91a6fb-59eb-49d2-8b97-0b4b1f0eb1e9 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:12.478971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:12.479805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:12.480266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:12.480640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] PATH_INFO: `/v3/projects/7b622f2d47384931a570db411c947fb5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:12.482041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b622f2d47384931a570db411c947fb5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:12.484421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:12.507238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3860b970934de7a40ca9e14ecec4e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.512541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3860b970934de7a40ca9e14ecec4e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.616102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3860b970934de7a40ca9e14ecec4e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.640353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3860b970934de7a40ca9e14ecec4e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.643497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fdd9da1b-5907-4310-b2b4-ebec94850649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3860b970934de7a40ca9e14ecec4e9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.653331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:12.659684 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3669/7325] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:12 2022] DELETE /identity/v3/users/aa3860b970934de7a40ca9e14ecec4e9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:12.664563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:12.665116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:12.665702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:12.691149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:12.693785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:12.817912 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3670/7326] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:52:12.843690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:12.845317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:12.916817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b622f2d47384931a570db411c947fb5', 'request_id': 'req-790e4b87-3832-4ce0-ad84-ae7d172c49bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:12.936816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfbfe-c735-4b94-8278-ff2391718d39 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:13.001624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:13.002242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.002525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.002835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.219342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:13.219342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:13.231033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3671/7327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:13.292613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:13.305737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153d2f-be4c-49ac-bbea-d5aae031913a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:13.310255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:13.316139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.316139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.316139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.316139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:13.370767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b622f2d47384931a570db411c947fb5', 'request_id': 'req-790e4b87-3832-4ce0-ad84-ae7d172c49bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:13.377235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b622f2d47384931a570db411c947fb5', 'request_id': 'req-790e4b87-3832-4ce0-ad84-ae7d172c49bc'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:13.397477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] The token cache is being invalidate because project 7b622f2d47384931a570db411c947fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:13.398933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:13.399685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-790e4b87-3832-4ce0-ad84-ae7d172c49bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:13.405163 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3657/7328] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:12 2022] DELETE /identity/v3/projects/7b622f2d47384931a570db411c947fb5 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:13.406750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.407229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.407848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.469926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:13.471634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557fe63-a132-41fe-9062-f96142c009ec service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:13.504709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:13.506764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:13.517527 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3672/7329] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:13.524829 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3658/7330] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:13.532418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.532718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.532996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.558744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:13.560041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:13.570541 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3673/7331] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:13.575363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:13.587200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8dba-05fd-4e57-ba51-bd6641b287ba None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:13.600111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:13.600111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.600111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.600111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.600541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:52:13.600541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:13.600541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:13.613263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3659/7332] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:52:13.617700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:13.641298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c41b2-aa7e-47aa-b0ac-3688c1855fe4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:13.647799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:13.649569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:13.650204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:13.650761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:13.651642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:13.655248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:13.925602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:13.931297 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3674/7333] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:13 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:13.938322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b785303-7af8-4862-902f-b91158ea3f05 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.001367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.001978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.002440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.002929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.003567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.005629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.196180 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3660/7334] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:13 2022] POST /identity/v3/users => generated 282 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:14.200258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.217874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0ca8d-5d16-41a1-8c9e-e7c274051dbf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.227831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.234338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.234338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.234338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.234338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.234338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.238374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.240395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:14.250139 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3675/7335] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:14.254877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30389e-527d-4a82-ac16-08462bf186b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.256790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.263338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.264006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.264337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.264556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] PATH_INFO: `/v3/projects/812948831cce439a829de6eb2d27d9ca` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.265805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812948831cce439a829de6eb2d27d9ca)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.267919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.272481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d86c26-f8c3-484c-b5a1-7b348275834a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.283868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.284490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.284773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.285055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.285707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.287490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.305497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3676/7336] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:14.315313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.322473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ca016-0b54-452a-a527-a240b8529c8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.328417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.328851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.329141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.329438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] PATH_INFO: `/v3/projects/60ab02e1bd1b4269b6720e0eaed5e45d/users/27f5ee1cc19c47858490a4d4825623a4/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.353910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ab02e1bd1b4269b6720e0eaed5e45d, user_id=27f5ee1cc19c47858490a4d4825623a4, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.357282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e6947-17bf-4f9e-b4ab-6cafb346b4c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.502979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3677/7337] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:14 2022] PUT /identity/v3/projects/60ab02e1bd1b4269b6720e0eaed5e45d/users/27f5ee1cc19c47858490a4d4825623a4/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:14.513516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.513851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.514070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.526566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812948831cce439a829de6eb2d27d9ca', 'request_id': 'req-7f1d667a-7e30-4989-b987-38a532489e39'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:14.572072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] MFA Rules not processed for user `27f5ee1cc19c47858490a4d4825623a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:14.573347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:14.618322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812948831cce439a829de6eb2d27d9ca', 'request_id': 'req-7f1d667a-7e30-4989-b987-38a532489e39'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:14.626775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812948831cce439a829de6eb2d27d9ca', 'request_id': 'req-7f1d667a-7e30-4989-b987-38a532489e39'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:14.648056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] The token cache is being invalidate because project 812948831cce439a829de6eb2d27d9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:14.648889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:14.658857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:14.662508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3661/7338] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:14 2022] DELETE /identity/v3/projects/812948831cce439a829de6eb2d27d9ca => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:14.671184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.673918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:14.692607 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3678/7339] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:14.726042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:14.728260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:14.819261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d667a-7e30-4989-b987-38a532489e39 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.826320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.827421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.828122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.828625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] PATH_INFO: `/v3/users/a5716afd994d452f9f509648b185ecfb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.832391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5716afd994d452f9f509648b185ecfb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.835054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.861484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:14.877587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605782ba-81d0-451b-9aa8-993749db28ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:14.883604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:14.884877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:14.884877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:14.884877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:14.904464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:14.905994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:14.926502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3679/7340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:52:15.172494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5716afd994d452f9f509648b185ecfb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:15.173861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5716afd994d452f9f509648b185ecfb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:15.297994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5716afd994d452f9f509648b185ecfb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:15.329004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5716afd994d452f9f509648b185ecfb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:15.330079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b38f5abd-b3b0-4f1a-8602-d7b08452f50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5716afd994d452f9f509648b185ecfb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:15.351752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3662/7341] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:14 2022] DELETE /identity/v3/users/a5716afd994d452f9f509648b185ecfb => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:16.111490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:16.570898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:16.603258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943541d8-ff01-4d02-ab6f-1c8e23cc0a45 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:16.749586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:16.751172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:16.751871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:16.761053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] PATH_INFO: `/v3/projects/aa7751aec8a5463493e7e3f9f736af09` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:16.770502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7751aec8a5463493e7e3f9f736af09)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:16.777399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:16.965561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:16.971086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7751aec8a5463493e7e3f9f736af09', 'request_id': 'req-55a798e7-39a0-41e2-bf83-f1a498b45f09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:17.079558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7751aec8a5463493e7e3f9f736af09', 'request_id': 'req-55a798e7-39a0-41e2-bf83-f1a498b45f09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:17.095742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7751aec8a5463493e7e3f9f736af09', 'request_id': 'req-55a798e7-39a0-41e2-bf83-f1a498b45f09'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:17.117334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] The token cache is being invalidate because project aa7751aec8a5463493e7e3f9f736af09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:17.118029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:17.119052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55a798e7-39a0-41e2-bf83-f1a498b45f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:17.125523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3680/7342] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:16 2022] DELETE /identity/v3/projects/aa7751aec8a5463493e7e3f9f736af09 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:17.132370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:17.133501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:17.133501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:17.169211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:17.170451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:17.274334 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3663/7343] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:17.280849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:17.281140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:17.281558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:17.321596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:17.323675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:17.340899 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3681/7344] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:17.341511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:17.356277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073abdf1-810b-49b6-9705-792cff3a8be3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:17.361876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:17.362489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:17.362802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:17.363079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:17.363736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:52:17.364039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:17.365654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:17.395597 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3664/7345] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:52:17.400784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:17.411779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c8ae-0216-433f-9080-e8b5e0b42d54 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:17.420498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:17.421135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:17.421424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:17.421753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:17.423043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:17.424989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:17.456794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=79,keystone:INSERT=5,keystone:DELETE=16 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:17.608249 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3682/7346] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:17 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:17.608434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:17.627048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ee83-7b6f-42e0-8e03-fef2ff9d4423 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:17.775666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:17.776386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:17.776665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:17.776938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:17.778784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:17.781206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:17.998358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3665/7347] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:17 2022] POST /identity/v3/users => generated 297 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:17.999591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:18.017554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f455-32db-4b1e-838a-264186e1bf06 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:18.028262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:18.029182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.029637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.030304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.031353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:18.033173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:18.057425 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3683/7348] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:18.061918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:18.077550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566726d-9bd6-4f5f-8a25-5f7e6758b7e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:18.092444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:18.093373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.093845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.094308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.095171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:18.096976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a4ab-bed9-44c4-a676-d4912dd55ee7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:18.117829 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3666/7349] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:18.123092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:18.163460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c37fc7-0732-439c-b776-5509a5b83dba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:18.164733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:18.168324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.169619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.169917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] PATH_INFO: `/v3/projects/abb183720799411cb09748b22914bf0c/users/5eda3889b3934ee49b4b38340a76636f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.217545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb183720799411cb09748b22914bf0c, user_id=5eda3889b3934ee49b4b38340a76636f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:18.227072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:18.398108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3684/7350] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:18 2022] PUT /identity/v3/projects/abb183720799411cb09748b22914bf0c/users/5eda3889b3934ee49b4b38340a76636f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:52:18.413044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.413560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.413657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.469156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] MFA Rules not processed for user `5eda3889b3934ee49b4b38340a76636f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:18.470719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:18.613864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:18.615197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3667/7351] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:18.714770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5789c-91aa-4618-ad7b-3b12fe4d8c58 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:18.741580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:18.744989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.745714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.746424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.747417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:18.754146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:18.770110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:18.772165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:18.817252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682b9f7-3bd2-44ef-a285-1d898d9833e3 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:18.834728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:18.836515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:18.836823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:18.837163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] PATH_INFO: `/v3/users/43845ab6f1bf4ec392c598ca28edb799` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:18.840839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43845ab6f1bf4ec392c598ca28edb799)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:18.846815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:18.915516 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3685/7352] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:18 2022] POST /identity/v3/projects => generated 393 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:18.917859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.029753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207021-3ee1-4b84-ba31-1b605ea0b11a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.046120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.046120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.046120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.046120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.046823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:19.046823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:19.163466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3686/7353] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:18 2022] POST /identity/v3/users => generated 303 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:52:19.168629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.182561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43845ab6f1bf4ec392c598ca28edb799'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:19.184774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43845ab6f1bf4ec392c598ca28edb799'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:19.194393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beeb97-79ab-4d74-8c05-c0705cb1e2cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.208060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.209116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.211267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.212008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.213398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:19.216938 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:19.242995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3687/7354] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:52:19.244039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.246231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:19.262782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:19.269863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c144-aedf-4c24-b91d-33610801351b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.278871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.279766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.280430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.280891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] PATH_INFO: `/v3/projects/65b0909352824b1782a3dd0346408d51/users/68802c2c451c42c68be74abc8d148fa4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.285398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43845ab6f1bf4ec392c598ca28edb799'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:19.306839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b0909352824b1782a3dd0346408d51, user_id=68802c2c451c42c68be74abc8d148fa4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:19.310510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:19.315916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43845ab6f1bf4ec392c598ca28edb799'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:19.316771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43845ab6f1bf4ec392c598ca28edb799'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:19.343331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3668/7355] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:18 2022] DELETE /identity/v3/users/43845ab6f1bf4ec392c598ca28edb799 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:19.697052 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3688/7356] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:19 2022] PUT /identity/v3/projects/65b0909352824b1782a3dd0346408d51/users/68802c2c451c42c68be74abc8d148fa4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:19.698044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.746183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.748900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:19.808236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00daab5-a645-474c-b0ec-0f619e8eca0f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.859987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308b1-df0a-43ed-8cc3-06d13dee5e9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.866545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.869338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.869863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.870467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] PATH_INFO: `/v3/projects/70328f5f1b934c87b0b266216f2da904` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.872091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] RBAC: Authorizing `identity:delete_project(project_id=70328f5f1b934c87b0b266216f2da904)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:19.874253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:19.926238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.929118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.930260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.935063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.939815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:19.939815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:19.954586 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3669/7357] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:19.958548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:19.983952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a2871-0a4c-4dce-be87-e48bc9792489 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:19.994983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:19.995599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:19.995878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:19.996446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] PATH_INFO: `/v3/projects/65b0909352824b1782a3dd0346408d51/users/68802c2c451c42c68be74abc8d148fa4/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:19.999089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b0909352824b1782a3dd0346408d51, user_id=68802c2c451c42c68be74abc8d148fa4, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.001847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f209de-c4be-498b-9c05-5bc5bace7c94 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.013653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3670/7358] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:19 2022] PUT /identity/v3/projects/65b0909352824b1782a3dd0346408d51/users/68802c2c451c42c68be74abc8d148fa4/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:52:20.024570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.024918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.025203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.058643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] MFA Rules not processed for user `68802c2c451c42c68be74abc8d148fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:20.060357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.080398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70328f5f1b934c87b0b266216f2da904', 'request_id': 'req-5a067d48-8dd4-4f5f-bbc2-bb275395fade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:20.155486 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3671/7359] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:52:20.169858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:20.171144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.193846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70328f5f1b934c87b0b266216f2da904', 'request_id': 'req-5a067d48-8dd4-4f5f-bbc2-bb275395fade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:20.203712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70328f5f1b934c87b0b266216f2da904', 'request_id': 'req-5a067d48-8dd4-4f5f-bbc2-bb275395fade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:20.215935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] The token cache is being invalidate because project 70328f5f1b934c87b0b266216f2da904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:20.216310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:20.216967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5a067d48-8dd4-4f5f-bbc2-bb275395fade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:20.222497 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3689/7360] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:19 2022] DELETE /identity/v3/projects/70328f5f1b934c87b0b266216f2da904 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:52:20.225080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83260-38b3-42c8-99a1-26bd262a6bc4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.225367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83260-38b3-42c8-99a1-26bd262a6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.225640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83260-38b3-42c8-99a1-26bd262a6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.258480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ece83260-38b3-42c8-99a1-26bd262a6bc4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:20.261618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ece83260-38b3-42c8-99a1-26bd262a6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.271389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f1be-764e-49dc-a8d4-ec3ba29b61f0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:20.277923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:20.282771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.282771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.282771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.282771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.300524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.302143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.340892 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3672/7361] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:52:20.438727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:20.440288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3690/7362] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:20.440955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.451629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.452057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.452469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.459103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6181-6e33-4e88-8958-d7d54028eb1d service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:20.464979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:20.465603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.466192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.466337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.472262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.480707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:20.483172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:20.494718 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3691/7363] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:20.499728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:20.512929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814b58-2f9a-4bff-9251-479ecd41828d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:20.528228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:20.529283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.529856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.531270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.541086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:52:20.541086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.541086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.550810 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3692/7364] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:52:20.555594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:20.569653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d7cd-c9e0-493d-9dc4-170e4e7255bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:20.576410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:20.577179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.577635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.578034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.578835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.582297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.613343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.623532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.628190 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3673/7365] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:52:20.712899 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3693/7366] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:20 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:20.729359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:20.746311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883585-1e94-4ad1-853d-0dd0e646777f service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:20.813403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:20.824221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:20.824221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:20.824221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:20.824221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:20.824221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:20.981313 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3674/7367] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:20 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:20.986070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:21.002710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b9e7-ff15-470f-8f3b-b9c8453a811b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:21.010597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:21.011833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:21.012525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:21.013171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:21.014366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:21.017296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:21.036558 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3694/7368] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:21.043540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:21.056683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9acd83-56c1-4b6d-93f7-d17ed52c3bb9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:21.065216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:21.066715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:21.067190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:21.067643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:21.068534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:21.071593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced3a4a-d8fb-415e-8e29-b4ea78f506ba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:21.088997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3675/7369] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:21.093081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:21.108083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eea55-a419-4614-a441-110e424a37f5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:21.116647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:21.117491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:21.117869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:21.118397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] PATH_INFO: `/v3/projects/0614cdff75f94d2bad2e0ac75b52f131/users/45a44e99d4dd4691ba4222fe166df89c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:21.134808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0614cdff75f94d2bad2e0ac75b52f131, user_id=45a44e99d4dd4691ba4222fe166df89c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:21.137633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:21.226011 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3695/7370] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:21 2022] PUT /identity/v3/projects/0614cdff75f94d2bad2e0ac75b52f131/users/45a44e99d4dd4691ba4222fe166df89c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:21.230863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:21.231155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:21.231460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:21.253749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:21.255163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:21.317978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3676/7371] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:21.328777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:21.330571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:21.397869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8608a4-5499-4bbc-aed9-3580790afdea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:21.401786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:21.402398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:21.402714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:21.402994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:21.412570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:21.414073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1735493-cc26-4ba9-9a2f-60ea58683223 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:21.425041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3696/7372] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:22.257531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:24.262856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:25.996616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:26.347806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:28.497869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:31.609053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:31.611337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:31.644602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8049d-ad54-4222-b70a-cb21cd3c3886 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:31.662289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:31.664355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:31.664641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:31.664919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] PATH_INFO: `/v3/users/5eda3889b3934ee49b4b38340a76636f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:31.667758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eda3889b3934ee49b4b38340a76636f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:31.669745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:31.998387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eda3889b3934ee49b4b38340a76636f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:32.000081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eda3889b3934ee49b4b38340a76636f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:32.142075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eda3889b3934ee49b4b38340a76636f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:32.185870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eda3889b3934ee49b4b38340a76636f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:32.185870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eda3889b3934ee49b4b38340a76636f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:32.211630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:32.222943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3677/7373] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:31 2022] DELETE /identity/v3/users/5eda3889b3934ee49b4b38340a76636f => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:32.228113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913592b-0ed4-4ab7-bfc3-4591bbaf60a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:32.228627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913592b-0ed4-4ab7-bfc3-4591bbaf60a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:32.228726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913592b-0ed4-4ab7-bfc3-4591bbaf60a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:32.283988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0913592b-0ed4-4ab7-bfc3-4591bbaf60a5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:32.291844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0913592b-0ed4-4ab7-bfc3-4591bbaf60a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:32.479772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3697/7374] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:32.568255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:32.570330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:32.718688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1fe87-0c35-4b94-8525-58b4716bed8c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:32.719637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:32.725294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:32.725656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:32.726032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:32.743558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:32.745551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:32.762298 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3678/7375] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:35.365845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:35.366337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:35.366407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:35.407420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:35.408934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:35.481726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:35.534605 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3698/7376] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:35.554313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:35.556004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:35.716934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479546d-669a-4819-be10-6f8f689def54 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:35.724537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:35.725299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:35.725677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:35.726804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:35.749055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:35.750933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:35.765581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3679/7377] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:35.852139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:35.855067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:35.874231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4e93-5304-40d0-b1e3-a5b9935b50b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:35.880350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:35.881213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:35.881670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:35.882544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] PATH_INFO: `/v3/projects/abb183720799411cb09748b22914bf0c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:35.883932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb183720799411cb09748b22914bf0c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:35.885855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:36.084270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb183720799411cb09748b22914bf0c', 'request_id': 'req-8411ffa9-12aa-4438-854b-fba559122251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.205275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb183720799411cb09748b22914bf0c', 'request_id': 'req-8411ffa9-12aa-4438-854b-fba559122251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.215931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb183720799411cb09748b22914bf0c', 'request_id': 'req-8411ffa9-12aa-4438-854b-fba559122251'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.250104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] The token cache is being invalidate because project abb183720799411cb09748b22914bf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:36.250513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.251756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.253387 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3699/7378] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:35 2022] DELETE /identity/v3/projects/abb183720799411cb09748b22914bf0c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:36.258797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:36.279646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aed30-46af-46e4-9f4f-dc495ac487d3 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:36.360564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:36.361308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:36.361465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:36.361743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] PATH_INFO: `/v3/users/68802c2c451c42c68be74abc8d148fa4` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:36.362957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68802c2c451c42c68be74abc8d148fa4)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:36.365369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:36.391319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:36.393556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:36.423329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ffa9-12aa-4438-854b-fba559122251 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:36.431676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:36.432595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:36.433638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:36.434088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] PATH_INFO: `/v3/users/f6ceec4548f147928550a60165191242` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:36.435646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ceec4548f147928550a60165191242)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:36.438527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:36.623286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:36.652079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68802c2c451c42c68be74abc8d148fa4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.653325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68802c2c451c42c68be74abc8d148fa4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.779352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68802c2c451c42c68be74abc8d148fa4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.814702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ceec4548f147928550a60165191242'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.815689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ceec4548f147928550a60165191242'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.828951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68802c2c451c42c68be74abc8d148fa4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.829768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c4598b5f-1d8b-4a87-8ab5-271b6cab9f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68802c2c451c42c68be74abc8d148fa4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.850091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3680/7379] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:36 2022] DELETE /identity/v3/users/68802c2c451c42c68be74abc8d148fa4 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:36.906592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ceec4548f147928550a60165191242'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.947291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ceec4548f147928550a60165191242'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:36.949152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ceec4548f147928550a60165191242'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:37.004876 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3700/7380] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:36 2022] DELETE /identity/v3/users/f6ceec4548f147928550a60165191242 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:37.010600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:37.010915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:37.011191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:37.055244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:37.056610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:37.171010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3681/7381] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:37.189241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:37.191149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:37.329827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:37.346265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99cf89-205a-42a8-9077-6619e9b3873a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:37.352709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:37.353745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:37.354112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:37.354468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:37.367371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:37.369429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:37.383823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3701/7382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:37.772776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:37.775895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:37.804090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2acd-6a60-4c26-a289-4023cf4aa4df None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:37.826006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:37.827701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:37.827987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:37.833246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] PATH_INFO: `/v3/projects/65b0909352824b1782a3dd0346408d51` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:37.836751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b0909352824b1782a3dd0346408d51)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:37.840060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:38.027411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:38.029767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:38.076802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7edee-4a29-4f11-83ea-d586ac88917a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:38.082597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b0909352824b1782a3dd0346408d51', 'request_id': 'req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.206208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b0909352824b1782a3dd0346408d51', 'request_id': 'req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.223032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b0909352824b1782a3dd0346408d51', 'request_id': 'req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.281654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] The token cache is being invalidate because project 65b0909352824b1782a3dd0346408d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:38.283481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.285823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fa11c4e7-e8d1-4a96-b4c0-cc7614494ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.294058 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3682/7383] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:37 2022] DELETE /identity/v3/projects/65b0909352824b1782a3dd0346408d51 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:38.301720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51848-f2b3-4ecb-8036-d2b29dce594c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.302550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51848-f2b3-4ecb-8036-d2b29dce594c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.303344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51848-f2b3-4ecb-8036-d2b29dce594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.341021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:38.341707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.345273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.346047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] PATH_INFO: `/v3/projects/6fcc90548b264d3b985f8fe42b856967` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.352437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcc90548b264d3b985f8fe42b856967)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:38.361610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:38.409868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bdd51848-f2b3-4ecb-8036-d2b29dce594c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:38.412666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bdd51848-f2b3-4ecb-8036-d2b29dce594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:38.469843 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3683/7384] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:38.482871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47764-307d-4813-bb97-d9bf6d31c2d5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.486059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47764-307d-4813-bb97-d9bf6d31c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.487082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47764-307d-4813-bb97-d9bf6d31c2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.599071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e2b47764-307d-4813-bb97-d9bf6d31c2d5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:38.600695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2b47764-307d-4813-bb97-d9bf6d31c2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:38.605078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcc90548b264d3b985f8fe42b856967', 'request_id': 'req-8930b0ea-86a7-4714-b8a6-11271ff473cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.630686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:38.721387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcc90548b264d3b985f8fe42b856967', 'request_id': 'req-8930b0ea-86a7-4714-b8a6-11271ff473cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.759472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcc90548b264d3b985f8fe42b856967', 'request_id': 'req-8930b0ea-86a7-4714-b8a6-11271ff473cf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.810040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] The token cache is being invalidate because project 6fcc90548b264d3b985f8fe42b856967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:52:38.814352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.815823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:38.823746 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3684/7386] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:52:38.826455 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3702/7386] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:52:38 2022] DELETE /identity/v3/projects/6fcc90548b264d3b985f8fe42b856967 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:38.828107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600758f-3ded-44f0-90c4-17b9302fb940 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.828551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600758f-3ded-44f0-90c4-17b9302fb940 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.828871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:38.829149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600758f-3ded-44f0-90c4-17b9302fb940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.833633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:38.868101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930b0ea-86a7-4714-b8a6-11271ff473cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:38.882042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:38.884873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6600758f-3ded-44f0-90c4-17b9302fb940 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:38.885195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.885673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.887286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.888507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:52:38.888895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6600758f-3ded-44f0-90c4-17b9302fb940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:38.895156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:38.895156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:38.912859 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3685/7387] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:38.920674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:38.921198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:38.921908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:38.935141 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3703/7388] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:52:38.939985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:38.999689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a5a3-5834-483b-82ec-b92507421520 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.015985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:39.023118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:39.024749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.030686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.031548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.031548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.034814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.038985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.066193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3686/7389] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:39.070960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.098059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bda908-cbb8-4010-ae8b-20af839fdcd6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.104504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.108096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.108096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.108096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.108096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:52:39.108096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.112383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.142191 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3687/7390] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:52:39.149231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.171903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b6be-dde3-454d-80a5-fd9963f2388a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.183246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.190071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.190441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.190810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.191531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.194078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.236431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3704/7391] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:38 2022] POST /identity/v3/projects => generated 407 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:39.240413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.381571 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3688/7392] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:39 2022] POST /identity/v3/projects => generated 359 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:39.382924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.399473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342915-30eb-47fe-a5da-6473808a49a8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.482631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.483453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.483876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.484249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.485011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.487373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.520460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b00c49-8401-4ae9-9fb3-95acad7b7e78 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.535406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.536050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.536335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.536610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.537254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.543274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.651825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3689/7393] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:39 2022] POST /identity/v3/users => generated 280 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:52:39.652815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3705/7394] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:39 2022] POST /identity/v3/users => generated 304 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:39.655787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.661132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.684821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a488dc-835d-4af2-ba92-21cb46d4c7a5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.688929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce903-0fdd-4989-a85a-2f9766f3a084 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.698866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.698965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.699909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.700193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.700854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.714569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.715712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.716399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.717229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.718648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.720592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.733426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.745238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3706/7395] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:52:39.749308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.775562 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3690/7396] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:52:39.777184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f3b1e-53f3-4733-a2a5-09467a642aaf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.786189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.791327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.792341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.792828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.793300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.794352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.796474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.823828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeda24a-3b3e-4599-8577-0cf9f9376db3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.837927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3707/7397] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:52:39.843303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.856220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.856866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.857296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.857571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.858345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.859319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160da5-23be-4a3b-b945-3eb0b4d72772 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.862509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.875273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.881019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.881749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.883129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] PATH_INFO: `/v3/projects/b5a142f8d12d4d9787d7b44a23e7baa0/users/73b5a7c2ff234cc29c6fbb0f91125651/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.901429 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3691/7398] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:39.901706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:39.925614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9531aa-a416-443f-9c6e-5a5696b79719 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:39.928483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a142f8d12d4d9787d7b44a23e7baa0, user_id=73b5a7c2ff234cc29c6fbb0f91125651, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.934555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b043cdd-d796-4cb6-a6c4-2971f1d50a73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:39.956427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:39.957132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:39.957614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:39.957907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] PATH_INFO: `/v3/projects/8f46e38ad8fe4260b3aaf2439e0f28d3/users/717aa15d2f1142c7a3928a5294293846/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:39.992490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f46e38ad8fe4260b3aaf2439e0f28d3, user_id=717aa15d2f1142c7a3928a5294293846, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:39.997155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514dcac-a63a-4f47-a37d-67721aa9edb5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:40.091770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3708/7399] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:39 2022] PUT /identity/v3/projects/b5a142f8d12d4d9787d7b44a23e7baa0/users/73b5a7c2ff234cc29c6fbb0f91125651/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:52:40.103831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:40.104191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:40.104765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:40.128747 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3692/7400] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:39 2022] PUT /identity/v3/projects/8f46e38ad8fe4260b3aaf2439e0f28d3/users/717aa15d2f1142c7a3928a5294293846/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:40.145007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073611d-317d-4079-9a53-97ade1512254 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:40.145483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073611d-317d-4079-9a53-97ade1512254 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:40.145946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073611d-317d-4079-9a53-97ade1512254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:40.200229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:40.287812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] MFA Rules not processed for user `73b5a7c2ff234cc29c6fbb0f91125651`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:40.290185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:40.293002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a073611d-317d-4079-9a53-97ade1512254 None None] MFA Rules not processed for user `717aa15d2f1142c7a3928a5294293846`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:40.295213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a073611d-317d-4079-9a53-97ade1512254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:40.442238 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3709/7401] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:52:40.446181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:40.519324 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3693/7402] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:40.565520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073611d-317d-4079-9a53-97ade1512254 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:40.568394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a073611d-317d-4079-9a53-97ade1512254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:40.641156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeac79-9068-4ca8-973f-963972086a66 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:40.654192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:40.655002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:40.655319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:40.655570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:40.656208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:40.659713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:40.777351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073611d-317d-4079-9a53-97ade1512254 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:40.783965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:40.784599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:40.784877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:40.790164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:40.815153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:40.816722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:40.863038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3694/7403] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:40.910282 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3710/7404] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:52:40 2022] POST /identity/v3/projects => generated 409 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:52:40.911424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:40.934595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dd2da-4e30-4162-903b-ba29d66bb817 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:41.091135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:41.091755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.092042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.092319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.092972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:41.101167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561ba9-9c87-4e2f-acd0-6d29263ef5fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:41.281338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:41.283744 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3695/7405] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:52:40 2022] POST /identity/v3/users => generated 311 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:52:41.321785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ddc97-16e0-404c-a234-99357bc5d784 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:41.333789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:41.336168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.336519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.336795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.337457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:41.339974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:41.371334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.371831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.372308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.382735 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3711/7406] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:41.388903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:41.411066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51a8f-17af-4790-9f68-cbbb495387a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:41.422861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:41.424214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:41.424669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:41.425530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.425913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.426384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] PATH_INFO: `/v3/projects/da3e1ddac1d247bda9c21bc735d86076/users/c56051a7ec404f029df3a62c12f072eb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.462199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3e1ddac1d247bda9c21bc735d86076, user_id=c56051a7ec404f029df3a62c12f072eb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:41.465335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:41.535860 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3696/7407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:41.567231 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3712/7408] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:41 2022] PUT /identity/v3/projects/da3e1ddac1d247bda9c21bc735d86076/users/c56051a7ec404f029df3a62c12f072eb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:52:41.568540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:41.590220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:41.600895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd0e48-6377-470f-963b-fb27d43d8c58 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:41.717189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:41.717918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.718261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.720473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.721239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:41.723774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c43a-4d90-47ac-bb4e-183f81e742b1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:41.735146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3697/7409] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:52:41.739278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:41.763881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c701e-120e-4432-9b91-802dcfaa259d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:41.781420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:41.783445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.783445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.783445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] PATH_INFO: `/v3/projects/da3e1ddac1d247bda9c21bc735d86076/users/c56051a7ec404f029df3a62c12f072eb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.785109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3e1ddac1d247bda9c21bc735d86076, user_id=c56051a7ec404f029df3a62c12f072eb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:41.787872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:41.803017 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3713/7410] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:52:41 2022] PUT /identity/v3/projects/da3e1ddac1d247bda9c21bc735d86076/users/c56051a7ec404f029df3a62c12f072eb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:52:41.813795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:41.814285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:41.814713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:41.875062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] MFA Rules not processed for user `c56051a7ec404f029df3a62c12f072eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:52:41.876299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:42.003691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3698/7411] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:52:42.018783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:42.020666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:42.160726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1699-924b-4632-ba31-311eb9d75ec2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:42.166139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:42.166829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:42.167109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:42.167377 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:42.179654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:42.181122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:42.209421 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3714/7412] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:42.745605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:42.760579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8ac89-6dc7-49da-a10f-ad02b75f9423 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:42.764949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:42.765578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:42.765926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:42.766257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:42.781805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:42.859713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:42.861373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:42.879543 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3699/7413] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:43.344901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:49.053961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:49.055804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:49.210374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b886-1590-4ec2-8de0-db36ebabef87 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:49.214329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:49.215065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:49.215406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:49.215735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:49.217574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:52:49.231922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:49.233475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620139-f3fc-4045-80db-df24bb936a6c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:49.246345 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3715/7414] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:52:55.503307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:59.138413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:52:59.239432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:52:59.254701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2623-211b-4a24-a905-cceb9f9efd47 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:52:59.261660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:52:59.262689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:52:59.263047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:52:59.263579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] PATH_INFO: `/v3/users/73b5a7c2ff234cc29c6fbb0f91125651` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:52:59.265207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b5a7c2ff234cc29c6fbb0f91125651)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:52:59.267379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:52:59.987191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b5a7c2ff234cc29c6fbb0f91125651'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:52:59.988895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b5a7c2ff234cc29c6fbb0f91125651'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:00.138955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b5a7c2ff234cc29c6fbb0f91125651'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:00.156015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b5a7c2ff234cc29c6fbb0f91125651'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:00.161529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b5a7c2ff234cc29c6fbb0f91125651'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:00.176892 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3700/7415] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:52:59 2022] DELETE /identity/v3/users/73b5a7c2ff234cc29c6fbb0f91125651 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:00.181423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:00.181720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:00.181984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:00.206989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:00.208794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:00.309183 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3716/7416] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:00.319213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:00.322133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:00.430054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b79c2-0bb2-428c-8179-c2f1854db07a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:00.434520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:00.435169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:00.435448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:00.435723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:00.447011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:00.449326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:00.460834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3701/7417] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:01.269351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:01.270911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:01.285214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70633f2-fe5b-453c-8cb5-3764173393da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:01.298440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:01.299164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:01.299440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:01.299756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] PATH_INFO: `/v3/projects/b5a142f8d12d4d9787d7b44a23e7baa0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:01.310753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a142f8d12d4d9787d7b44a23e7baa0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:01.310753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:01.454014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a142f8d12d4d9787d7b44a23e7baa0', 'request_id': 'req-edc01f4b-8eac-4543-991c-0dd4f48a993f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:01.540176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a142f8d12d4d9787d7b44a23e7baa0', 'request_id': 'req-edc01f4b-8eac-4543-991c-0dd4f48a993f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:01.547476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a142f8d12d4d9787d7b44a23e7baa0', 'request_id': 'req-edc01f4b-8eac-4543-991c-0dd4f48a993f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:01.576001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] The token cache is being invalidate because project b5a142f8d12d4d9787d7b44a23e7baa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:01.577082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:01.579143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:01.583045 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3717/7418] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:01 2022] DELETE /identity/v3/projects/b5a142f8d12d4d9787d7b44a23e7baa0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:01.591622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:01.612933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d8ac-cfad-4126-b812-35bf814187dd service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:01.646572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:01.735371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:01.738976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:01.738976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:01.738976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] PATH_INFO: `/v3/users/c56051a7ec404f029df3a62c12f072eb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:01.741742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56051a7ec404f029df3a62c12f072eb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:01.747787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:01.997319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56051a7ec404f029df3a62c12f072eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:02.004938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56051a7ec404f029df3a62c12f072eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:02.111808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56051a7ec404f029df3a62c12f072eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:02.137463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56051a7ec404f029df3a62c12f072eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:02.145621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e083efa3-d305-4e41-803a-cd0560bf5e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56051a7ec404f029df3a62c12f072eb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:02.175217 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3702/7419] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:53:01 2022] DELETE /identity/v3/users/c56051a7ec404f029df3a62c12f072eb => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:04.139510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:04.141513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:04.176678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc01f4b-8eac-4543-991c-0dd4f48a993f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:04.339715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:04.340642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:04.341122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:04.341613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] PATH_INFO: `/v3/projects/da3e1ddac1d247bda9c21bc735d86076` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:04.343200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3e1ddac1d247bda9c21bc735d86076)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:04.345421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:04.663417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:04.701822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3e1ddac1d247bda9c21bc735d86076', 'request_id': 'req-ea06c922-b983-48be-a81d-08c9c24ffb2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:05.688944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3e1ddac1d247bda9c21bc735d86076', 'request_id': 'req-ea06c922-b983-48be-a81d-08c9c24ffb2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:05.699077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3e1ddac1d247bda9c21bc735d86076', 'request_id': 'req-ea06c922-b983-48be-a81d-08c9c24ffb2b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:05.716409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] The token cache is being invalidate because project da3e1ddac1d247bda9c21bc735d86076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:05.716986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:05.718042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea06c922-b983-48be-a81d-08c9c24ffb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:05.722839 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3718/7420] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:04 2022] DELETE /identity/v3/projects/da3e1ddac1d247bda9c21bc735d86076 => generated 0 bytes in 1582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:05.725716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:05.727121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:05.728519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:05.781861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:05.784576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:05.939910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3703/7421] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:05.948743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:05.949023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:05.949330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:05.995554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:05.996861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:06.023316 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3719/7422] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:06.025507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.042828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7297-7173-4b0b-ab56-a77f366e3d80 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.053675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.055951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.060248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.060248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.060813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:53:06.061239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.063919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:06.117770 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3704/7423] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:53:06.122910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.138334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda05c-f98e-4a2e-b690-4e76d8098d72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.149463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.160187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.163319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.163735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.166506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.170415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:06.356772 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3720/7424] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:06 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:53:06.364222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.391228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93453a54-62bf-483e-b47f-6b9d5ad5ecac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.463808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:06.507444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.508907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.509734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.510056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.510988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.513335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:06.673673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.681661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3705/7425] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:06 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:06.687939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde2ce-2161-4c27-9801-07ce9d75295f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.693345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.694036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.694245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.694522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.695224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.697128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:06.726274 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3721/7426] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:06.734301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.756574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13b3a7-04e8-47eb-b43e-887712eea6f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.766029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.767181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.767679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.768158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.769727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.771776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784a7df-1208-4a5b-a42e-74bbc2400d2e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:06.791150 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3706/7427] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:06.792639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:06.818390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc65da-5bab-4e1f-8a86-f2740fa9b99b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:06.830789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:06.832196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:06.832497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:06.832782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] PATH_INFO: `/v3/projects/acc0901ef4b847d995740fcfb6e3e3d7/users/c29c4522c3204e24adeeffb44d7031f5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:06.869941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc0901ef4b847d995740fcfb6e3e3d7, user_id=c29c4522c3204e24adeeffb44d7031f5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:06.869941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:07.177888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3722/7428] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:06 2022] PUT /identity/v3/projects/acc0901ef4b847d995740fcfb6e3e3d7/users/c29c4522c3204e24adeeffb44d7031f5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:07.177975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:07.177975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:07.177975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:07.185040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:07.186282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:07.271438 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3707/7429] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:07.283190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:07.286718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:07.419363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313623c-8870-44ab-9cdc-de1c8b3ba936 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:07.425556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:07.427469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:07.428015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:07.428397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:07.441103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:07.442852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7c8bd-c13f-4c65-a234-fc7f275e096a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:07.480510 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3723/7430] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:10.279765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:10.281646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:10.317435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70166bda-fbf7-4bde-beee-e2439d4bd82b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:10.339556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:10.340623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:10.342160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:10.343428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] PATH_INFO: `/v3/users/717aa15d2f1142c7a3928a5294293846` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:10.354498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717aa15d2f1142c7a3928a5294293846)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:10.358657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:10.812847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717aa15d2f1142c7a3928a5294293846'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:10.813952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717aa15d2f1142c7a3928a5294293846'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:10.951756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717aa15d2f1142c7a3928a5294293846'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:10.969778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:10.970374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:10.971750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:11.014733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717aa15d2f1142c7a3928a5294293846'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:11.015771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ac0996c6-3f64-45f6-a45d-becbb8c29188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717aa15d2f1142c7a3928a5294293846'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:11.062130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] MFA Rules not processed for user `c29c4522c3204e24adeeffb44d7031f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:11.062582 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3708/7431] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:53:10 2022] DELETE /identity/v3/users/717aa15d2f1142c7a3928a5294293846 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:11.064979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:11.066936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:11.067491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:11.068026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:11.092266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:11.093786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:11.118929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:11.203319 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3709/7432] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:11.214910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:11.216779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:11.226178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:11.271306 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3724/7433] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:53:11.285036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:11.287050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:11.336673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746916-5b3b-4c01-8e2e-08abb174eff8 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:11.342930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:11.343814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:11.344200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:11.344597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:11.360343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:11.362387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:11.375933 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3710/7434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:11.395272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f555de-63f5-49fd-a7f0-96e3b0f4d4e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:11.405726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:11.406727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:11.407087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:11.407439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:11.438559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:11.441182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c86c05-0361-460e-8115-981fbafd3b23 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:11.475122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3725/7435] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:12.183246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:12.184930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:12.229149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4dd4-c0f6-46ea-97e0-b4768fc1d3c9 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:12.237768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:12.239502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:12.241609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:12.242134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] PATH_INFO: `/v3/projects/8f46e38ad8fe4260b3aaf2439e0f28d3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:12.246245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f46e38ad8fe4260b3aaf2439e0f28d3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:12.253009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:12.512968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f46e38ad8fe4260b3aaf2439e0f28d3', 'request_id': 'req-350658d5-a2a4-4a90-b07c-3c79d67d70cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:12.636087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f46e38ad8fe4260b3aaf2439e0f28d3', 'request_id': 'req-350658d5-a2a4-4a90-b07c-3c79d67d70cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:12.674463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f46e38ad8fe4260b3aaf2439e0f28d3', 'request_id': 'req-350658d5-a2a4-4a90-b07c-3c79d67d70cd'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:12.691054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] The token cache is being invalidate because project 8f46e38ad8fe4260b3aaf2439e0f28d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:12.691353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:12.692041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-350658d5-a2a4-4a90-b07c-3c79d67d70cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:12.694749 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3711/7436] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:12 2022] DELETE /identity/v3/projects/8f46e38ad8fe4260b3aaf2439e0f28d3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:12.702139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:12.702934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:12.703080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:12.773551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:12.778228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:12.894040 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3726/7437] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:12.913659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:12.914170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:12.915961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:12.969592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:12.971967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:12.983966 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3712/7438] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:12.989403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.004044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8c0c9-26c0-4cde-84cc-d119797535bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.012897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.013796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.014935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.015214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.018656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:53:13.019492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.023216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:13.048530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3727/7439] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:53:13.051578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.086815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7b89-22d5-4b85-8d32-bedc350b56d5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.102577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.103868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.104247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.104614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.106280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.108760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:13.332923 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3713/7440] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:13 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:13.337763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.354349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50379-4764-46a9-8ca1-19a5c967cfff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.466896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.467807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.468130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.468442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.470457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.474092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:13.791671 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3728/7441] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:13 2022] POST /identity/v3/users => generated 288 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:53:13.797302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.847095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20419c-8ee8-42c2-a62b-f88b57f6185f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.857445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.858035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.858331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.858601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.859279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.864004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:13.884445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3714/7442] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:13.886137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.901251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55394-6143-4978-a452-56d734bb06a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.910765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.911827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.912548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.913396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.915632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.926110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fef76-fa21-4946-8582-4c74ad9cb06f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:13.947053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3729/7443] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:53:13.948313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:13.966087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db011f-3b38-448b-b772-9dcb861c7642 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:13.972004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:13.973097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:13.973602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:13.974082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] PATH_INFO: `/v3/projects/cb113dfa0abf45ac8b344b68e6c15714/users/c6e57ef96e58415f905c7a5954b177f2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:13.996488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb113dfa0abf45ac8b344b68e6c15714, user_id=c6e57ef96e58415f905c7a5954b177f2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:13.999839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:14.245753 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3715/7444] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:13 2022] PUT /identity/v3/projects/cb113dfa0abf45ac8b344b68e6c15714/users/c6e57ef96e58415f905c7a5954b177f2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:14.260526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:14.261649 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:14.262080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:14.306331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] MFA Rules not processed for user `c6e57ef96e58415f905c7a5954b177f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:14.308577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:14.391583 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3730/7445] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:14.400823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:14.402723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:14.491056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caf5e0-1c5b-4173-b142-7d563010e516 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:14.496032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:14.497006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:14.497292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:14.497572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:14.508862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:14.510315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59a8bf-88f8-44d3-9927-341ca4907560 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:14.528531 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3716/7446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:15.034896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:15.441334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:16.289295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:16.375704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5276-d817-447a-9e5a-bf8aef71600c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:16.381625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:16.382287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:16.382569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:16.382876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] PATH_INFO: `/v3/users/c6e57ef96e58415f905c7a5954b177f2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:16.384005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e57ef96e58415f905c7a5954b177f2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:16.385932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:16.769217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e57ef96e58415f905c7a5954b177f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:16.769904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e57ef96e58415f905c7a5954b177f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:16.953676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e57ef96e58415f905c7a5954b177f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:16.994850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e57ef96e58415f905c7a5954b177f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:16.995604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e57ef96e58415f905c7a5954b177f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:17.010751 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3731/7447] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:53:16 2022] DELETE /identity/v3/users/c6e57ef96e58415f905c7a5954b177f2 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:17.015765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:17.017620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:17.017902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:17.046575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:17.048418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:17.166328 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3717/7448] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:17.176998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:17.178473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:17.290980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbaadf-69ef-4673-8a2c-91f39b3d2325 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:17.295214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:17.295838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:17.296117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:17.296391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:17.307756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:17.309408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b120ae-2ef1-4930-b53b-167eb97ba3e9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:17.321206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3732/7449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:53:18.970882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:18.972998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:18.991611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d9769-4f0e-41e4-9321-3437413882ee None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:19.002472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:19.003371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:19.003789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:19.004191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] PATH_INFO: `/v3/projects/cb113dfa0abf45ac8b344b68e6c15714` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:19.005538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb113dfa0abf45ac8b344b68e6c15714)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:19.010565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:19.284652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb113dfa0abf45ac8b344b68e6c15714', 'request_id': 'req-dece9bf2-0846-4df8-bc55-c3162df024ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:19.610128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb113dfa0abf45ac8b344b68e6c15714', 'request_id': 'req-dece9bf2-0846-4df8-bc55-c3162df024ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:19.634169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb113dfa0abf45ac8b344b68e6c15714', 'request_id': 'req-dece9bf2-0846-4df8-bc55-c3162df024ae'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:19.658227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] The token cache is being invalidate because project cb113dfa0abf45ac8b344b68e6c15714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:19.658731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:19.659600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dece9bf2-0846-4df8-bc55-c3162df024ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:19.661629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3718/7450] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:18 2022] DELETE /identity/v3/projects/cb113dfa0abf45ac8b344b68e6c15714 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:19.666775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:19.667302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:19.667302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:19.707956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:19.717964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:19.808890 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3733/7451] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:53:19.817073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:19.817360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:19.817664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:19.845393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:19.847639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:19.858102 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3719/7452] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:19.863219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:19.889619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee701-582d-454a-8db6-34e5f5d45598 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:19.899330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:19.899330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:19.899330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:19.899330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:19.900380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:53:19.900380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:19.905315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:19.935095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3734/7453] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:53:19.939568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:19.949906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cee6ba-2d82-4aa0-9173-8dd50a12ae22 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:19.962081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:19.962877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:19.963159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:19.963435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:19.964102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:19.966054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:20.196835 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3720/7454] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:19 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:53:20.201951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:20.221561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41398b4-7c68-4dc8-8559-6cdd3c6d0a14 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:20.312620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:20.314137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:20.314593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:20.315160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:20.317449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:20.320921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:20.371014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:20.635363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:20.636084 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3735/7455] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:20 2022] POST /identity/v3/users => generated 291 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:20.650975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3dec4-1ff3-45d4-a09f-3d704efc376b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:20.656354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:20.657370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:20.658109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:20.659384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:20.660409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:20.676531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:20.731312 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3721/7456] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:53:20.736462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:20.753750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401d32-3cb3-42b5-a3e7-5ec4d4935fe9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:20.771911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:20.772804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:20.773282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:20.773761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:20.774757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:20.777055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a045cf-3de5-4595-b3ad-7e3720c53ba2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:20.810695 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3736/7457] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:20.811558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:20.826816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee6d91-fcab-4428-896d-70b49d737454 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:20.832805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:20.833714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:20.834078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:20.834889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] PATH_INFO: `/v3/projects/42456a80f9034915960bb6a5a543f92e/users/3337130940054517828d5edc4fd932d3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:20.898461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42456a80f9034915960bb6a5a543f92e, user_id=3337130940054517828d5edc4fd932d3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:20.903792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:21.119672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3722/7458] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:20 2022] PUT /identity/v3/projects/42456a80f9034915960bb6a5a543f92e/users/3337130940054517828d5edc4fd932d3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:21.130284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:21.130943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:21.131415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:21.172396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] MFA Rules not processed for user `3337130940054517828d5edc4fd932d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:21.174431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:21.303610 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3737/7459] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:21.308329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:21.441135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96340-84c4-4a89-b1d0-115b4869cfb7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:21.449697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:21.450351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:21.450915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:21.451191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:21.451884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:21.456955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:21.720225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3723/7460] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:21 2022] POST /identity/v3/projects => generated 379 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:21.725897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:21.754636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8c87-8951-4e11-aa5b-6d93d0fba7e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:21.844890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:21.846141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:21.846141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:21.846141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:21.847049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:21.849547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.145651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3738/7461] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:21 2022] POST /identity/v3/users => generated 296 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:22.150075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:22.164411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f00ac-9c09-46a9-aed0-062a67273dc7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:22.169934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:22.171589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.172029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.172983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.173778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:22.176156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.191953 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3724/7462] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:53:22.196173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:22.207639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32491a9-0fc9-42b0-b334-f23dd2ce9f99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:22.212838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:22.213856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.214193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.214681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] PATH_INFO: `/v3/projects/cda51a6367904328af2d8fbd602bcfec/users/b6f6ebe17d3543acbffd12f3ccb6eb51/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.235864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda51a6367904328af2d8fbd602bcfec, user_id=b6f6ebe17d3543acbffd12f3ccb6eb51, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:22.242364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.383470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:22.390292 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3739/7463] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:22 2022] PUT /identity/v3/projects/cda51a6367904328af2d8fbd602bcfec/users/b6f6ebe17d3543acbffd12f3ccb6eb51/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:53:22.395741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:22.406922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17a74-2bd7-4e81-8d3e-5dd696d38fec admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:22.477841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:22.478477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.478796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.479075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.479733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:22.481416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dd79a-11db-474a-8815-dc8371a33f54 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.493380 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3725/7464] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:22.497951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:22.513388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda80e-62f3-46bc-bed1-c33d3526f1da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:22.528877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:22.529898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.530438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.531584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] PATH_INFO: `/v3/projects/cda51a6367904328af2d8fbd602bcfec/users/b6f6ebe17d3543acbffd12f3ccb6eb51/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.534763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda51a6367904328af2d8fbd602bcfec, user_id=b6f6ebe17d3543acbffd12f3ccb6eb51, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:22.555988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.573199 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3740/7465] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:22 2022] PUT /identity/v3/projects/cda51a6367904328af2d8fbd602bcfec/users/b6f6ebe17d3543acbffd12f3ccb6eb51/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:22.598000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.599628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.599628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.639032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] MFA Rules not processed for user `b6f6ebe17d3543acbffd12f3ccb6eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:22.640178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:22.748921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3726/7466] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:53:22.772378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:22.775462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:22.907795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9aaf8-8f2a-47de-9056-d9348417768f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:22.913241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:22.917720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:22.917720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:22.917720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:22.931014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:22.932777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21f76-6fb6-4622-85d2-ac179ec0c57d service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:22.948189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3741/7467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:23.343416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:23.360477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c134bb-0260-417c-84c6-34ae1339cfda None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:23.364712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:23.365529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:23.366084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:23.366504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:23.462195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:23.463908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:23.474762 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3727/7468] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:26.284711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:26.906484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:26.906870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:26.906962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:26.932918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:26.938078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:27.053476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3742/7469] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:27.987254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:29.388084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:29.393444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:29.503259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b4061-3a20-48d4-bedc-3e125651da5e service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:29.513279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:29.514026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:29.514539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:29.515063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:29.517938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:29.539074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:29.540843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067f85c-e6b5-4ff4-bd5b-afe3476b80dc service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:29.561124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3728/7470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:30.697552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:35.535297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:35.537416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:35.673434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46c45d-caf1-41f1-a811-c6debaa0101d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:35.680067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:35.680813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:35.681211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:35.682283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:35.685030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:35.731186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:35.736791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:35.776876 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3743/7471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:42.262573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:43.210534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:43.210891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:43.211323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:43.267456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:43.271536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:43.456797 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3729/7472] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:53:43.754211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:43.756591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:43.949367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46ab0-6ce0-4a0c-bf3f-7f376eaf8597 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:43.964795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:43.967711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:43.968830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:43.969367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:43.987201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:43.989424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726197e6-bbfb-44ef-871a-a7d3ba26f2ed service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:43.998273 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3744/7473] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:53:48.434744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:48.666050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde20a8-83ec-4989-9b2b-f6929645fe12 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:48.686862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:48.687771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:48.690420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:48.690929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] PATH_INFO: `/v3/users/3337130940054517828d5edc4fd932d3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:48.694529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3337130940054517828d5edc4fd932d3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:48.701194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:49.130849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3337130940054517828d5edc4fd932d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:49.132233 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3337130940054517828d5edc4fd932d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:49.265409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3337130940054517828d5edc4fd932d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:49.306644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3337130940054517828d5edc4fd932d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:49.310130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3337130940054517828d5edc4fd932d3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:49.352491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:49.353141 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3730/7474] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:53:48 2022] DELETE /identity/v3/users/3337130940054517828d5edc4fd932d3 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:49.353533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:49.353961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:49.427411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:49.437342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:49.601920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:49.753724 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3745/7475] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:53:49.852170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:49.856550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:49.947329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:50.057455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744a87-92d2-4534-90aa-a60b01aab55b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:50.074102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:50.083788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:50.084127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:50.084402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:50.107125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:50.109698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:50.187432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3731/7476] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:53:51.360830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:51.368882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:51.447909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2df1f-44b9-400a-a75c-9e157b310106 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:51.466383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:51.467825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:51.468150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:51.470753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] PATH_INFO: `/v3/projects/42456a80f9034915960bb6a5a543f92e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:51.473323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42456a80f9034915960bb6a5a543f92e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:51.486028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:51.888046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42456a80f9034915960bb6a5a543f92e', 'request_id': 'req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.013396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42456a80f9034915960bb6a5a543f92e', 'request_id': 'req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.027743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42456a80f9034915960bb6a5a543f92e', 'request_id': 'req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.059738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] The token cache is being invalidate because project 42456a80f9034915960bb6a5a543f92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:52.060226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.062219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-92ac4322-d9a9-4a13-9f63-f3fe42d38c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.068354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3746/7477] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:51 2022] DELETE /identity/v3/projects/42456a80f9034915960bb6a5a543f92e => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:52.074291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:52.100361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c218-2a02-4b12-a428-3b8514d0e08a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:52.270202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:52.271848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:52.272294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:52.272721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] PATH_INFO: `/v3/users/b6f6ebe17d3543acbffd12f3ccb6eb51` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:52.274241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f6ebe17d3543acbffd12f3ccb6eb51)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:52.285417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:52.672592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f6ebe17d3543acbffd12f3ccb6eb51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.688630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f6ebe17d3543acbffd12f3ccb6eb51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.881451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f6ebe17d3543acbffd12f3ccb6eb51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.924773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f6ebe17d3543acbffd12f3ccb6eb51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.928870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f6ebe17d3543acbffd12f3ccb6eb51'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:52.995408 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3732/7478] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:53:52 2022] DELETE /identity/v3/users/b6f6ebe17d3543acbffd12f3ccb6eb51 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:53.429846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f060d-f967-4359-91c2-46121f8b6aaa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:53.431424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f060d-f967-4359-91c2-46121f8b6aaa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:53.431915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f060d-f967-4359-91c2-46121f8b6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:53.490941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a11f060d-f967-4359-91c2-46121f8b6aaa None None] MFA Rules not processed for user `cb1efcbda6484a28b11a721d6184b324`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:53.492405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a11f060d-f967-4359-91c2-46121f8b6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:53.643364 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3747/7479] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:54.230701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:54.232792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:54.334694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:54.380621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8871d74-a19a-4ce6-90a8-874a255bbd93 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:54.395075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:54.395991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:54.396465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:54.396842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] PATH_INFO: `/v3/projects/cda51a6367904328af2d8fbd602bcfec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:54.402709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda51a6367904328af2d8fbd602bcfec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:54.408576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:54.606493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda51a6367904328af2d8fbd602bcfec', 'request_id': 'req-60e6f218-aa62-427f-9677-9611c55316f0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:54.709923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda51a6367904328af2d8fbd602bcfec', 'request_id': 'req-60e6f218-aa62-427f-9677-9611c55316f0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:54.720042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda51a6367904328af2d8fbd602bcfec', 'request_id': 'req-60e6f218-aa62-427f-9677-9611c55316f0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:54.753692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] The token cache is being invalidate because project cda51a6367904328af2d8fbd602bcfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:53:54.758291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:54.762656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-60e6f218-aa62-427f-9677-9611c55316f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:53:54.771325 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3733/7480] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:53:54 2022] DELETE /identity/v3/projects/cda51a6367904328af2d8fbd602bcfec => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:54.777741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:54.778602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:54.779046 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:54.830095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:54.832266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:54.989929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:55.011269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3748/7481] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:55.020225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.020506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.021401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.070661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:55.075249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:55.098852 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3734/7482] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:55.100531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.118547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add68d-f06d-44bd-8e91-3ae8f98faab5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:55.128078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:55.130005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.130351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.137876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.137876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:53:55.137876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:55.139172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:55.173472 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3749/7483] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:53:55.181279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.205411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb545be-3bf1-4a92-9d9c-9fee9d6ca67b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:55.231510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:55.232449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.233829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.239422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.247004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:55.249945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:55.476479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3735/7484] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:55 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:55.478090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.497629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7300ca-10d5-4eae-99c1-b7924b0a6dcb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:55.695986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:55.697513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.697944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.698351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.699200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:55.701299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:55.847801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.848672 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3750/7485] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:55 2022] POST /identity/v3/users => generated 291 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:55.865138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146d7f-9084-4ea2-8bdf-b809f1ad76fb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:55.872976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:55.880993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.880993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.880993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.880993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:55.882055 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:55.898700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.904997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3736/7486] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:55.914122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d90c-2d51-426c-aa35-40ba431cb8b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:55.932039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:55.932991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:55.933850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:55.934347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:55.935148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:55.936893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270ef6-20c7-48e0-bf02-a14f5637a256 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:55.956398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3751/7487] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:53:55.967686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:55.998727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230475-0e9c-476b-823f-9575250ae327 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:56.016086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:56.016846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:56.017156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:56.017755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] PATH_INFO: `/v3/projects/b61b295affbe4e919e744926c7fb1a09/users/232281193eb7460c9520e0accf5b5a44/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:56.053415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61b295affbe4e919e744926c7fb1a09, user_id=232281193eb7460c9520e0accf5b5a44, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:56.056350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:56.173647 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3737/7488] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:55 2022] PUT /identity/v3/projects/b61b295affbe4e919e744926c7fb1a09/users/232281193eb7460c9520e0accf5b5a44/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:56.186986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:56.187299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:56.195957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:56.250194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] MFA Rules not processed for user `232281193eb7460c9520e0accf5b5a44`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:56.251650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:56.396133 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3752/7489] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:56.398031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:56.525351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63c25-bf4c-4285-b8a2-f9a98c54544e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:56.537071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:56.537997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:56.538355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:56.538816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:56.539795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:56.542860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:56.766934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:56.800511 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3738/7490] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:53:56 2022] POST /identity/v3/projects => generated 379 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:56.800686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:56.813681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b8c98-ad09-4d86-a43a-e9b0e238c5f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:56.908115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:56.912633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:56.912633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:56.912633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:56.912633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:56.915004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:57.061972 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3753/7491] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:53:56 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:53:57.067088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:57.085462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b017e-745a-43c6-84e8-094a7ad4f855 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:57.106544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:57.107544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:57.108162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:57.108540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:57.109399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:57.111323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:57.134997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3739/7492] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:57.139972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:57.154943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96b5f-8d4b-416a-8cd5-1b3c7e4521f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:57.162225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:57.163512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:57.163512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:57.163910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] PATH_INFO: `/v3/projects/cf0168680a5a4903a114d8a81f439b5a/users/9cc0f597924f466eba24c08a40b21ea3/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:57.187511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0168680a5a4903a114d8a81f439b5a, user_id=9cc0f597924f466eba24c08a40b21ea3, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:57.193322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:57.346517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3754/7493] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:57 2022] PUT /identity/v3/projects/cf0168680a5a4903a114d8a81f439b5a/users/9cc0f597924f466eba24c08a40b21ea3/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:57.350472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:57.364554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a439-a80e-46c1-b3e8-e97e00cf0aac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:57.550509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:57.551513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:57.551886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:57.555515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:57.556421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:57.558739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1bbc2-adba-4803-b618-9e5b2434c425 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:57.580363 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3740/7494] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:53:57.580559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:57.647177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578199d0-418d-43bb-b920-e5ee46913dee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:57.687570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:57.688340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:57.688659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:57.688941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] PATH_INFO: `/v3/projects/cf0168680a5a4903a114d8a81f439b5a/users/9cc0f597924f466eba24c08a40b21ea3/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:57.703138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0168680a5a4903a114d8a81f439b5a, user_id=9cc0f597924f466eba24c08a40b21ea3, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:57.707198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:57.726487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:53:57.747719 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3755/7495] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:53:57 2022] PUT /identity/v3/projects/cf0168680a5a4903a114d8a81f439b5a/users/9cc0f597924f466eba24c08a40b21ea3/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:53:57.748825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:57.749119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:57.749394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:57.811256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] MFA Rules not processed for user `9cc0f597924f466eba24c08a40b21ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:53:57.812745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:58.091015 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3741/7496] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:53:58.107500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:53:58.109947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:53:58.305111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259ed1-cd6e-400d-9f09-444314fc4c1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:53:58.310280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:53:58.310983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:53:58.313462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:53:58.313462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:53:58.326331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:53:58.327930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:53:58.339612 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3756/7497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:00.413582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:00.434435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da330-6ae3-46b6-a3bf-f06578f725f7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:00.450568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cc0f597924f466eba24c08a40b21ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0168680a5a4903a114d8a81f439b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:00.451419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:00.452197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:00.452545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:00.453867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:54:00.453867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:00.455375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:00.473969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3742/7498] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:54:00.477989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:00.522248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3a43-d5b9-49c0-8004-bac0e87a44c3 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:00.522248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cc0f597924f466eba24c08a40b21ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0168680a5a4903a114d8a81f439b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:00.522248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:00.522680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:00.522680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:00.522680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:00.522680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:00.914690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3757/7499] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:54:00 2022] POST /identity/v3/projects => generated 353 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:54:00.915984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:00.927689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f4d8-7855-4d50-9b31-478f9c72a064 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:01.033841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:01.041480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cc0f597924f466eba24c08a40b21ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0168680a5a4903a114d8a81f439b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:01.042609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:01.043418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:01.043838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:01.044503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:54:01.051550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:01.051550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:01.073729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3743/7500] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:54:01.136456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:01.165908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582893-e04a-47c8-b8a2-5fb4c7da8042 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:01.174325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cc0f597924f466eba24c08a40b21ea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0168680a5a4903a114d8a81f439b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:01.175029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:01.175318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:01.175596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] PATH_INFO: `/v3/projects/737b6fae5033444d8f8eff08a0b09d20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:01.178449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorizing `identity:delete_project(project_id=737b6fae5033444d8f8eff08a0b09d20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:01.184565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:01.424106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737b6fae5033444d8f8eff08a0b09d20', 'request_id': 'req-43fa952e-43d5-4600-a0fa-ffeb642f4d97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:01.537734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737b6fae5033444d8f8eff08a0b09d20', 'request_id': 'req-43fa952e-43d5-4600-a0fa-ffeb642f4d97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:01.546557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737b6fae5033444d8f8eff08a0b09d20', 'request_id': 'req-43fa952e-43d5-4600-a0fa-ffeb642f4d97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:01.582652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] The token cache is being invalidate because project 737b6fae5033444d8f8eff08a0b09d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:54:01.587214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:01.587214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:01.591362 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3758/7501] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:54:01 2022] DELETE /identity/v3/projects/737b6fae5033444d8f8eff08a0b09d20 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:02.603453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:02.607270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:02.812557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419ada8-8bc9-4f6b-bc24-947ec1b32cc3 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:02.934402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3357b95-781c-415f-9363-904a51178391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:02.935150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357b95-781c-415f-9363-904a51178391 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:02.935429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357b95-781c-415f-9363-904a51178391 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:02.935770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357b95-781c-415f-9363-904a51178391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:02.937497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b3357b95-781c-415f-9363-904a51178391 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:02.941640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:02.943061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:02.972605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:03.046384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa952e-43d5-4600-a0fa-ffeb642f4d97 tempest-VolumeQuotaClassesTest-929080444 tempest-VolumeQuotaClassesTest-929080444-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:03.057509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:03.058494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:03.060417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:03.061028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] PATH_INFO: `/v3/users/232281193eb7460c9520e0accf5b5a44` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:03.062465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232281193eb7460c9520e0accf5b5a44)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:03.064777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:03.120638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357b95-781c-415f-9363-904a51178391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:03.125576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357b95-781c-415f-9363-904a51178391 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:03.161354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3744/7502] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:54:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:54:03.465369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232281193eb7460c9520e0accf5b5a44'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:03.468548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232281193eb7460c9520e0accf5b5a44'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:03.644059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232281193eb7460c9520e0accf5b5a44'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:03.730284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232281193eb7460c9520e0accf5b5a44'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:03.732174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232281193eb7460c9520e0accf5b5a44'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:03.761140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3759/7503] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:54:02 2022] DELETE /identity/v3/users/232281193eb7460c9520e0accf5b5a44 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:54:03.767889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:03.768420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:03.768420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:03.847285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:03.849714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:03.917140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:03.987572 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3745/7504] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:04.031291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:04.032894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:04.169795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6554e21-5cf3-4442-bef3-faf5bd3417f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:04.234162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:04.234162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:04.234479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:04.234550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:04.278858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:04.280330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:04.309122 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3760/7505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:05.455257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:05.457377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:05.480766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44eeae4-4f36-497c-bab0-736044a180fd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:05.500988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:05.502167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:05.502674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:05.503102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] PATH_INFO: `/v3/projects/b61b295affbe4e919e744926c7fb1a09` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:05.504660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61b295affbe4e919e744926c7fb1a09)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:05.506990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:05.820435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61b295affbe4e919e744926c7fb1a09', 'request_id': 'req-7eef7534-80d2-4fad-9399-a32c02925522'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:05.913753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61b295affbe4e919e744926c7fb1a09', 'request_id': 'req-7eef7534-80d2-4fad-9399-a32c02925522'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:05.926913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61b295affbe4e919e744926c7fb1a09', 'request_id': 'req-7eef7534-80d2-4fad-9399-a32c02925522'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:05.960012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] The token cache is being invalidate because project b61b295affbe4e919e744926c7fb1a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:54:05.960645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:05.961963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:05.965208 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3746/7506] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:54:05 2022] DELETE /identity/v3/projects/b61b295affbe4e919e744926c7fb1a09 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:05.970837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:05.986420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94eb56-a7d0-4d9c-adb9-2d476206b75d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:06.159114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:06.273665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:06.274379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:06.274863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:06.276018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] PATH_INFO: `/v3/users/9cc0f597924f466eba24c08a40b21ea3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:06.282347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc0f597924f466eba24c08a40b21ea3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:06.289708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:06.663912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc0f597924f466eba24c08a40b21ea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:06.665491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc0f597924f466eba24c08a40b21ea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:07.102679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc0f597924f466eba24c08a40b21ea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:07.116521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc0f597924f466eba24c08a40b21ea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:07.117210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d65d0e-30c3-467f-8b81-4f8f9afb2c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc0f597924f466eba24c08a40b21ea3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:07.129900 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3761/7507] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:54:05 2022] DELETE /identity/v3/users/9cc0f597924f466eba24c08a40b21ea3 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:08.575350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:08.576897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:08.593584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7534-80d2-4fad-9399-a32c02925522 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:08.685592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:08.686174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:08.686465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:08.686767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] PATH_INFO: `/v3/projects/cf0168680a5a4903a114d8a81f439b5a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:08.688270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0168680a5a4903a114d8a81f439b5a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:08.690463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:08.963864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0168680a5a4903a114d8a81f439b5a', 'request_id': 'req-42c34926-23bc-4679-b5ae-08bb27903f20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:09.120546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0168680a5a4903a114d8a81f439b5a', 'request_id': 'req-42c34926-23bc-4679-b5ae-08bb27903f20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:09.124108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:09.129934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0168680a5a4903a114d8a81f439b5a', 'request_id': 'req-42c34926-23bc-4679-b5ae-08bb27903f20'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:09.149380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] The token cache is being invalidate because project cf0168680a5a4903a114d8a81f439b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:54:09.149611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:09.150295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-42c34926-23bc-4679-b5ae-08bb27903f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:09.152659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3747/7508] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:54:08 2022] DELETE /identity/v3/projects/cf0168680a5a4903a114d8a81f439b5a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:09.167619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.167619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.167619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.188024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:09.188024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:09.312098 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3762/7509] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:09.321115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.321476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.322417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.346547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:09.347956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:09.357839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3748/7510] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:09.362964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.380770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832fcfe-4d65-488d-9e68-f7c298901f2b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.395088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.395983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.396466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.396939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.397790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:54:09.398296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.400182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:09.419487 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3763/7511] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:54:09.421527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.438915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05be22-4604-4810-950f-9a21d62bba17 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.446289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.447153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.447563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.447940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.448686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.452164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:09.561890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3749/7512] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:54:09 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:54:09.565940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.576659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039168-37e6-4d80-9d83-8239ea9d8f85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.676648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.677419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.677769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.678123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.678943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.681676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:09.803552 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3764/7513] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:54:09 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:54:09.807529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.822161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87090060-4d17-4abf-a792-cce87a521648 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.841859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.842964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.843401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.843819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.844629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.846594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:09.873641 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3750/7514] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:09.877818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.896627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7592ac-012c-4d68-8323-1931856b6a1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.901019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.901645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.901933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.902207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.902898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.904547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:09.922694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3765/7515] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:09.927079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:09.939504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527560-6009-4b37-9f66-0712163d32ac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:09.944767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:09.945436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:09.945712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:09.945985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] PATH_INFO: `/v3/projects/9f7ec4bb5ebc476da30cbca73893332a/users/9855d8db94ed451580373bd5fa75440b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:09.963315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7ec4bb5ebc476da30cbca73893332a, user_id=9855d8db94ed451580373bd5fa75440b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:09.966306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7d89-a551-411b-9bb4-03fdc677a453 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:10.084613 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:10.086681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:10.173247 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3751/7516] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:54:09 2022] PUT /identity/v3/projects/9f7ec4bb5ebc476da30cbca73893332a/users/9855d8db94ed451580373bd5fa75440b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:54:10.184774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964757-a327-4b52-a559-70144da266eb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:10.185312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964757-a327-4b52-a559-70144da266eb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:10.185731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964757-a327-4b52-a559-70144da266eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:10.194514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f59658-b803-4904-906c-1940900987b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:10.247633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b7964757-a327-4b52-a559-70144da266eb None None] MFA Rules not processed for user `9855d8db94ed451580373bd5fa75440b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:10.248817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b7964757-a327-4b52-a559-70144da266eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:10.291882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:10.292801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:10.293321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:10.295280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:10.299965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:10.329896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:10.344297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:10.375112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3766/7517] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:10.378375 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3752/7518] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:54:10.379041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:10.486995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955f52-0ac0-45a5-b8ad-0b220c8dc7f7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:10.496366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:10.497108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:10.497852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:10.497852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:10.498674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:10.503763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:10.728927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3767/7519] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:54:10 2022] POST /identity/v3/projects => generated 379 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:54:10.733456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964757-a327-4b52-a559-70144da266eb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:10.751449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964757-a327-4b52-a559-70144da266eb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:10.867582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:10.998554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:11.000414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.001888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.002272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.004963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:11.010737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:11.200038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3753/7520] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:54:10 2022] POST /identity/v3/users => generated 296 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:54:11.209592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:11.226531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819183e5-e8ca-4958-91ee-7863160edce1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:11.240370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:11.241011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.241424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.241710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.242360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:11.244881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:11.269214 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3768/7521] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:11.272976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:11.288242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1b06-0045-486e-8e31-5a9772e4f540 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:11.299817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:11.300903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.301461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.302091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] PATH_INFO: `/v3/projects/90008313cf074826ad6eae1542682924/users/d69f9235e4544c48bd229b65e183420e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.327639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90008313cf074826ad6eae1542682924, user_id=d69f9235e4544c48bd229b65e183420e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:11.332343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:11.441476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3754/7522] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:54:11 2022] PUT /identity/v3/projects/90008313cf074826ad6eae1542682924/users/d69f9235e4544c48bd229b65e183420e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:11.445703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:11.460969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b2a-246c-489c-a101-dfedac0d8ef9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:11.566715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:11.567577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.568037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.568307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.569378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:11.571387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcfac0-fd1d-4d02-b35f-aa5690b1965a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:11.584440 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3769/7523] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:11.588288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:11.607062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246b37-5ad4-408e-8f34-c0efcc6e77f2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:11.611270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:11.611973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.612262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.612538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] PATH_INFO: `/v3/projects/90008313cf074826ad6eae1542682924/users/d69f9235e4544c48bd229b65e183420e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.614735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90008313cf074826ad6eae1542682924, user_id=d69f9235e4544c48bd229b65e183420e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:11.617442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:11.630848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3755/7524] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:54:11 2022] PUT /identity/v3/projects/90008313cf074826ad6eae1542682924/users/d69f9235e4544c48bd229b65e183420e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:11.640575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfae-818b-4d85-a982-a18bd3c0e124 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:11.640856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfae-818b-4d85-a982-a18bd3c0e124 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:11.641149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfae-818b-4d85-a982-a18bd3c0e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:11.679612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e5dbfae-818b-4d85-a982-a18bd3c0e124 None None] MFA Rules not processed for user `d69f9235e4544c48bd229b65e183420e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:11.681657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e5dbfae-818b-4d85-a982-a18bd3c0e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:11.811385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3770/7525] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:11.823669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:11.825697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:12.014213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68695a41-16a9-4ae7-887d-93197bdbe9a4 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:12.028950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:12.029987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:12.030416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:12.030874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:12.230869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:12.239611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:12.266964 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3756/7526] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:14.246400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:14.902204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:16.858140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:16.858846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:16.858846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:16.935831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:16.937247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:17.035752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:17.097773 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3771/7527] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:17.112390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:17.112390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:17.306460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4e76-3cf2-4954-9fef-38b480e1ff46 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:17.316735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:17.317654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:17.318098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:17.318587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:17.343579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:17.346152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d009c07-f36d-42ac-a506-aa6df9bf87e7 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:17.370761 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3757/7528] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:54:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:54:21.815474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:21.817081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:22.022855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033b32-0881-44fd-9fa1-7239a947c0bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:22.031143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:22.032482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:22.032917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:22.033290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] PATH_INFO: `/v3/users/27f5ee1cc19c47858490a4d4825623a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:22.035784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f5ee1cc19c47858490a4d4825623a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:22.037875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:22.401997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f5ee1cc19c47858490a4d4825623a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:22.403584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f5ee1cc19c47858490a4d4825623a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:22.489644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f5ee1cc19c47858490a4d4825623a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:22.522395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f5ee1cc19c47858490a4d4825623a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:22.523700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f5ee1cc19c47858490a4d4825623a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:22.548530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3772/7529] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:54:21 2022] DELETE /identity/v3/users/27f5ee1cc19c47858490a4d4825623a4 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:22.549408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:22.550189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:22.550668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:22.578921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:22.581182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:22.592852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:22.696276 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3758/7530] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:22.722408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:22.728716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:22.907775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e803c7f-87f0-4d82-a586-babdd909457d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:22.919864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:22.920493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:22.920774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:22.921048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:22.943300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:22.944939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b1ae5-5474-47f2-a565-48d66d0cccf7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:22.981464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3773/7531] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:23.412258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:23.415776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:23.444397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f44d2c-a808-4f75-a5f1-5220db275eea None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:23.468836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:23.472048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:23.472969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:23.473378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] PATH_INFO: `/v3/projects/60ab02e1bd1b4269b6720e0eaed5e45d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:23.480960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ab02e1bd1b4269b6720e0eaed5e45d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:23.487964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:23.730323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ab02e1bd1b4269b6720e0eaed5e45d', 'request_id': 'req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:23.929374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ab02e1bd1b4269b6720e0eaed5e45d', 'request_id': 'req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:23.946580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ab02e1bd1b4269b6720e0eaed5e45d', 'request_id': 'req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:23.961191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] The token cache is being invalidate because project 60ab02e1bd1b4269b6720e0eaed5e45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:54:23.961669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:23.962392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffa086a3-dcaa-4bde-a3df-d55d78f5c4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:54:23.967429 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3759/7532] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:54:23 2022] DELETE /identity/v3/projects/60ab02e1bd1b4269b6720e0eaed5e45d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:23.969183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:23.969648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:23.969745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:23.980970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:23.994940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:23.996258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:24.071115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.091202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.091202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.091712 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3774/7533] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:24.096924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:24.098267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:24.106639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3760/7534] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:54:24.111056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.122502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636af6-edb2-4972-b159-b2b355f04860 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.128574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.129714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.129714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.129908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.130516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:54:24.130837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.133487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:24.152053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3775/7535] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:54:24.159109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.169284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784453-8c7d-4d86-b343-d23d97343b59 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.175885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.176884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.176884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.177111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.177856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.181109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:24.509165 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3761/7536] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:54:24 2022] POST /identity/v3/projects => generated 365 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:54:24.513295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.523718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50d74-d866-4ee5-91e9-41e40cc5bea7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.604545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.605603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.606038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.606517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.607870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.609991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:24.744937 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3776/7537] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:54:24 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:54:24.748981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.761713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922563-c7d4-49be-92da-3fa049a9b65e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.767315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.768367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.768840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.769302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.773056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.775140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:24.814347 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3762/7538] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:24.814930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.837748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea6bee-64ad-44bc-9da0-f76cfef70ba0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.864742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.867929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.867929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.867929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.867929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.868723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050046-9fff-4ce7-9372-1506500268c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:24.891807 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3777/7539] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:54:24.896242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:24.912404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91750fd-12bc-495d-8187-97207277e45a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:24.932244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:24.932951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:24.933230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:24.933502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] PATH_INFO: `/v3/projects/9c23c36f053b43b8839ee2a3e1730e25/users/1f3644858960445da117ac73f681ac08/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:24.973659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c23c36f053b43b8839ee2a3e1730e25, user_id=1f3644858960445da117ac73f681ac08, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:24.977880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:25.142685 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3763/7540] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:54:24 2022] PUT /identity/v3/projects/9c23c36f053b43b8839ee2a3e1730e25/users/1f3644858960445da117ac73f681ac08/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:54:25.150214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:25.150772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:25.150772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:25.185477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] MFA Rules not processed for user `1f3644858960445da117ac73f681ac08`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:25.186730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:25.306963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:25.315861 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3778/7541] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:25.326985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:25.329190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:25.377684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:25.412128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69956c-a8a8-4ded-961b-2d55617d2298 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:25.416967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:25.417719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:25.418048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:25.418395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:25.432561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:25.434124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:25.445836 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3764/7542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:29.076688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:29.078248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:29.170793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81053-50ba-4d06-87e9-f240f5961d52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:29.181939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:29.182699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:29.183153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:29.183782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:29.186185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:29.284635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:29.286295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401e011-78e5-4aaa-bcf4-45072cceed41 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:29.309665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3779/7543] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:54:36.396793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=13 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:39.298068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=54 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:54:42.316281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:42.316281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:42.451346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b9e00-0cae-476f-a7f7-2bf2dd51c0f9 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:42.460567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:42.463704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:42.463704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:42.463704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:42.466670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:42.489926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:42.491846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:42.539638 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3765/7544] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:44.860431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:44.860431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:44.860431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:44.908656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:54:44.910141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:45.011319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3780/7545] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:54:45.032835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:45.053917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddee88-9fa5-4f31-abd4-401ed1d32e84 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:45.064218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:45.065085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:45.065532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:45.066044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:45.106592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:45.109861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:45.134048 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3766/7546] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:54:53.069477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:54:53.071003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:53.127939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb618ca9-f8f3-4ee2-883d-3d2f3e613935 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:54:53.162108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:54:53.165397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:54:53.165685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:54:53.166010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:54:53.173855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:54:53.238224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:54:53.245063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57de89-c483-4594-bf29-f46bc3d8e3d6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:54:53.336534 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3781/7547] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:54:55.117448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=40 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:03.288540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:08.335320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:08.337321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:08.559847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9486-c003-4d7c-9703-137a1b89c470 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:08.580539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:08.588033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:08.588562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:08.589005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] PATH_INFO: `/v3/users/cb1efcbda6484a28b11a721d6184b324` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:08.591909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1efcbda6484a28b11a721d6184b324)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:08.596395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:08.993381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1efcbda6484a28b11a721d6184b324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:08.998908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1efcbda6484a28b11a721d6184b324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:09.228205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1efcbda6484a28b11a721d6184b324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:09.277439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1efcbda6484a28b11a721d6184b324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:09.278538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1efcbda6484a28b11a721d6184b324'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:09.318959 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3767/7548] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:55:08 2022] DELETE /identity/v3/users/cb1efcbda6484a28b11a721d6184b324 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:09.323812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:09.324408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:09.324611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:09.373999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:09.375640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:09.566204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:09.567032 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3782/7549] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:09.567691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:09.720070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5066dbd-361d-43a7-bd54-466d45c3f387 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:09.731795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:09.731795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:09.731795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:09.732097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:09.758519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:09.760119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:09.819755 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3768/7550] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:55:10.481152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:10.483104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:10.498457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416d50-cae6-4eff-a039-47cf9a261e25 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:10.504016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:10.504663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:10.504942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:10.505214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] PATH_INFO: `/v3/projects/06de869412a34daaacdf1e72de7971e9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:10.507628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06de869412a34daaacdf1e72de7971e9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:10.509671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:10.912592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06de869412a34daaacdf1e72de7971e9', 'request_id': 'req-acec41a9-718a-4456-8412-82ff777591c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.015753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06de869412a34daaacdf1e72de7971e9', 'request_id': 'req-acec41a9-718a-4456-8412-82ff777591c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.026220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06de869412a34daaacdf1e72de7971e9', 'request_id': 'req-acec41a9-718a-4456-8412-82ff777591c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.093423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] The token cache is being invalidate because project 06de869412a34daaacdf1e72de7971e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:55:11.093423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.102138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.109833 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3783/7551] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:55:10 2022] DELETE /identity/v3/projects/06de869412a34daaacdf1e72de7971e9 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:11.112255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:11.143128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:11.157623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebac6-f745-40bb-aa68-2fe4a2481e49 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:11.267588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:11.268411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:11.268702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:11.268954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] PATH_INFO: `/v3/users/233a8a7950ca47c5b199c1152dffd343` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:11.270677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233a8a7950ca47c5b199c1152dffd343)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:11.273378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:11.623498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233a8a7950ca47c5b199c1152dffd343'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.624754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233a8a7950ca47c5b199c1152dffd343'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.787000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233a8a7950ca47c5b199c1152dffd343'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.823154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233a8a7950ca47c5b199c1152dffd343'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.825285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eaf1cd03-5afe-4f92-bd58-c80e3945d938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233a8a7950ca47c5b199c1152dffd343'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:11.966932 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3769/7552] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:55:11 2022] DELETE /identity/v3/users/233a8a7950ca47c5b199c1152dffd343 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:12.947061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:12.948571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:12.973079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec41a9-718a-4456-8412-82ff777591c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:13.115717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:13.116212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:13.116648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:13.117269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] PATH_INFO: `/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:13.118965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b1d57f4a5d43e9b40cc2f2e8f38023)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:13.121397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:13.357689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:13.395757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b1d57f4a5d43e9b40cc2f2e8f38023', 'request_id': 'req-3c58ff98-4442-4e0f-9c4a-23929d14ab05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:13.483772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b1d57f4a5d43e9b40cc2f2e8f38023', 'request_id': 'req-3c58ff98-4442-4e0f-9c4a-23929d14ab05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:13.490939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b1d57f4a5d43e9b40cc2f2e8f38023', 'request_id': 'req-3c58ff98-4442-4e0f-9c4a-23929d14ab05'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:13.521405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] The token cache is being invalidate because project c6b1d57f4a5d43e9b40cc2f2e8f38023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:55:13.521788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:13.525477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c58ff98-4442-4e0f-9c4a-23929d14ab05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:55:13.531467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3784/7553] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:55:12 2022] DELETE /identity/v3/projects/c6b1d57f4a5d43e9b40cc2f2e8f38023 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:13.534941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ce19-003f-47ca-bad4-86b2b451170d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:13.539131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ce19-003f-47ca-bad4-86b2b451170d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:13.539131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ce19-003f-47ca-bad4-86b2b451170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:13.578129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2774ce19-003f-47ca-bad4-86b2b451170d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:13.585040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2774ce19-003f-47ca-bad4-86b2b451170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:13.598102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:13.598766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:13.599200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:13.693464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:13.694897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:13.816699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3770/7554] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:13.823397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:13.825924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:13.826287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:13.845598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3785/7555] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:13.862797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:13.864381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:13.866276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:13.868664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:13.874699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3771/7556] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:13.878791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:13.918714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cf69-2156-4f3b-9a88-4f1255e72a04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:13.941130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:13.941387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:13.941665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:13.941931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:13.942585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:55:13.942917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:13.944543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:13.973418 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3772/7557] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:55:13.980209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:13.992114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:14.004434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0791c-83e1-4937-a902-a6d5341c231c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.015382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.020064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.020064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.020064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.020064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.020064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.058748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5715-c168-42e9-b3cf-300645ccd836 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.065085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.065786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.066065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.066687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.081566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.083430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.100796 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3786/7558] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:55:14.223492 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3773/7559] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:55:14.224477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:14.237326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d294a-5a04-4997-8301-5a0ecf1397f8 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.392604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.392977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.393288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.393744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.394499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.397122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.571200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3787/7560] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:55:14 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:55:14.575561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:14.591186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac666a-0c4a-435e-979b-5cb13b1a7c64 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.597700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.598362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.598669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.599139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.600964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.603153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.620708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:14.622171 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3774/7561] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:14.632903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024a6b-a366-4724-ac85-8b3ede8a6aae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.637847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.638477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.639074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.639074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.639731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.642306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.658784 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3788/7562] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:14.659666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:14.673936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedc2d-8a71-48f2-8917-08298b8ba5c2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:14.688692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:14.689383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.689659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.689932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] PATH_INFO: `/v3/projects/813e9d8dfd6f46e5bd19734acc0914d8/users/860b83d4d8fa487e872b02d96e96c0ea/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.744409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813e9d8dfd6f46e5bd19734acc0914d8, user_id=860b83d4d8fa487e872b02d96e96c0ea, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:14.755874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16985-f258-4886-9eb0-061ec2b22264 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:14.756772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:14.758773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:14.897974 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3775/7563] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:55:14 2022] PUT /identity/v3/projects/813e9d8dfd6f46e5bd19734acc0914d8/users/860b83d4d8fa487e872b02d96e96c0ea/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:55:14.912811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:14.913104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:14.913365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:14.982730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476dde-6c3a-427c-b949-9274eb68e586 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:15.071714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] MFA Rules not processed for user `860b83d4d8fa487e872b02d96e96c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:15.072966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:15.219598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:15.220229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:15.225950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:15.227414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:15.235839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:15.255283 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3776/7564] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:15.261534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:15.274074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:15.277013 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:15.312218 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3789/7565] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:55:15.334943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:15.457577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac056a-6720-461d-b160-253e974d58ab None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:15.485091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:15.485091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:15.485091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:15.485091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:15.485557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:15.485557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:15.654952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3777/7566] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:55:15 2022] POST /identity/v3/projects => generated 389 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:55:15.660673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:15.677681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09854b-5e65-432e-bd2f-f69a7cd6c95e service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:15.801363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:15.801363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:15.801363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:15.801777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:15.802586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:15.804664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:16.205604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3790/7567] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:55:15 2022] POST /identity/v3/users => generated 295 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:55:16.210275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:16.228207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a8c9-0b1d-431b-b030-a277eb0e7843 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:16.234733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:16.236163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:16.236163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:16.236461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:16.237078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:16.246454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:16.266565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:16.267436 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3778/7568] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:16.280875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7c6b-f4fa-4f26-abac-a1939bd90c23 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:16.301537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:16.301537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:16.301537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:16.301537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:16.301935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:16.302534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e468d4-c10d-4e00-ac46-992977492880 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:16.346850 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3791/7569] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:16.349857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:16.363580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b5bd-a241-4a80-bf7a-d7274ed37cbe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:16.383253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:16.384601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:16.386417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:16.386894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] PATH_INFO: `/v3/projects/d43f646d0c1b42e9b2cc7b271c649173/users/e46efe4ddb1d465ebc218fea92a587ec/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:16.422348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43f646d0c1b42e9b2cc7b271c649173, user_id=e46efe4ddb1d465ebc218fea92a587ec, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:16.430876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:16.686941 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3779/7570] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:55:16 2022] PUT /identity/v3/projects/d43f646d0c1b42e9b2cc7b271c649173/users/e46efe4ddb1d465ebc218fea92a587ec/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:16.688306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:16.688306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:16.688306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:16.781572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:16.784101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:16.797979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] MFA Rules not processed for user `e46efe4ddb1d465ebc218fea92a587ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:16.797979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:16.946994 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3792/7571] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:55:16.949969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:16.986877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:16.992757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264386ef-906d-4219-a447-8b0ed61496b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.013435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.014812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.015276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.015746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.024019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:17.057187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.060135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.088592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa9c4c-7ac9-435c-945b-f5d7b773bc4d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.090327 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3780/7572] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:55:17.096032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.096885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.097331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.097757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.098556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.100673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36140-3fbd-46e6-91b5-c54e4a73bc06 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.248213 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3793/7573] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:55:16 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:55:17.253293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:17.267722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393298e-0ada-4737-ae84-d33a6604e0de service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.318789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.319264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.319354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.358422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:17.359978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:17.430943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.431607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.432248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.437513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.437513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.437513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.467384 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3794/7574] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:17.486726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:17.598911 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3781/7575] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:55:17 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:55:17.604170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:17.629413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba1fa-b019-42ad-adaa-3baa2fc95394 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.668238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.669232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.669675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.676692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.679680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.690070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.701154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74661-7810-4657-b4a9-30e267ae990d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.717528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.718522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.719864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.720565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.739052 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3782/7576] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:17.740191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:17.751073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.755106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.771585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0adc-e29b-4616-9a4d-be673cbd69b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:17.781191 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3795/7577] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:55:17.784359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:17.785190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:17.785581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:17.786131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] PATH_INFO: `/v3/projects/6aec1877688f47fe8af56fd5e9a8597d/users/977d1784de364338ae551d604c3369b7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:17.815854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aec1877688f47fe8af56fd5e9a8597d, user_id=977d1784de364338ae551d604c3369b7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:17.820851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:17.948512 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3783/7578] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:55:17 2022] PUT /identity/v3/projects/6aec1877688f47fe8af56fd5e9a8597d/users/977d1784de364338ae551d604c3369b7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:17.952149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:17.972155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93190-0314-416e-abe7-54d8a2d03ce4 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:18.098991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:18.100598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:18.100978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:18.103555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:18.112172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:18.114517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cfad5-ca97-457f-864f-d6c5d34c52b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:18.118561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:18.135547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3796/7579] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:55:18.136903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:18.151563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d513fc-22e7-495c-9984-72444e341348 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:18.156721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:18.157400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:18.157680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:18.157952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] PATH_INFO: `/v3/projects/6aec1877688f47fe8af56fd5e9a8597d/users/977d1784de364338ae551d604c3369b7/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:18.160181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aec1877688f47fe8af56fd5e9a8597d, user_id=977d1784de364338ae551d604c3369b7, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:18.163599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:18.192258 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3784/7580] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:55:18 2022] PUT /identity/v3/projects/6aec1877688f47fe8af56fd5e9a8597d/users/977d1784de364338ae551d604c3369b7/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:55:18.202583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032b67-bac2-432c-8865-2a3e13ed9f43 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:18.203467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032b67-bac2-432c-8865-2a3e13ed9f43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:18.203744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98032b67-bac2-432c-8865-2a3e13ed9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:18.257435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98032b67-bac2-432c-8865-2a3e13ed9f43 None None] MFA Rules not processed for user `977d1784de364338ae551d604c3369b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:18.260455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98032b67-bac2-432c-8865-2a3e13ed9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:18.401465 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3797/7581] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:55:18.420081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:18.426374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:18.514332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:18.634990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b44c8-130b-4250-bd2c-bce6ad51da08 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:18.646626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:18.647363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:18.647644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:18.647916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:18.726590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:18.729899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:18.760040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3785/7582] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:55:18.814100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:19.778955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:19.780132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:19.780563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:19.813403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:19.814908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:19.927346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:19.931411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3798/7583] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:55:19.997510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:20.128929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8c50-44ef-4da4-b2d1-3ab0260f0f92 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:20.137682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:20.138693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:20.139122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:20.139942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:20.154238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:20.156312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ae452-de57-444a-9e6e-ff55c78148d8 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:20.189153 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3786/7584] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:55:24.388853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:24.390828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:24.598653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54472922-4595-4df0-abb2-47b5edbbc911 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:24.610579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:24.611241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:24.611526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:24.611805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:24.626117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:24.628000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6373-8029-4334-98bc-9ab8f73b9f62 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:24.639785 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3799/7585] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:55:30.167350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=80 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:30.920383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:30.921439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:30.921911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:30.971999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:30.974322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:31.158980 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3787/7586] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:34.634579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=68 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:37.709161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717f89-5a6d-4576-b22b-5a66c31985e0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:37.714112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717f89-5a6d-4576-b22b-5a66c31985e0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:37.714658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15717f89-5a6d-4576-b22b-5a66c31985e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:37.764802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15717f89-5a6d-4576-b22b-5a66c31985e0 None None] MFA Rules not processed for user `860b83d4d8fa487e872b02d96e96c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:37.766232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15717f89-5a6d-4576-b22b-5a66c31985e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:37.779353 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3800/7587] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:41.127273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=25 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:47.756582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:55:50.000976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:50.002685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:50.106687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885159a-eb52-4390-bd92-a98f60bf158d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:50.110909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:50.111775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:50.112134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:50.112479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:50.114433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:50.201505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:50.203719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:50.216131 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3788/7588] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:55:52.527663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873263-f06a-4b6d-b056-c15d5e33cb8d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:52.529381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873263-f06a-4b6d-b056-c15d5e33cb8d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:52.529833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3873263-f06a-4b6d-b056-c15d5e33cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:52.562452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3873263-f06a-4b6d-b056-c15d5e33cb8d None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:55:52.564059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3873263-f06a-4b6d-b056-c15d5e33cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:52.573033 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3801/7589] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:55:55.961676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:55:55.976723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d03f-a006-4a07-bf78-795d0819ef19 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:55:55.982165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:55:55.982845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:55:55.983158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:55:55.983431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:55:55.993214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:55:56.123392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:55:56.125960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:55:56.144849 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3789/7590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:56:02.555190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:02.948286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7fbe-7776-4914-9e06-2eecfad5cad3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:02.950594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7fbe-7776-4914-9e06-2eecfad5cad3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:02.950594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7fbe-7776-4914-9e06-2eecfad5cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:03.027132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b03d7fbe-7776-4914-9e06-2eecfad5cad3 None None] MFA Rules not processed for user `c29c4522c3204e24adeeffb44d7031f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:03.027132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b03d7fbe-7776-4914-9e06-2eecfad5cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:03.241657 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3802/7591] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:03.846781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:03.849183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:03.875239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931245-95ae-4b0c-ad04-9995f86e7303 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:03.897446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:03.897446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:03.897446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:03.897446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:03.897877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:03.918070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:03.919710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:03.937295 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3790/7592] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:56:13.231918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:13.927230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:22.986028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48a81-9b5f-46dd-a0e3-05b76f087a80 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:22.991028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48a81-9b5f-46dd-a0e3-05b76f087a80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:22.991583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48a81-9b5f-46dd-a0e3-05b76f087a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:23.041868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a9f48a81-9b5f-46dd-a0e3-05b76f087a80 None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:23.042407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9f48a81-9b5f-46dd-a0e3-05b76f087a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:23.067271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3803/7593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:23.630753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:23.649893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345854bc-48a8-4b45-85ba-2adb59d383e4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:23.685795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:23.687399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:23.688133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:23.690879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:23.697161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:23.734438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:23.736376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:23.750930 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3791/7594] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:56:30.936489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fab13-3efe-4b8b-a906-437d25c542d4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:30.937112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fab13-3efe-4b8b-a906-437d25c542d4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:30.937112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fab13-3efe-4b8b-a906-437d25c542d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:30.977085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f1fab13-3efe-4b8b-a906-437d25c542d4 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:30.978907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f1fab13-3efe-4b8b-a906-437d25c542d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:31.009586 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3804/7595] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:31.232621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:31.260588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd11a-6597-4fe2-9cbc-4f6573520dee service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:31.277549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:31.281551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:31.281551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:31.281551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:31.295809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:31.298213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:31.317731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3792/7596] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:56:34.269950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d595-6385-40d6-875e-8579b4db7eb4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:34.270488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d595-6385-40d6-875e-8579b4db7eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:34.270488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d595-6385-40d6-875e-8579b4db7eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:34.300743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99b5d595-6385-40d6-875e-8579b4db7eb4 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:34.302795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99b5d595-6385-40d6-875e-8579b4db7eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:34.322313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3805/7597] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:41.306294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:44.293235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:49.976521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:50.067530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa86b82-bfb4-494e-ae25-841caf899a6f service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:50.088955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:50.093503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:50.095016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:50.100780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:50.153399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:50.155733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:50.192429 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3793/7598] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 732 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:56:50.235919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953f8b-37eb-4626-83ca-e4ed1da467dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:50.235919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953f8b-37eb-4626-83ca-e4ed1da467dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:50.235919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953f8b-37eb-4626-83ca-e4ed1da467dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:50.298571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83953f8b-37eb-4626-83ca-e4ed1da467dc None None] MFA Rules not processed for user `860b83d4d8fa487e872b02d96e96c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:50.299640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83953f8b-37eb-4626-83ca-e4ed1da467dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:50.314984 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3806/7599] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:50.606247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:50.609069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:50.814139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afd007-17c3-484b-8b67-8fd6197c64a4 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:50.821472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:50.821472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:50.826882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:50.828976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] PATH_INFO: `/v3/users/1f3644858960445da117ac73f681ac08` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:50.833940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3644858960445da117ac73f681ac08)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:50.839271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:51.310880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3644858960445da117ac73f681ac08'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:51.313021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3644858960445da117ac73f681ac08'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:51.496022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3644858960445da117ac73f681ac08'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:51.510797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3644858960445da117ac73f681ac08'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:51.511852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3644858960445da117ac73f681ac08'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:51.551808 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3794/7600] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:56:50 2022] DELETE /identity/v3/users/1f3644858960445da117ac73f681ac08 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:56:51.557025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:51.557025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:51.557025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:51.597824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:51.600099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:51.683431 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3807/7601] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:51.694786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:51.696987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:51.804450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76ea3-6e28-40cb-99d2-769075b27584 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:51.808580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:51.809393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:51.810399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:51.811027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:51.829674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:51.831221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f910-8b7b-4481-873d-84b0416664e9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:51.907650 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3795/7602] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:56:52.366193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:52.370286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:52.395723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409981eb-326d-41b8-a63d-8bf2a34336e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:52.423499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:52.423499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:52.423499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:52.423499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] PATH_INFO: `/v3/projects/9c23c36f053b43b8839ee2a3e1730e25` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:52.426910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c23c36f053b43b8839ee2a3e1730e25)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:52.426910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:52.616483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c23c36f053b43b8839ee2a3e1730e25', 'request_id': 'req-5955213c-c68d-4002-aef4-f9b6e48bea8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:52.852467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c23c36f053b43b8839ee2a3e1730e25', 'request_id': 'req-5955213c-c68d-4002-aef4-f9b6e48bea8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:52.878167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c23c36f053b43b8839ee2a3e1730e25', 'request_id': 'req-5955213c-c68d-4002-aef4-f9b6e48bea8c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:52.892655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] The token cache is being invalidate because project 9c23c36f053b43b8839ee2a3e1730e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:56:52.892946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:52.893868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5955213c-c68d-4002-aef4-f9b6e48bea8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:56:52.899717 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3808/7603] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:56:52 2022] DELETE /identity/v3/projects/9c23c36f053b43b8839ee2a3e1730e25 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:56:52.904513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:52.905566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:52.906013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:52.937897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:52.939172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:52.943750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:53.037940 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3796/7604] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:53.046285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:53.046575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:53.046897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:53.076298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:53.077561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:53.089945 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3809/7605] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:53.093668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:53.110822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d3f5-a023-4848-aa2a-ce7beb751b8c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:53.140573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:53.141439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:53.141913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:53.142339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:53.143338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:56:53.143850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:53.146662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:53.161671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3797/7606] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:56:53.167343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:53.189168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb1188-3e28-4ec9-a9bd-314c97614de4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:53.211580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:53.211580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:53.211580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:53.211580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:53.211970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:53.211970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:53.450466 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3810/7607] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:56:53 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:56:53.454345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:53.514549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a15627-8b84-4abb-96f5-7280a0ab7863 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:53.651270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:53.652262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:53.652721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:53.653151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:53.654060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:53.656322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:53.919808 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3798/7608] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:56:53 2022] POST /identity/v3/users => generated 293 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:56:53.923905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:53.943231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b74c8-d568-4c9c-aa4c-3040883f75db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:53.964336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:53.965931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:53.965931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:53.966374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:53.967507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:53.970060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:54.004098 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3811/7609] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:56:54.004994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:54.016701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935178-081b-49cc-8832-00dfc577aa3a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:54.022565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:54.024004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:54.024004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:54.024323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:54.025362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:54.029007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2bcf-48a9-4f6a-ab2d-c9cc8875cefe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:54.046499 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3799/7610] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:56:54.056594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:54.072495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1674a-b8bc-4483-a8fb-6435237c18cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:54.081522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:54.083072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:54.083576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:54.084582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] PATH_INFO: `/v3/projects/190d6b01298a4e04b025c581d8365802/users/3ba752079bbd4282b743550408414973/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:54.111141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190d6b01298a4e04b025c581d8365802, user_id=3ba752079bbd4282b743550408414973, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:54.115543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:54.258139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:54.258452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:54.258726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:54.261823 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3812/7611] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:56:54 2022] PUT /identity/v3/projects/190d6b01298a4e04b025c581d8365802/users/3ba752079bbd4282b743550408414973/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:56:54.296850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] MFA Rules not processed for user `3ba752079bbd4282b743550408414973`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:56:54.298116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:54.432890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3800/7612] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:56:54.445581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:56:54.447623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:56:54.481726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:56:54.605814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ff990-9ebf-45d3-9418-ea646a7ab480 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:56:54.612716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:56:54.613701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:56:54.614178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:56:54.614677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:56:54.626696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:56:54.628961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:56:54.640783 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3813/7613] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:07.372494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:09.159818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=20 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:10.057732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:10.059394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:10.090304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9450d0-59c0-4fcd-b710-03d262309317 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:10.096355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:10.097728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:10.098225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:10.098734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:10.102063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:10.210574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:10.212074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420cc4b-8ada-4d20-a756-18b5a256e245 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:10.240407 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3801/7614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:12.896385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:13.006007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4365ff-9743-4041-8675-b5c17987953f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:13.012239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:13.013108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:13.013396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:13.014199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] PATH_INFO: `/v3/users/3ba752079bbd4282b743550408414973` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:13.016818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba752079bbd4282b743550408414973)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:13.017902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:13.414810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba752079bbd4282b743550408414973'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:13.417393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba752079bbd4282b743550408414973'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:13.557862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba752079bbd4282b743550408414973'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:13.577208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba752079bbd4282b743550408414973'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:13.577984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba752079bbd4282b743550408414973'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:13.593597 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3814/7615] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:12 2022] DELETE /identity/v3/users/3ba752079bbd4282b743550408414973 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:13.598678 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:13.599127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:13.599235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:13.622683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:13.623920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:13.694755 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3802/7616] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:13.703885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:13.706709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:13.848931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb519-1316-48f1-a6c9-8b723e16776a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:13.853575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:13.854210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:13.854491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:13.854836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:13.867974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:13.869433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:13.880087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3815/7617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:14.310836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:14.312767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:14.319361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:14.321677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:14.337282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511262ab-304a-41a4-ae74-96fa372b738f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:14.344585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:14.346598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:14.346598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:14.346598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] PATH_INFO: `/v3/projects/190d6b01298a4e04b025c581d8365802` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:14.349168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190d6b01298a4e04b025c581d8365802)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:14.350498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:14.364083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736bad-3bce-4ed3-9d34-6820117975cb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:14.374795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:14.375657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:14.375937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:14.376207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:14.379126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:14.409581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:14.511108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:14.512540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570aeb0-4054-4da2-b26f-0f20fc83dc83 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:14.528877 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3816/7618] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:14.618586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190d6b01298a4e04b025c581d8365802', 'request_id': 'req-f26f3630-4823-457a-b84c-8475af4faab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:14.735161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190d6b01298a4e04b025c581d8365802', 'request_id': 'req-f26f3630-4823-457a-b84c-8475af4faab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:14.743431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:14.747853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190d6b01298a4e04b025c581d8365802', 'request_id': 'req-f26f3630-4823-457a-b84c-8475af4faab6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:14.784715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] The token cache is being invalidate because project 190d6b01298a4e04b025c581d8365802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:14.792198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:14.792198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f26f3630-4823-457a-b84c-8475af4faab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:14.792198 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3803/7619] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:14 2022] DELETE /identity/v3/projects/190d6b01298a4e04b025c581d8365802 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:14.798790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:14.801219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:14.802203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:14.825985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:14.827417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:14.917885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3817/7620] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:14.926536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:14.927221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:14.927738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:14.961795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:14.963315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:14.991881 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3804/7621] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:14.997712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.016600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9142b9e-004b-4ab1-bd93-efa0c143588c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.022920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.024221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.024221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.024426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.025161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:57:15.025557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.027459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:15.046002 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3818/7622] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:57:15.046889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.059613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4754e-964f-49f3-b142-af8558110e3d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.065375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.066215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.066495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.066947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.067599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.071334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:15.279082 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3805/7623] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:15 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:57:15.279879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.297808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6817d-ae9c-49f3-9b20-4cb89d724ff9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.416202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.418059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.418692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.419165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.420259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.422713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:15.620848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3819/7624] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:15 2022] POST /identity/v3/users => generated 287 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:57:15.625118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.638726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55d232-cb5b-422f-a358-6426435cd428 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.650094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.650863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.651152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.651430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.652084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.654275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:15.670729 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3806/7625] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:57:15.679111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.692805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1cac3-eafe-4f1e-9a41-8a421c697fc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.700898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.701704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.702192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.702665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.703847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.707485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cf60f-0b98-42ea-9107-c9cf547cdeb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:15.726206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3820/7626] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:15.732405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:15.753424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fa739-7f7d-4858-bc1b-c492fb84dec0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:15.761725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:15.762864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:15.769147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:15.769147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] PATH_INFO: `/v3/projects/9273fc146d1f4be89ee0ebb9f8814944/users/c82531b3373649a1a0427bd439c9df19/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:15.806386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9273fc146d1f4be89ee0ebb9f8814944, user_id=c82531b3373649a1a0427bd439c9df19, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:15.812159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:16.101831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3807/7627] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:15 2022] PUT /identity/v3/projects/9273fc146d1f4be89ee0ebb9f8814944/users/c82531b3373649a1a0427bd439c9df19/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:16.113076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:16.113360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:16.113640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:16.147141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] MFA Rules not processed for user `c82531b3373649a1a0427bd439c9df19`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:16.148383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:16.236673 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3821/7628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:16.250440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:16.252664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:16.332455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de92ec-032d-45f1-b55c-a5e34ee0510e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:16.336557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:16.337173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:16.337451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:16.337723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:16.348370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:16.349904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6798-87b6-4f2d-b745-77cf40ec8d7a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:16.369172 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3808/7629] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:16.393835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:16.485579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f122-db87-4d03-b9b5-79c6242b4940 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:16.490838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:16.491877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:16.492309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:16.492770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] PATH_INFO: `/v3/users/c82531b3373649a1a0427bd439c9df19` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:16.494735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82531b3373649a1a0427bd439c9df19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:16.496997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:16.956846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82531b3373649a1a0427bd439c9df19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:16.958136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82531b3373649a1a0427bd439c9df19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:17.014757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:17.130356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82531b3373649a1a0427bd439c9df19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:17.151617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82531b3373649a1a0427bd439c9df19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:17.153113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82531b3373649a1a0427bd439c9df19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:17.170017 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3822/7630] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:16 2022] DELETE /identity/v3/users/c82531b3373649a1a0427bd439c9df19 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:17.175837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:17.176392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:17.176392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:17.199438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:17.200911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:17.301586 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3809/7631] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:17.334834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:17.336302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:17.460593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33fbb7-b455-4bf7-ab68-08c397776b4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:17.465075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:17.467268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:17.467806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:17.468269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:17.490945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:17.505962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9996a1-970d-4731-a202-49036bf7af07 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:17.512378 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3823/7632] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:18.757824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:19.113803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:19.115391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:19.143406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f530ee-8726-4f2e-80ee-d045db0057d7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:19.169033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:19.169721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:19.170023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:19.170280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] PATH_INFO: `/v3/projects/9273fc146d1f4be89ee0ebb9f8814944` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:19.171626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9273fc146d1f4be89ee0ebb9f8814944)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:19.174206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:19.243770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:19.377408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9273fc146d1f4be89ee0ebb9f8814944', 'request_id': 'req-8d4cb945-350d-493e-8f7a-454800e9fbf9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:19.557388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9273fc146d1f4be89ee0ebb9f8814944', 'request_id': 'req-8d4cb945-350d-493e-8f7a-454800e9fbf9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:19.564850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9273fc146d1f4be89ee0ebb9f8814944', 'request_id': 'req-8d4cb945-350d-493e-8f7a-454800e9fbf9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:19.610904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] The token cache is being invalidate because project 9273fc146d1f4be89ee0ebb9f8814944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:19.611258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:19.613840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8d4cb945-350d-493e-8f7a-454800e9fbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:19.617133 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3810/7633] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:19 2022] DELETE /identity/v3/projects/9273fc146d1f4be89ee0ebb9f8814944 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:19.623469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:19.624055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:19.624415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:19.683726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:19.684998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:19.863049 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3824/7634] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:19.870475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:19.870806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:19.871089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:19.925944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:19.928281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:19.940669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3811/7635] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:19.944790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:19.962701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc073-823f-417a-918c-0c866fd3d8f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:19.976402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:19.977063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:19.977344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:19.977621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:19.978307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:57:19.978609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:19.980304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:20.017014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3825/7636] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:57:20.018441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:20.036714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74a4a3-3daa-4d0d-b988-e0eb4a009a0b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:20.043671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:20.045248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:20.045902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:20.053054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:20.054214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:20.057083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:20.272252 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3812/7637] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:20 2022] POST /identity/v3/projects => generated 371 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:20.273899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:20.308887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf94c6-a83e-43e5-8d8d-f3c816062d7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:20.453038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:20.497749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:20.497749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:20.497749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:20.497749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:20.497749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:20.941496 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3826/7638] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:20 2022] POST /identity/v3/users => generated 286 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:20.945890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:20.959574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc516ab-7f4b-4d21-bb77-dddc3e9928f0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:20.967199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:20.969048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:20.970114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:20.970874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:20.972834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:20.978329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:21.005518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3813/7639] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:21.009353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:21.033622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0974b-2c59-4281-a5df-728501edda0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:21.055089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:21.055089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:21.055089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:21.055089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:21.055505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:21.055505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f535bc-37d3-471f-95a4-e5cd53bab14d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:21.082168 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3827/7640] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:21.086436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:21.100492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015c64-a713-4ca0-9e67-d1c0b6a9f6d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:21.114647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:21.114647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:21.114647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:21.114647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] PATH_INFO: `/v3/projects/565717c2ee8a411fbc37712b5bad1208/users/a6a86d7f83c144debe1ca7f3eadbfcab/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:21.139230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565717c2ee8a411fbc37712b5bad1208, user_id=a6a86d7f83c144debe1ca7f3eadbfcab, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:21.146319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:21.336192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3814/7641] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:21 2022] PUT /identity/v3/projects/565717c2ee8a411fbc37712b5bad1208/users/a6a86d7f83c144debe1ca7f3eadbfcab/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:21.338094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:21.338533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:21.338958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:21.392376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] MFA Rules not processed for user `a6a86d7f83c144debe1ca7f3eadbfcab`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:21.394011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:21.553601 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3828/7642] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:21.563030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:21.660221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7327ac-3a5f-4fc1-995c-a81d8689c083 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:21.669952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:21.679851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:21.679851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:21.679851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:21.679851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:21.679851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:21.926580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3815/7643] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:21 2022] POST /identity/v3/projects => generated 371 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:21.931629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:21.948766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285b259-77ed-420f-b96f-dc8ff1b3b123 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:22.084079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:22.085150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.085715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.086273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.087567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:22.090812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:22.279597 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3829/7644] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:21 2022] POST /identity/v3/users => generated 292 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:22.284645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:22.311776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d793cc-a13d-41f1-b7d7-a103fca6ec72 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:22.320144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:22.322181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.323715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.324170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.325556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:22.328214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:22.342215 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3816/7645] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:22.350145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:22.379967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f685f-e6ff-413b-a401-a44e19ed508d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:22.399586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:22.400370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.400734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.401088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] PATH_INFO: `/v3/projects/a26e700053194536984b455b8742e004/users/ee2ce949abd8427b977292530c0f0ef6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.442224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26e700053194536984b455b8742e004, user_id=ee2ce949abd8427b977292530c0f0ef6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:22.444886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:22.717711 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3830/7646] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:22 2022] PUT /identity/v3/projects/a26e700053194536984b455b8742e004/users/ee2ce949abd8427b977292530c0f0ef6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:22.728641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:22.742236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669ce5-5c9a-4cc7-8c61-ee487f02c62f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:22.826221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:22.828371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:22.834058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:22.834745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.835133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.835418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.836217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:22.837946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:22.851263 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3817/7647] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:22.858041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:22.879153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4ee4-a323-45a1-ad9f-c0f4b8f8dc9f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:22.886843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:22.887958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.888457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.888953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] PATH_INFO: `/v3/projects/a26e700053194536984b455b8742e004/users/ee2ce949abd8427b977292530c0f0ef6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.891358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26e700053194536984b455b8742e004, user_id=ee2ce949abd8427b977292530c0f0ef6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:22.894123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968de5a-98b2-441b-87fe-08d1ed0525c7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:22.912798 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3818/7648] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:22 2022] PUT /identity/v3/projects/a26e700053194536984b455b8742e004/users/ee2ce949abd8427b977292530c0f0ef6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:22.926075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:22.926418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:22.926752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:22.971515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] MFA Rules not processed for user `ee2ce949abd8427b977292530c0f0ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:22.972953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:22.985455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a288d-67cf-4ff0-962e-7d336bd8ca25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:23.071464 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3819/7649] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:57:23.081612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:23.083238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:23.093350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:23.094053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:23.094579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:23.094907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:23.096915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:23.126592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:23.130813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:23.161694 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3831/7650] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:23.221775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd54d8-8605-40d7-9672-a92e476c2046 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:23.226197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:23.227115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:23.227500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:23.228543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:23.241557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:23.243282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb45d-9e37-4043-805b-b279d236840f service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:23.269891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3820/7651] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:23.478313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:23.848539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:25.341582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:25.459331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074040-8b94-4ce9-837c-fc3711d7bfaa service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:25.466963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:25.467948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:25.477875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:25.477875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] PATH_INFO: `/v3/users/a6a86d7f83c144debe1ca7f3eadbfcab` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:25.477875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a86d7f83c144debe1ca7f3eadbfcab)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:25.477875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:25.713585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:25.808963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a86d7f83c144debe1ca7f3eadbfcab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:25.808963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a86d7f83c144debe1ca7f3eadbfcab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:25.980492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a86d7f83c144debe1ca7f3eadbfcab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:26.005677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a86d7f83c144debe1ca7f3eadbfcab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:26.007419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a86d7f83c144debe1ca7f3eadbfcab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:26.033691 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3832/7652] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:25 2022] DELETE /identity/v3/users/a6a86d7f83c144debe1ca7f3eadbfcab => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:26.038578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:26.039047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:26.039277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:26.067431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:26.069197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:26.161677 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3821/7653] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:26.171472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:26.173359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:26.281389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1e9c-c991-4155-8cd1-9403c91b6d09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:26.287362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:26.288288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:26.288419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:26.288657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:26.310839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:26.316480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:26.324117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3833/7654] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:26.999807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:27.008220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:27.010748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:27.051601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a0ea3-6a3b-47d2-90cb-03d0a27031fd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:27.077967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:27.079451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:27.080150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:27.081157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] PATH_INFO: `/v3/projects/565717c2ee8a411fbc37712b5bad1208` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:27.083494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] RBAC: Authorizing `identity:delete_project(project_id=565717c2ee8a411fbc37712b5bad1208)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:27.087914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:27.262151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565717c2ee8a411fbc37712b5bad1208', 'request_id': 'req-6778fcd9-491f-4c57-860d-d7805ccd354d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:27.442125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565717c2ee8a411fbc37712b5bad1208', 'request_id': 'req-6778fcd9-491f-4c57-860d-d7805ccd354d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:27.450962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565717c2ee8a411fbc37712b5bad1208', 'request_id': 'req-6778fcd9-491f-4c57-860d-d7805ccd354d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:27.467250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] The token cache is being invalidate because project 565717c2ee8a411fbc37712b5bad1208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:27.467845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:27.471218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:27.478955 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3822/7655] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:27 2022] DELETE /identity/v3/projects/565717c2ee8a411fbc37712b5bad1208 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:27.479359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:27.488019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e0bac-e95e-4883-87c6-25114403f930 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:27.571583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:27.572381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:27.573000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:27.573000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] PATH_INFO: `/v3/users/ee2ce949abd8427b977292530c0f0ef6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:27.574257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2ce949abd8427b977292530c0f0ef6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:27.576695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:28.017884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2ce949abd8427b977292530c0f0ef6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:28.019029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2ce949abd8427b977292530c0f0ef6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:28.241348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2ce949abd8427b977292530c0f0ef6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:28.246452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:28.258561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2ce949abd8427b977292530c0f0ef6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:28.259503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b267f768-6f53-4ecf-a3f5-a5ccf2c7d77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2ce949abd8427b977292530c0f0ef6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:28.275680 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3834/7656] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:27 2022] DELETE /identity/v3/users/ee2ce949abd8427b977292530c0f0ef6 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:28.905157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:28.907862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:28.925829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778fcd9-491f-4c57-860d-d7805ccd354d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:29.010569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:29.010927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.011071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.011244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] PATH_INFO: `/v3/projects/a26e700053194536984b455b8742e004` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.012518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26e700053194536984b455b8742e004)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:29.014513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:29.208926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26e700053194536984b455b8742e004', 'request_id': 'req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:29.340402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26e700053194536984b455b8742e004', 'request_id': 'req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:29.349003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26e700053194536984b455b8742e004', 'request_id': 'req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:29.373895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] The token cache is being invalidate because project a26e700053194536984b455b8742e004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:29.374194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:29.375627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fb825f2b-c7ae-42e6-8ca3-cb35193eb967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:29.377182 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3823/7657] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:28 2022] DELETE /identity/v3/projects/a26e700053194536984b455b8742e004 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:29.382286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.382793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.382888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.415567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:29.416866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:29.484474 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3835/7658] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:29.493088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.493088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.493088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.514319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:29.516141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:29.525270 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3824/7659] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:29.538093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:29.548957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396ff2c-2dc4-460a-bc2b-b1c0eb38b7e5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:29.554537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:29.555191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.555487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.555750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.556426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:57:29.556735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:29.558400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:29.581778 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3836/7660] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:57:29.586206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:29.598044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853bbac-cb11-4a51-a123-34f4e9e071d4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:29.607831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:29.608478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.608766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.609038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.610539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:29.612726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:29.809686 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3825/7661] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:29 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:29.810971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:29.823495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cb8ae-1b3c-480d-9f8b-84c9fb8e2324 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:29.855570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:29.932136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:29.932769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:29.933113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:29.933451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:29.934149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:29.936902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:30.131172 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3837/7662] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:29 2022] POST /identity/v3/users => generated 282 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:30.135403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:30.151328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92fad6-f71b-49ad-9ebb-b90d6302ad3a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:30.164680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:30.165329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:30.165766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:30.166165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:30.167051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:30.168948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:30.189591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3826/7663] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:30.191500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:30.207185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4515df-d206-4d35-a6d4-848728d347b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:30.214593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:30.215432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:30.215776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:30.216113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:30.216848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:30.219198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51edf6-2d6e-47fb-aaff-f5240683fcca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:30.235234 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3838/7664] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:30.238656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:30.253078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48251-4ead-43ff-bce5-ac65da67d6d9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:30.258594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:30.259483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:30.259843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:30.260178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] PATH_INFO: `/v3/projects/b342cf6fbb8c4cf8ba6d6c01e1bc96d9/users/e48b69d260a54ff893ac871f0bbbe393/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:30.282451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b342cf6fbb8c4cf8ba6d6c01e1bc96d9, user_id=e48b69d260a54ff893ac871f0bbbe393, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:30.285623 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:30.476343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:30.476887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:30.476887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:30.479815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3827/7665] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:30 2022] PUT /identity/v3/projects/b342cf6fbb8c4cf8ba6d6c01e1bc96d9/users/e48b69d260a54ff893ac871f0bbbe393/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:30.507869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] MFA Rules not processed for user `e48b69d260a54ff893ac871f0bbbe393`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:30.509076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:30.614053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3839/7666] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:30.618431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:30.733799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aafa6-8026-4f23-a615-714e3ffcdaac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:30.738944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:30.739881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:30.740215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:30.740553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:30.741287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:30.743443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:30.935653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3828/7667] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:30 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:30.940342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:30.951657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fac7e-7ba4-4095-ba65-2ddcf8de36e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.014887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.016140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.016498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.016790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.018119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.019426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.107228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:31.202012 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3840/7668] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:30 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:31.207081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:31.226753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8293047-2b32-4f3e-9bcf-afcbc022c295 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.236461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.237085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.237551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.237832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.238493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.240636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.255210 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3829/7669] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:31.260399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:31.276530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc472-5a5c-43cd-b561-8da25e7589bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.282244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.283173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.283449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.283776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] PATH_INFO: `/v3/projects/7fec87be5e60400e826c00eb65746e8f/users/9ff1d2f782234130992519c1e2f4ce44/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.318955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fec87be5e60400e826c00eb65746e8f, user_id=9ff1d2f782234130992519c1e2f4ce44, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.322382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.485427 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3841/7670] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:31 2022] PUT /identity/v3/projects/7fec87be5e60400e826c00eb65746e8f/users/9ff1d2f782234130992519c1e2f4ce44/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:31.489978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:31.531875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf4fa-d2ac-4be3-8d1a-de529775bb77 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.625845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.626779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.627326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.627888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.629098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.632716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bee30-5db1-4903-b48b-736f0d02da7c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.646830 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3830/7671] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:31.648816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:31.664232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a066c5-f15f-41f2-bcf8-44d135af26a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.670577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.672530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.673071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.673589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] PATH_INFO: `/v3/projects/7fec87be5e60400e826c00eb65746e8f/users/9ff1d2f782234130992519c1e2f4ce44/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.676581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fec87be5e60400e826c00eb65746e8f, user_id=9ff1d2f782234130992519c1e2f4ce44, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.679790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.700209 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3842/7672] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:31 2022] PUT /identity/v3/projects/7fec87be5e60400e826c00eb65746e8f/users/9ff1d2f782234130992519c1e2f4ce44/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:31.712227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.713240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.713685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.750218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] MFA Rules not processed for user `9ff1d2f782234130992519c1e2f4ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:31.751518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:31.835726 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3831/7673] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:31.848354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:31.850294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:31.951271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972d7a2-5414-4d5f-9dde-47cf1c382259 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:31.955802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:31.956556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:31.957313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:31.957659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:31.969940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:31.971487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:31.988930 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3843/7674] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:32.286411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:32.302327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9d5f4-936d-4b41-bbb2-5fad3a3204b5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:32.307477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:32.308393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:32.309459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:32.309768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:32.378340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:32.393553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:32.397119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:32.408720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3832/7675] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:33.481778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:37.416621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:37.418133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:37.521458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53647f-d37b-4d8a-a2c1-82812e2a82a6 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:37.527282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:37.527927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:37.528207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:37.528480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:37.530356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:37.545622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:37.547341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:37.567410 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3844/7676] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:37.613285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:37.714891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bf6b-2a35-4e09-8ef1-faf61e3320ec service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:37.723186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:37.724050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:37.724507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:37.726332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] PATH_INFO: `/v3/users/e48b69d260a54ff893ac871f0bbbe393` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:37.728959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48b69d260a54ff893ac871f0bbbe393)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:37.737815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:37.751453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:37.867596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:37.869059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:37.887995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084deb3-e525-487d-abb5-d73885724f45 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:37.893390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:37.894451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:37.894836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:37.895183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] PATH_INFO: `/v3/users/860b83d4d8fa487e872b02d96e96c0ea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:37.896429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860b83d4d8fa487e872b02d96e96c0ea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:37.898647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:38.205648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48b69d260a54ff893ac871f0bbbe393'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.206389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48b69d260a54ff893ac871f0bbbe393'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.457740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:38.473650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860b83d4d8fa487e872b02d96e96c0ea'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.474821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860b83d4d8fa487e872b02d96e96c0ea'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.596105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48b69d260a54ff893ac871f0bbbe393'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.608858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48b69d260a54ff893ac871f0bbbe393'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.609581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-57fa73e2-2d49-42dd-86ff-999a43dd0770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48b69d260a54ff893ac871f0bbbe393'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.622691 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3833/7677] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:37 2022] DELETE /identity/v3/users/e48b69d260a54ff893ac871f0bbbe393 => generated 0 bytes in 1010 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:38.627345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:38.627637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:38.627916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:38.647826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:38.649293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:38.715043 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3834/7678] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:38.725823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:38.727296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:38.792111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1a364-2872-4e93-9e9f-7673dde94bf6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:38.796228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:38.796859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:38.797166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:38.797443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:38.808019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:38.809485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d614c-6e0f-4b31-b858-cdd6c49caa6a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:38.835055 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3835/7679] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:38.852711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860b83d4d8fa487e872b02d96e96c0ea'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.869920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860b83d4d8fa487e872b02d96e96c0ea'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.870714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860b83d4d8fa487e872b02d96e96c0ea'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:38.905153 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3845/7680] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:37 2022] DELETE /identity/v3/users/860b83d4d8fa487e872b02d96e96c0ea => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:38.907323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:38.907519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:38.907681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:38.928892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:38.930124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:38.978212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:39.010274 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3836/7681] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:39.024051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:39.099462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020bd98-9c86-4a90-b05a-1dd008d09733 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:39.103538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:39.104160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:39.104437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:39.105118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:39.115400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:39.116959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:39.135307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3846/7682] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:39.488834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:39.492962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:39.519951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:39.521227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe325f9f-5b30-4a2a-8bc5-5b7dbc280cbd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:39.523272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:39.539541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:39.540199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:39.540487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:39.540763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] PATH_INFO: `/v3/projects/b342cf6fbb8c4cf8ba6d6c01e1bc96d9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:39.546715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151192bb-5451-40e3-8111-be634e4bbf3f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:39.548660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b342cf6fbb8c4cf8ba6d6c01e1bc96d9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:39.551717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:39.555740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:39.556611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:39.559100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:39.559100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] PATH_INFO: `/v3/projects/813e9d8dfd6f46e5bd19734acc0914d8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:39.568909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=813e9d8dfd6f46e5bd19734acc0914d8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:39.577413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:39.707666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b342cf6fbb8c4cf8ba6d6c01e1bc96d9', 'request_id': 'req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.769193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813e9d8dfd6f46e5bd19734acc0914d8', 'request_id': 'req-d5cba63b-10b8-4add-b0be-636ab8c37f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.897887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b342cf6fbb8c4cf8ba6d6c01e1bc96d9', 'request_id': 'req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.904757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b342cf6fbb8c4cf8ba6d6c01e1bc96d9', 'request_id': 'req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.917540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] The token cache is being invalidate because project b342cf6fbb8c4cf8ba6d6c01e1bc96d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:39.917833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.918492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:39.920214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3837/7683] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:39 2022] DELETE /identity/v3/projects/b342cf6fbb8c4cf8ba6d6c01e1bc96d9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:39.924832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:39.935350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:40.007787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf77f0-466f-4c9c-93f1-5af8740f86e0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:40.035638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813e9d8dfd6f46e5bd19734acc0914d8', 'request_id': 'req-d5cba63b-10b8-4add-b0be-636ab8c37f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.043093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813e9d8dfd6f46e5bd19734acc0914d8', 'request_id': 'req-d5cba63b-10b8-4add-b0be-636ab8c37f0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.057469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] The token cache is being invalidate because project 813e9d8dfd6f46e5bd19734acc0914d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:40.057780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.058493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.060186 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3847/7684] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:39 2022] DELETE /identity/v3/projects/813e9d8dfd6f46e5bd19734acc0914d8 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:40.064506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:40.066130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:40.081877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:40.082534 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:40.083008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:40.083320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] PATH_INFO: `/v3/users/9ff1d2f782234130992519c1e2f4ce44` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:40.084653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff1d2f782234130992519c1e2f4ce44)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:40.086870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:40.147140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cba63b-10b8-4add-b0be-636ab8c37f0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:40.154877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:40.156877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:40.157630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:40.158174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] PATH_INFO: `/v3/users/e46efe4ddb1d465ebc218fea92a587ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:40.159448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46efe4ddb1d465ebc218fea92a587ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:40.161618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:40.429940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff1d2f782234130992519c1e2f4ce44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.430602 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff1d2f782234130992519c1e2f4ce44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.462235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46efe4ddb1d465ebc218fea92a587ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.462927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46efe4ddb1d465ebc218fea92a587ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.566961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff1d2f782234130992519c1e2f4ce44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.580541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff1d2f782234130992519c1e2f4ce44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.581273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff1d2f782234130992519c1e2f4ce44'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.593793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3838/7685] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:39 2022] DELETE /identity/v3/users/9ff1d2f782234130992519c1e2f4ce44 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:40.713758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46efe4ddb1d465ebc218fea92a587ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.730066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46efe4ddb1d465ebc218fea92a587ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.731342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46efe4ddb1d465ebc218fea92a587ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:40.746176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3848/7686] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:40 2022] DELETE /identity/v3/users/e46efe4ddb1d465ebc218fea92a587ec => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:41.114591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:41.319991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:41.321572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:41.372898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:41.426199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fdd7d-f6ee-47ce-9c0b-29123b30918d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:41.460064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:41.461885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:41.498861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:41.499806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:41.500019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:41.500298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] PATH_INFO: `/v3/projects/7fec87be5e60400e826c00eb65746e8f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:41.504218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fec87be5e60400e826c00eb65746e8f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:41.504218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:41.560421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe9ea3-a29c-4439-9457-7fd81d96e6b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:41.566796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:41.567438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:41.567720 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:41.568024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] PATH_INFO: `/v3/projects/d43f646d0c1b42e9b2cc7b271c649173` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:41.569212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43f646d0c1b42e9b2cc7b271c649173)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:41.571297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:41.683117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fec87be5e60400e826c00eb65746e8f', 'request_id': 'req-36615f71-4408-4afe-b309-221d933d74f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.784919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43f646d0c1b42e9b2cc7b271c649173', 'request_id': 'req-538cb958-f90b-4024-bc9e-8a33f7f1890d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.874154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fec87be5e60400e826c00eb65746e8f', 'request_id': 'req-36615f71-4408-4afe-b309-221d933d74f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.880682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fec87be5e60400e826c00eb65746e8f', 'request_id': 'req-36615f71-4408-4afe-b309-221d933d74f8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.899009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] The token cache is being invalidate because project 7fec87be5e60400e826c00eb65746e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:41.899388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.899984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-36615f71-4408-4afe-b309-221d933d74f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.901656 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3839/7687] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:41 2022] DELETE /identity/v3/projects/7fec87be5e60400e826c00eb65746e8f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:41.911483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:41.911998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:41.913253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:41.937354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:41.938647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:41.989571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43f646d0c1b42e9b2cc7b271c649173', 'request_id': 'req-538cb958-f90b-4024-bc9e-8a33f7f1890d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:41.997721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43f646d0c1b42e9b2cc7b271c649173', 'request_id': 'req-538cb958-f90b-4024-bc9e-8a33f7f1890d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.018747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] The token cache is being invalidate because project d43f646d0c1b42e9b2cc7b271c649173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:42.018747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.018937 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3840/7688] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:42.019031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-538cb958-f90b-4024-bc9e-8a33f7f1890d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.019031 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3849/7689] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:41 2022] DELETE /identity/v3/projects/d43f646d0c1b42e9b2cc7b271c649173 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:42.020726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.022220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:42.022701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.022992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.023271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.034883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298535b-eea8-42b4-a049-68f649c162bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.039812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.045164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.045164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.045164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] PATH_INFO: `/v3/users/977d1784de364338ae551d604c3369b7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.045164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977d1784de364338ae551d604c3369b7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.045164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.045684 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:42.046775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:42.059725 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3850/7690] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:42.065525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.077349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd67ce-5e07-4991-aa14-23e937d0276c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.082164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.082802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.083082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.083357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.084010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:57:42.084310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.086028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.099095 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3851/7691] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:57:42.103189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.125868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29f8f3-177c-4386-b295-87319a4e2f54 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.130357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.131375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.131837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.132198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.132852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.134816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.287515 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3852/7692] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:57:42.288822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.369794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977d1784de364338ae551d604c3369b7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.370491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977d1784de364338ae551d604c3369b7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.371555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0334511-f1cd-46e9-9931-854aec578507 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.377229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.377842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.378127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.378397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.379064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.380989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.618561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977d1784de364338ae551d604c3369b7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.625126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3853/7693] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:42 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:57:42.629290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.630945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:42.639179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977d1784de364338ae551d604c3369b7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.640124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977d1784de364338ae551d604c3369b7'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:42.646364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918053b-640e-4c04-9ba8-85173c74e6c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.651763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.652429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.652783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.653459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.654244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.656292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.658010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3841/7694] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:42 2022] DELETE /identity/v3/users/977d1784de364338ae551d604c3369b7 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:42.674347 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3854/7695] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:57:42.679443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.783528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afbe1d-2df5-4d8d-87b6-997ee0bab110 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.792039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.792835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.793204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.793539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.794253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.798196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:42.827913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3842/7696] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:57:42.828135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:42.844369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300d63-c4ba-4764-8712-d3627cadc555 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:42.851569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:42.852659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:42.853120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:42.853582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] PATH_INFO: `/v3/projects/713ae338bd584c389f873bd7e687d149/users/23796d6c566c453a9dd0385673656e96/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:42.885866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] RBAC: Authorizing `identity:create_grant(project_id=713ae338bd584c389f873bd7e687d149, user_id=23796d6c566c453a9dd0385673656e96, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:42.888459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc6ddf-3e8b-4aae-8903-a388f2a0feed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:43.017869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:43.020417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:43.040173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256de04a-3b5f-4d81-b981-3ea2db5a67be admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:43.052075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:43.053963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.054717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.055458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] PATH_INFO: `/v3/projects/6aec1877688f47fe8af56fd5e9a8597d` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:43.060159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aec1877688f47fe8af56fd5e9a8597d)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:43.064446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:43.087109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3855/7697] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:42 2022] PUT /identity/v3/projects/713ae338bd584c389f873bd7e687d149/users/23796d6c566c453a9dd0385673656e96/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:43.099246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.099531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.099801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:43.141310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] MFA Rules not processed for user `23796d6c566c453a9dd0385673656e96`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:43.142446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:43.214021 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3856/7698] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:43.219244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:43.289070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aec8e-8653-4641-a2dc-e9d85a874b01 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:43.294112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:43.294770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.295056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.295363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:43.295999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:43.297970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:43.338737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aec1877688f47fe8af56fd5e9a8597d', 'request_id': 'req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:43.476513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aec1877688f47fe8af56fd5e9a8597d', 'request_id': 'req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:43.489092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aec1877688f47fe8af56fd5e9a8597d', 'request_id': 'req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:43.507659 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3857/7699] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:57:43.507932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:43.536177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] The token cache is being invalidate because project 6aec1877688f47fe8af56fd5e9a8597d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:43.537265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:43.538740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:43.554658 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3843/7700] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:43 2022] DELETE /identity/v3/projects/6aec1877688f47fe8af56fd5e9a8597d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:43.633745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006992-d3a9-45a9-a7c7-fe51fe5f0291 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:43.640991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:43.641814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.642174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.642523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:43.643746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:43.646093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:43.784733 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3858/7701] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:43 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:43.788572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:43.792111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:43.801958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:43.895685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42661fb-3a83-4bf3-af3e-f96dde9e09a3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:43.898013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:43.902828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:43.903470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.903752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.904026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:43.904743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:43.906443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:43.918605 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3844/7702] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:43.925049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:43.943993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f39f3-497b-492c-a173-c9d516ce2e3d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:43.952614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:43.953685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:43.953967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:43.954242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] PATH_INFO: `/v3/projects/32c502f9760e4640a35ec558f0e3996d/users/799645bd86234da28a8195007934084f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.008770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c502f9760e4640a35ec558f0e3996d, user_id=799645bd86234da28a8195007934084f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:44.018118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:44.157764 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3859/7703] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:43 2022] PUT /identity/v3/projects/32c502f9760e4640a35ec558f0e3996d/users/799645bd86234da28a8195007934084f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:44.162039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:44.181056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17150f06-9d20-413f-9cd6-67dc434dccb3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:44.245114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:44.245764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:44.246041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:44.246315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.247021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:44.248679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8c9c9-d5e9-43f5-824e-b2cacf543153 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:44.259233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3845/7704] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:44.263571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:44.275025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7ce2-cfaf-4328-8cfc-43df316bbc5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:44.280201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:44.280987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:44.281383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:44.289897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] PATH_INFO: `/v3/projects/32c502f9760e4640a35ec558f0e3996d/users/799645bd86234da28a8195007934084f/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.289897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c502f9760e4640a35ec558f0e3996d, user_id=799645bd86234da28a8195007934084f, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:44.289897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:44.303531 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3860/7705] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:44 2022] PUT /identity/v3/projects/32c502f9760e4640a35ec558f0e3996d/users/799645bd86234da28a8195007934084f/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:44.313571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:44.313858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:44.314138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.344314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] MFA Rules not processed for user `799645bd86234da28a8195007934084f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:44.345666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:44.447337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3846/7706] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:44.458828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:44.461934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:44.542327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce600-2cd7-481c-ad92-7701baab4649 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:44.547016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:44.548041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:44.548347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:44.548536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.559952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:44.561518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143598-a616-46f1-a943-c529bd00cb3b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:44.572577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3861/7707] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:44.669777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:44.767374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3e33-ee08-481f-b82b-ddddc7ab154c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:44.772162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:44.772904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:44.773258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:44.773624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] PATH_INFO: `/v3/users/23796d6c566c453a9dd0385673656e96` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:44.774886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23796d6c566c453a9dd0385673656e96)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:44.776907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:45.016537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23796d6c566c453a9dd0385673656e96'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:45.017554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23796d6c566c453a9dd0385673656e96'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:45.128157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:45.183440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23796d6c566c453a9dd0385673656e96'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:45.196698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23796d6c566c453a9dd0385673656e96'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:45.197454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23796d6c566c453a9dd0385673656e96'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:45.201336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:45.212091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3847/7708] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:44 2022] DELETE /identity/v3/users/23796d6c566c453a9dd0385673656e96 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:57:45.217695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:45.218190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:45.221773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:45.260055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:45.260055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:45.316662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3862/7709] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:57:45.327714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:45.329160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:45.416399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771a6e-2e4a-473c-a3fa-9cf3aa23e634 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:45.424774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:45.424774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:45.424774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:45.424774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:45.434771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:45.436335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:45.446642 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3848/7710] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:46.095092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:46.096629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:46.119731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545792d-00b8-4027-90c3-48329ebf6751 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:46.134098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:46.134831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:46.135048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:46.135322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] PATH_INFO: `/v3/projects/713ae338bd584c389f873bd7e687d149` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:46.136683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713ae338bd584c389f873bd7e687d149)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:46.138692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:46.305468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713ae338bd584c389f873bd7e687d149', 'request_id': 'req-33f55fa6-a60d-4aa5-8143-d99754d72508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.395282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713ae338bd584c389f873bd7e687d149', 'request_id': 'req-33f55fa6-a60d-4aa5-8143-d99754d72508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.405751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713ae338bd584c389f873bd7e687d149', 'request_id': 'req-33f55fa6-a60d-4aa5-8143-d99754d72508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.419521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] The token cache is being invalidate because project 713ae338bd584c389f873bd7e687d149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:46.421737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.422605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.423325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:46.428859 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3863/7711] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:46 2022] DELETE /identity/v3/projects/713ae338bd584c389f873bd7e687d149 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:46.433051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:46.445479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac61d6-6dbe-49fc-858c-bae3fd1a3829 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:46.509897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:46.530051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:46.530697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:46.530985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:46.531264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] PATH_INFO: `/v3/users/799645bd86234da28a8195007934084f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:46.532537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799645bd86234da28a8195007934084f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:46.534553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:46.847987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799645bd86234da28a8195007934084f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.848769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799645bd86234da28a8195007934084f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.955154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799645bd86234da28a8195007934084f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.990459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799645bd86234da28a8195007934084f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:46.991291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-3f9ff76c-3be2-4f45-a50d-802dae814065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799645bd86234da28a8195007934084f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:47.007069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3849/7712] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:46 2022] DELETE /identity/v3/users/799645bd86234da28a8195007934084f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:47.775139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:47.776812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:47.790914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fa6-a60d-4aa5-8143-d99754d72508 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:47.859055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:47.872747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:47.874360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:47.874762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:47.875179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] PATH_INFO: `/v3/projects/32c502f9760e4640a35ec558f0e3996d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:47.876847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c502f9760e4640a35ec558f0e3996d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:47.878822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:48.064925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c502f9760e4640a35ec558f0e3996d', 'request_id': 'req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:48.189169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c502f9760e4640a35ec558f0e3996d', 'request_id': 'req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:48.198130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c502f9760e4640a35ec558f0e3996d', 'request_id': 'req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:48.221274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] The token cache is being invalidate because project 32c502f9760e4640a35ec558f0e3996d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:57:48.221809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:48.235804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d6b7086b-dec4-48fb-bae1-f00a35d1d97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:48.235804 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3864/7713] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:57:47 2022] DELETE /identity/v3/projects/32c502f9760e4640a35ec558f0e3996d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:48.239717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.240135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.240258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.260503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:48.261732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:48.333612 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3850/7714] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:48.335402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.335691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.335963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.357118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:48.358328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:48.366826 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3865/7715] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:48.371486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:48.383710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2224df-c23b-4a0e-8961-cc30c6487081 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:48.389054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:48.389670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.389948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.390218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.390909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:57:48.391214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:48.392852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:48.407650 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3851/7716] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:57:48.412145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:48.422782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b0a3-b7b7-4625-855e-8d5dcba90007 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:48.431132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:48.431767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.432039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.432311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.432948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:48.440437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:48.582992 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3866/7717] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:48 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:48.584514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:48.595665 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813333d-4522-4a2e-baef-f76f079470b1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:48.601648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:48.749944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:48.750592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.750902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.751186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.751855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:48.754042 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:48.909672 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3852/7718] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:48 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:48.914488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:48.928700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a16f-1d06-48ca-b207-3751536ef019 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:48.937867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:48.939139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:48.939139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:48.939560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:48.940314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:48.942113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:48.972523 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3867/7719] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:57:48.976965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:48.998526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a1e14-db22-49ae-b842-1188719789a5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.001609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.002467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.003213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.003505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.004530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.007271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb83746-f8b7-4018-b601-2edf34c76f88 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:49.022862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3853/7720] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:49.027776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:49.040232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c86b8e-61b3-46bd-b75d-5a9707bfdb69 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.045761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.046506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.046831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.047115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] PATH_INFO: `/v3/projects/4064a930700e47e5984451381dd835da/users/3454d9d266714ef7a2522245906357b3/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.069824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4064a930700e47e5984451381dd835da, user_id=3454d9d266714ef7a2522245906357b3, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.073385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:49.195976 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3868/7721] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:49 2022] PUT /identity/v3/projects/4064a930700e47e5984451381dd835da/users/3454d9d266714ef7a2522245906357b3/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:49.207671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.207978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.208251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.241604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] MFA Rules not processed for user `3454d9d266714ef7a2522245906357b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:49.242974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:49.316897 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3854/7722] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:49.321511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:49.394041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcca6-c081-48d3-96c2-a7a01c869d45 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.399295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.399800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.400080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.400353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.400993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.402943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:49.567921 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3869/7723] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:57:49 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:49.572139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:49.609751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168da12-f25a-4fb9-af04-e2574490b21b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.703365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.704704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.705226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.705761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.706767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.709645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:49.822545 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3855/7724] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:57:49 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:57:49.826728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:49.849465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f005-813d-4746-8a7c-033f5c15a881 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.857141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.858182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.858666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.859110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.860294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.863432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:49.881125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3870/7725] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:49.886479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:49.902261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74eaf-e10e-4637-82db-9c0b9b9b220e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:49.908060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:49.908737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:49.909010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:49.909316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] PATH_INFO: `/v3/projects/7ec43e8ba813457b9317b7163ed467d6/users/2890dddbcbd544c1a6125409b2a8181e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:49.929569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec43e8ba813457b9317b7163ed467d6, user_id=2890dddbcbd544c1a6125409b2a8181e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:49.932563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:50.019345 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3856/7726] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:49 2022] PUT /identity/v3/projects/7ec43e8ba813457b9317b7163ed467d6/users/2890dddbcbd544c1a6125409b2a8181e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:50.023395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:50.035816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f66a0-4629-4355-b245-3a7f6fcd2b97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:50.112369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:50.113165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:50.113449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:50.113721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:50.114388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:50.116085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54349c6-219c-439d-9c88-b898c3a5b7b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:50.129753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3871/7727] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:57:50.134223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:50.153264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360097-10bd-4c73-ba95-a6d4ff71e8c1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:50.164683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:50.165649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:50.167050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:50.167443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] PATH_INFO: `/v3/projects/7ec43e8ba813457b9317b7163ed467d6/users/2890dddbcbd544c1a6125409b2a8181e/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:50.171778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec43e8ba813457b9317b7163ed467d6, user_id=2890dddbcbd544c1a6125409b2a8181e, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:50.176618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:50.191369 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3857/7728] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:57:50 2022] PUT /identity/v3/projects/7ec43e8ba813457b9317b7163ed467d6/users/2890dddbcbd544c1a6125409b2a8181e/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:50.203917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:50.204204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:50.204467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:50.218368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:50.246257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] MFA Rules not processed for user `2890dddbcbd544c1a6125409b2a8181e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:50.248666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:50.357813 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3872/7729] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:50.369293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:50.371340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:50.449135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532bc98-a17f-4be9-810f-2059941d2c91 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:50.453750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:50.454378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:50.454850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:50.454969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:50.465409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:50.466875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:50.477218 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3858/7730] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:50.613172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:50.628793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d314b-8796-4d47-abec-6120719dce75 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:50.641710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:50.644033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:50.644323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:50.644769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:50.750667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:50.752560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:50.780223 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3873/7731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:50.788971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:52.745659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:52.747870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:52.892935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d197c-e7ee-41d7-a633-388051c9fce9 service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:52.899496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:52.900356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:52.900846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:52.901336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:52.903467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:52.972888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:52.975250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:52.987079 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3859/7732] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:57:53.719410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:53.721602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:53.741009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:53.804327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a409d-bffd-444b-894f-1891422bf0cc service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:53.810502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:53.811483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:53.812056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:53.812442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:53.815136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:53.834230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:53.850265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:53.854706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f194db2-b574-4afe-ada1-26da6da4dad3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:53.872905 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3874/7733] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:57:54.760274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:58.901969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:59.011028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84823a-ec94-4b2d-b90e-aac159055c3c service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:59.016535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:59.017177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:59.017461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:59.017733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] PATH_INFO: `/v3/users/3454d9d266714ef7a2522245906357b3` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:59.018899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3454d9d266714ef7a2522245906357b3)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:59.020833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:59.444178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3454d9d266714ef7a2522245906357b3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:59.447964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3454d9d266714ef7a2522245906357b3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:59.560663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3454d9d266714ef7a2522245906357b3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:59.575750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3454d9d266714ef7a2522245906357b3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:59.576855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3454d9d266714ef7a2522245906357b3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:57:59.606503 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3860/7734] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:57:58 2022] DELETE /identity/v3/users/3454d9d266714ef7a2522245906357b3 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:57:59.612470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:59.612942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:59.613103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:59.641399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:57:59.643433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:59.734298 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3875/7735] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:57:59.744940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:57:59.747331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:57:59.768296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:57:59.830134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdabbec-7c1a-41ad-ba54-a4610c88d3c6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:57:59.836991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:57:59.838183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:57:59.838947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:57:59.839513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:57:59.859862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:57:59.859862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:57:59.869910 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3861/7736] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:58:00.569754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:00.572489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:00.587915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329590-3a90-4f06-a85e-b357aab9f3e6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:00.596754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:00.597595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:00.597876 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:00.598148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] PATH_INFO: `/v3/projects/4064a930700e47e5984451381dd835da` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:00.599506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4064a930700e47e5984451381dd835da)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:00.601632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:00.766964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4064a930700e47e5984451381dd835da', 'request_id': 'req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:00.890983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4064a930700e47e5984451381dd835da', 'request_id': 'req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:00.899954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4064a930700e47e5984451381dd835da', 'request_id': 'req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:00.913402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] The token cache is being invalidate because project 4064a930700e47e5984451381dd835da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:58:00.913710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:00.914394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:00.915964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3876/7737] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:58:00 2022] DELETE /identity/v3/projects/4064a930700e47e5984451381dd835da => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:58:00.921073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:00.933784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987704-6295-4bb7-b56d-260165693917 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:01.009467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:01.010540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:01.011019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:01.011418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] PATH_INFO: `/v3/users/2890dddbcbd544c1a6125409b2a8181e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:01.013242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2890dddbcbd544c1a6125409b2a8181e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:01.016525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:01.274892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2890dddbcbd544c1a6125409b2a8181e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:01.275577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2890dddbcbd544c1a6125409b2a8181e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:01.394587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2890dddbcbd544c1a6125409b2a8181e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:01.413990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2890dddbcbd544c1a6125409b2a8181e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:01.414817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-26f23c1a-458d-4771-b4a3-35b631db1ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2890dddbcbd544c1a6125409b2a8181e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:01.433459 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3862/7738] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:58:00 2022] DELETE /identity/v3/users/2890dddbcbd544c1a6125409b2a8181e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:58:02.144094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:02.145562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:02.161067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9beacd-c95b-4a30-a96c-2cfdd0327e19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:02.242676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:02.272169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:02.273712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:02.273712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:02.273712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] PATH_INFO: `/v3/projects/7ec43e8ba813457b9317b7163ed467d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:02.274756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec43e8ba813457b9317b7163ed467d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:02.276796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:02.494298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec43e8ba813457b9317b7163ed467d6', 'request_id': 'req-e6e18832-463f-44d5-b03d-0e97a31dafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:02.676700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec43e8ba813457b9317b7163ed467d6', 'request_id': 'req-e6e18832-463f-44d5-b03d-0e97a31dafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:02.687006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec43e8ba813457b9317b7163ed467d6', 'request_id': 'req-e6e18832-463f-44d5-b03d-0e97a31dafc3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:02.705616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] The token cache is being invalidate because project 7ec43e8ba813457b9317b7163ed467d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:58:02.706119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:02.707068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6e18832-463f-44d5-b03d-0e97a31dafc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:58:02.709372 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3877/7739] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:58:02 2022] DELETE /identity/v3/projects/7ec43e8ba813457b9317b7163ed467d6 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:58:02.718767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:02.719356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:02.719502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:02.743093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:02.744396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:02.783880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:02.823144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3863/7740] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:02.833454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:02.833944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:02.834247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:02.866781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:02.866781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:02.877703 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3878/7741] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:02.882358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:02.898206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac5a16-c6a8-4a13-a7e6-c7f5eca6e4fe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:02.904712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:02.908774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:02.923250 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3864/7742] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:58:02.928824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:02.945211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b850-b826-4f2e-9e55-3d7dc4eb2ff9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:02.956766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:02.957487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:02.957958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:02.958359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:02.959159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:02.961316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:03.260087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3879/7743] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:58:02 2022] POST /identity/v3/projects => generated 371 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:58:03.261195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:03.272023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383961-e4e2-4d48-b979-3d73b99bd4e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:03.336362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:03.338808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.339088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.339360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.340133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:03.342123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:03.514342 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3865/7744] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:58:03 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:58:03.519734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:03.531860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ed83a-9e96-415b-9ed3-7687ad9fad01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:03.536725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:03.537406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.537686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.537960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.538592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:03.540321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:03.551867 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3880/7745] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:58:03.556024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:03.567017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1378c-f433-45b8-a22a-fa5b1ee004be admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:03.571837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:03.572502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.572818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.573198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.573876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:03.575924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a3c10-74e4-4227-acd8-f7c2537a284e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:03.587490 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3866/7746] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:58:03.592409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:03.602848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e168-5ba4-4d57-a498-a579b71658a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:03.627580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:03.627580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.627580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.627580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] PATH_INFO: `/v3/projects/cb61fbaac6734eefa8ae55116930eeae/users/50c50e7204f849468895977db1d2856f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.628026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb61fbaac6734eefa8ae55116930eeae, user_id=50c50e7204f849468895977db1d2856f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:03.629333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:03.749451 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3881/7747] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:58:03 2022] PUT /identity/v3/projects/cb61fbaac6734eefa8ae55116930eeae/users/50c50e7204f849468895977db1d2856f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:58:03.763243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c20c-c3fb-4923-b911-e50f853cce66 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.763813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c20c-c3fb-4923-b911-e50f853cce66 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.763813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861c20c-c3fb-4923-b911-e50f853cce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.795111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c861c20c-c3fb-4923-b911-e50f853cce66 None None] MFA Rules not processed for user `50c50e7204f849468895977db1d2856f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:03.796344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c861c20c-c3fb-4923-b911-e50f853cce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:03.879460 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3867/7748] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:03.887868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:03.889981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:03.977279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85f65-5faf-4c0f-b81b-e2878c545ebc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:03.984203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:03.985027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:03.985484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:03.985825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:03.996057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:03.997527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:04.008188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3882/7749] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:58:07.250226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e093c-87da-4275-855b-41a9a7ab45cd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:07.250966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e093c-87da-4275-855b-41a9a7ab45cd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:07.250966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e093c-87da-4275-855b-41a9a7ab45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:07.276079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-052e093c-87da-4275-855b-41a9a7ab45cd None None] MFA Rules not processed for user `50c50e7204f849468895977db1d2856f`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:07.278432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-052e093c-87da-4275-855b-41a9a7ab45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:07.287421 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3868/7750] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:11.661295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:11.662963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:11.674834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:11.758271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e28485-8ec1-4105-952c-2daf860fb0f9 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:11.764400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:11.765130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:11.765476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:11.765811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:11.768384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:11.862708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:11.865963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:11.878418 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3883/7751] 10.222.0.13 () {60 vars in 1396 bytes} [Mon Oct 31 14:58:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:58:17.275925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:22.123974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=44 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:29.754313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7dcfe-6329-4a31-8cb6-6709bfd23858 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:29.759212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7dcfe-6329-4a31-8cb6-6709bfd23858 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:29.760277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7dcfe-6329-4a31-8cb6-6709bfd23858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:29.788301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5ca7dcfe-6329-4a31-8cb6-6709bfd23858 None None] MFA Rules not processed for user `c29c4522c3204e24adeeffb44d7031f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:29.791936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5ca7dcfe-6329-4a31-8cb6-6709bfd23858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:29.801920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3869/7752] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:30.889180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:30.890783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:31.022298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d317df5-25f9-4b7a-b061-029ec2d88044 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:31.029158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:31.029842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:31.030189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:31.030525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:31.032763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:31.053164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:31.055150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8bc3f-9956-43d6-af35-a2fec7012bbb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:31.071281 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3884/7753] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:58:31.465333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:31.465837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:31.466001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:31.488630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:31.489749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:31.573372 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3870/7754] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:41.062258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:41.556586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=28 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:58:46.978552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be273d-e534-4721-8e15-6814bc487331 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:46.979434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be273d-e534-4721-8e15-6814bc487331 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:46.979582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be273d-e534-4721-8e15-6814bc487331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:47.067192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6be273d-e534-4721-8e15-6814bc487331 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:47.068651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6be273d-e534-4721-8e15-6814bc487331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:47.146722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3885/7755] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:47.388633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:47.391159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:47.485797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf7e13-64a9-451d-a220-bee79a0f7f77 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:47.491543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:47.492361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:47.493336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:47.493707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:47.503743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:47.505569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:47.517351 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3871/7756] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:58:50.169157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:50.172641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:50.172641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:50.205523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] MFA Rules not processed for user `45a44e99d4dd4691ba4222fe166df89c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:58:50.210413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:50.226528 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3886/7757] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:58:56.249236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:58:56.264604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1f19-977a-40f5-b0a5-96ff59f3918a service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:58:56.271386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:58:56.273536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:58:56.273536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:58:56.273536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:58:56.276035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:58:56.298072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:58:56.299800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:58:56.316404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3872/7758] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:59:00.198461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=39 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:06.313229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=43 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:07.758560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:07.763900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:07.872012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1bc8-ca7d-4fc6-ad43-ef959e077663 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:07.885961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:07.886952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:07.887792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:07.888217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] PATH_INFO: `/v3/users/9855d8db94ed451580373bd5fa75440b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:07.889516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9855d8db94ed451580373bd5fa75440b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:07.892371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:08.844497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9855d8db94ed451580373bd5fa75440b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:08.845643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9855d8db94ed451580373bd5fa75440b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:09.008144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:09.018351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9855d8db94ed451580373bd5fa75440b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:09.032690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab692-e7e0-41c0-ba40-61f2f2ce48ac service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:09.045457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:09.046122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:09.046397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:09.046697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:09.048535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:09.052512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9855d8db94ed451580373bd5fa75440b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:09.056106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69aa3f41-ef45-417a-9067-9ca78cb04fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9855d8db94ed451580373bd5fa75440b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:09.060490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:09.063398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:09.071201 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3887/7759] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:59:07 2022] DELETE /identity/v3/users/9855d8db94ed451580373bd5fa75440b => generated 0 bytes in 1315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:09.076850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:09.077209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:09.077572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:09.086235 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3873/7760] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:59:09.125171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:09.128585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:09.234333 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3888/7761] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:59:09.255163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:09.259182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:09.320015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796dab2-f807-4bcd-9a9d-b6d24ae03aa8 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:09.394145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:09.394808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:09.395384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:09.395384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:09.406496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:09.409328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:09.422678 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3874/7762] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:59:10.077810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:10.080130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:10.094872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe7405-39d7-40bc-83fa-a5b87832a336 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:10.104159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:10.105929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:10.106309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:10.106849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] PATH_INFO: `/v3/projects/9f7ec4bb5ebc476da30cbca73893332a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:10.110144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7ec4bb5ebc476da30cbca73893332a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:10.111831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:10.140222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:10.274020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7ec4bb5ebc476da30cbca73893332a', 'request_id': 'req-54f8ca90-fe49-43e4-88fb-494d82f247e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.434528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7ec4bb5ebc476da30cbca73893332a', 'request_id': 'req-54f8ca90-fe49-43e4-88fb-494d82f247e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.441967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7ec4bb5ebc476da30cbca73893332a', 'request_id': 'req-54f8ca90-fe49-43e4-88fb-494d82f247e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.454477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] The token cache is being invalidate because project 9f7ec4bb5ebc476da30cbca73893332a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:59:10.457313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.457313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.457313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3889/7763] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:59:10 2022] DELETE /identity/v3/projects/9f7ec4bb5ebc476da30cbca73893332a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:10.461620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:10.482104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d21d-257c-4cf8-8ac3-ef6d4a4ec418 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:10.555249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:10.555899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:10.556175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:10.556442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] PATH_INFO: `/v3/users/d69f9235e4544c48bd229b65e183420e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:10.557669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69f9235e4544c48bd229b65e183420e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:10.560114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:10.908834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69f9235e4544c48bd229b65e183420e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:10.911207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69f9235e4544c48bd229b65e183420e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:11.205869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69f9235e4544c48bd229b65e183420e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:11.223944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69f9235e4544c48bd229b65e183420e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:11.225950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-afef73d4-9bb4-4ab0-8846-087c016b5e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69f9235e4544c48bd229b65e183420e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:11.246573 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3875/7764] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:59:10 2022] DELETE /identity/v3/users/d69f9235e4544c48bd229b65e183420e => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:59:11.850739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:11.851497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:11.885969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8ca90-fe49-43e4-88fb-494d82f247e4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:11.983874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:11.983874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:11.983874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:11.983874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] PATH_INFO: `/v3/projects/90008313cf074826ad6eae1542682924` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:11.984308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90008313cf074826ad6eae1542682924)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:11.986134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:12.165740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90008313cf074826ad6eae1542682924', 'request_id': 'req-b2bc3b6e-4b6b-460a-9642-2160046f6316'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:12.252456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90008313cf074826ad6eae1542682924', 'request_id': 'req-b2bc3b6e-4b6b-460a-9642-2160046f6316'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:12.261282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90008313cf074826ad6eae1542682924', 'request_id': 'req-b2bc3b6e-4b6b-460a-9642-2160046f6316'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:12.283247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] The token cache is being invalidate because project 90008313cf074826ad6eae1542682924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:59:12.283825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:12.284703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2bc3b6e-4b6b-460a-9642-2160046f6316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:12.287623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3890/7765] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:59:11 2022] DELETE /identity/v3/projects/90008313cf074826ad6eae1542682924 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:12.298187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:12.301753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:12.302971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:12.354757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:12.359175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:12.368676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:12.478695 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3876/7766] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:12.487671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:12.488064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:12.488432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:12.526057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:12.527742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:12.537469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3891/7767] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:12.541361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:12.560293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003c8b1-b32c-4643-bbbe-416f1aa18553 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:12.560293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:12.560293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:12.560293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:12.560661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:12.560661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:59:12.560661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:12.561754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:12.576417 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3877/7768] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:59:12.580818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:12.592474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ac3e-9fce-4cb3-b73c-43c94ce7f0ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:12.599522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:12.600210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:12.603816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:12.603816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:12.603816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:12.603816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:12.797566 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3892/7769] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:59:12 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:59:12.798892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:12.811569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd8366-5ff2-4282-a7f0-32f5e4171b06 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:12.881477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:12.882384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:12.882700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:12.882981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:12.883640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:12.885727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:13.853103 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3878/7770] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:59:12 2022] POST /identity/v3/users => generated 292 bytes in 1055 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:59:13.857802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:13.866462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:13.871043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2ba70-64e0-4a85-a971-646214c1bf46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:13.879564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:13.880189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:13.880457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:13.881293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:13.882228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:13.883542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:13.894572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3893/7771] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 14:59:13.899278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:13.926921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d00c-f1c4-4d30-8c66-dc90342e5241 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:13.949702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:13.952107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:13.952387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:13.952658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:13.953331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:13.955187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b4eb9-78d0-4de5-a0cb-276b145da5a5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:13.972253 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3879/7772] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:59:13.980734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:13.992866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d4d8-6837-4469-b1c3-1c04387ddd63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:13.998755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:14.007325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:14.007633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:14.007921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] PATH_INFO: `/v3/projects/5a4a49957fe24ad9aeed9047a6e9fef4/users/d1f1014e2da94902a419e6de14a18927/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:14.059402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4a49957fe24ad9aeed9047a6e9fef4, user_id=d1f1014e2da94902a419e6de14a18927, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:14.062514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:14.206026 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3894/7773] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:59:13 2022] PUT /identity/v3/projects/5a4a49957fe24ad9aeed9047a6e9fef4/users/d1f1014e2da94902a419e6de14a18927/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:59:14.217134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:14.217568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:14.218642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:14.263017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] MFA Rules not processed for user `d1f1014e2da94902a419e6de14a18927`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:14.264456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:14.342890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3880/7774] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:14.355721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:14.358059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:14.465682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0287-c5cc-4444-9536-d4e936d2ec00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:14.472682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:14.473455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:14.474021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:14.474224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:14.485950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:14.487562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f60f2b-c9d6-4ac7-9240-672d1c54c17b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:14.521407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3895/7775] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:59:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:59:14.546428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:14.553942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:14.631304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b55f54-f98f-4bf2-a8e9-b6ed5c13ce40 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:14.649838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:14.650504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:14.651195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:14.651471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] PATH_INFO: `/v3/users/d1f1014e2da94902a419e6de14a18927` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:14.652716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1014e2da94902a419e6de14a18927)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:14.661408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:14.954798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1014e2da94902a419e6de14a18927'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:14.956207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1014e2da94902a419e6de14a18927'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:15.102238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1014e2da94902a419e6de14a18927'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:15.117169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1014e2da94902a419e6de14a18927'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:15.118028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1014e2da94902a419e6de14a18927'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:15.134960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3881/7776] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 14:59:14 2022] DELETE /identity/v3/users/d1f1014e2da94902a419e6de14a18927 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:15.139372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:15.139776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:15.140069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:15.162169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:15.163531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:15.248979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3896/7777] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:59:15.260660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:15.264034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:15.362631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec84a7-c73c-40e2-a24a-5de1e6ea1a3f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:15.367794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:15.368557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:15.368939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:15.369310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:15.380962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:15.383079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:15.397979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3882/7778] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:59:16.096418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:16.098010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:16.125121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079104-8d92-4987-9fe6-79ff0dec6baa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:16.133195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:16.139795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:16.140095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:16.140095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.140095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.140095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] PATH_INFO: `/v3/projects/5a4a49957fe24ad9aeed9047a6e9fef4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.141372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4a49957fe24ad9aeed9047a6e9fef4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:16.145095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:16.216658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:16.272241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722f27-f70b-45e5-a23e-8beb8b4ed301 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:16.278230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:16.278979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.279261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.280146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.282009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:16.297960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:16.299936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d96ab-0037-4a1c-87d4-7784818d8bf0 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:16.321277 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3883/7779] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:59:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 14:59:16.328304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4a49957fe24ad9aeed9047a6e9fef4', 'request_id': 'req-c386c3f0-f153-461c-b8d4-2edaff927ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:16.457192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4a49957fe24ad9aeed9047a6e9fef4', 'request_id': 'req-c386c3f0-f153-461c-b8d4-2edaff927ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:16.464569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4a49957fe24ad9aeed9047a6e9fef4', 'request_id': 'req-c386c3f0-f153-461c-b8d4-2edaff927ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:16.471022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:16.488073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] The token cache is being invalidate because project 5a4a49957fe24ad9aeed9047a6e9fef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 14:59:16.488370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:16.489390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c386c3f0-f153-461c-b8d4-2edaff927ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 14:59:16.494728 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3897/7780] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 14:59:16 2022] DELETE /identity/v3/projects/5a4a49957fe24ad9aeed9047a6e9fef4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:16.497891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.500822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.500822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.529646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:16.530888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:16.603758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3884/7781] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:16.611456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.611743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.612005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.637645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:16.637645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:16.645476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3898/7782] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:16.650226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:16.661079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de39c2-80a3-40c2-8e31-7e1696a98611 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:16.667624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:16.668363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.668787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.669327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.670022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:59:16.670287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:16.672685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:16.689447 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3885/7783] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 14:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:59:16.694606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:16.710522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59c70-d5d0-42d3-8747-612eee7c3fdf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:16.724674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:16.725545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:16.725957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:16.726258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:16.726935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:16.729100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:16.922765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3899/7784] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 14:59:16 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:59:16.926553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:16.937820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cf31-975b-4655-8a23-e6e36f3f41da admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.028151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.028770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.029049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.029319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.029964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.032983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.231506 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3886/7785] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 14:59:16 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:59:17.233054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:17.259365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12beb0-b131-451a-8a3a-f57e50ea6274 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.266959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.267691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.268044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.268388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.269136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.270898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.284237 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3900/7786] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:59:17.289338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:17.303392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7456e3-3457-4d29-b0fe-9de317017741 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.317500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.319106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.319395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.319740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.320399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.323432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1f9b-4fe9-4775-8f3f-b5cff56df501 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.342028 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3887/7787] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 14:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:59:17.348075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:17.362253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698e6e6-000a-4a17-a7d5-e4fe1ecd7c29 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.368735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.369694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.370198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.370726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] PATH_INFO: `/v3/projects/c13188cfd88c4a66aec5f30f28a8616b/users/e31995e7d7694cd3b8c1945fa6f94f6e/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.436920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13188cfd88c4a66aec5f30f28a8616b, user_id=e31995e7d7694cd3b8c1945fa6f94f6e, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.448453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9531a7-5895-4c1f-8f05-9516c86e7938 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.554696 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3901/7788] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 14:59:17 2022] PUT /identity/v3/projects/c13188cfd88c4a66aec5f30f28a8616b/users/e31995e7d7694cd3b8c1945fa6f94f6e/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:59:17.556566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.556899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.557174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.595304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] MFA Rules not processed for user `e31995e7d7694cd3b8c1945fa6f94f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:17.596677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:17.605035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:17.648037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.648332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.648588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.673731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:17.675620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:17.698817 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3888/7789] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:17.711998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:17.715081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:17.752013 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3902/7790] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 14:59:17.774528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:59:17.774528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:17.805748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eceff-a318-4293-9668-d4cabb115e44 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.810020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.810750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.811111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.811464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.822493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.824437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb837e-e7ce-4322-a3ba-3d05219a9d13 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.840929 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3889/7791] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 14:59:17.905787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f12c35-7c89-4613-a1be-3f15c8a6f95e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:59:17.948225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:59:17.948857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:17.949138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:17.949406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:17.968080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:59:17.969971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e4a9-9bd2-4cc2-a8f0-73dfa2b89272 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:59:17.995651 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3903/7792] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 14:59:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:59:27.853419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=50 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:27.990591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:59:37.647986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:59:37.648601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:59:37.648601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:59:37.672377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:59:37.673633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:59:37.783823 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3890/7793] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 14:59:47.774865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=25 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:01.379780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:01.383843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:01.383843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:01.401285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:01.402502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:01.410215 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3904/7794] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:01.432320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:01.447400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91689cd9-9151-40d2-ac5c-bf276b1868b1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:01.469195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:01.470894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:01.471276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:01.471645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:01.506850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:01.510327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:01.538877 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3891/7795] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:00:04.532307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:04.534544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:04.700576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cf3fb-9b68-44a9-bc9d-0ab27ee12ca7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:04.713770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:04.714417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:04.714729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:04.715006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:04.716885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:04.857506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:04.858901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:04.879886 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3905/7796] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:06.346159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:06.350027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:06.618848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:06.620440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:06.669903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556ac27-41be-41b2-8d2c-f07e35369061 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:06.681502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:06.684814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:06.685108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:06.686320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:06.700762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:06.748733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:06.753807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:06.785187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba4014-719a-4ce6-bcc4-be8f5a275679 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:06.791127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:06.792560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:06.793094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:06.793536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:06.799845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:06.804525 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3892/7797] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:06.832147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:06.838648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354d0b-5f7f-4d93-b6c7-9eb6dbdbef03 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:06.877723 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3906/7798] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:00:10.894420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:11.106906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cca6db-ceae-40f2-99a4-0986d385a250 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:11.130108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:11.132901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:11.132901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:11.132901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] PATH_INFO: `/v3/users/e31995e7d7694cd3b8c1945fa6f94f6e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:11.142205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31995e7d7694cd3b8c1945fa6f94f6e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:11.161562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:11.457103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31995e7d7694cd3b8c1945fa6f94f6e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:11.458165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31995e7d7694cd3b8c1945fa6f94f6e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:11.578415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31995e7d7694cd3b8c1945fa6f94f6e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:11.607899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31995e7d7694cd3b8c1945fa6f94f6e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:11.608840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31995e7d7694cd3b8c1945fa6f94f6e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:11.613371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:11.657170 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3893/7799] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:00:10 2022] DELETE /identity/v3/users/e31995e7d7694cd3b8c1945fa6f94f6e => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:11.658136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:11.658530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:11.658710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:11.692107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:11.693640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:11.753149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:11.808892 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3907/7800] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:11.820998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:11.825894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:11.895868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678bf3-dabd-4541-82a2-8ee5d5febd86 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:11.901801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:11.903048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:11.910410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:11.910410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:11.916337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:11.918083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe0209-0a9a-4d27-80f2-ff43749304b9 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:11.932931 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3894/7801] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:12.738207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:12.738207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:12.767055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1510c7-87e9-46a1-bda5-f89d011f10dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:12.776506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:12.777865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:12.777865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:12.778219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] PATH_INFO: `/v3/projects/c13188cfd88c4a66aec5f30f28a8616b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:12.779491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13188cfd88c4a66aec5f30f28a8616b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:12.782166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:12.959204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13188cfd88c4a66aec5f30f28a8616b', 'request_id': 'req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:13.032234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13188cfd88c4a66aec5f30f28a8616b', 'request_id': 'req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:13.056068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13188cfd88c4a66aec5f30f28a8616b', 'request_id': 'req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:13.070482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] The token cache is being invalidate because project c13188cfd88c4a66aec5f30f28a8616b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:00:13.071075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:13.072166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-80fb5c52-4c50-4ead-b5c9-be0f6b79b557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:13.074128 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3908/7802] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:00:12 2022] DELETE /identity/v3/projects/c13188cfd88c4a66aec5f30f28a8616b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:13.080631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.081544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.082025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.123648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:13.125109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:13.235616 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3895/7803] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:13.243502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.243716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.244589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.264945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:13.266675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:13.275382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3909/7804] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:13.279610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.298341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac909ba-52c4-453e-91c0-f631d12ceb74 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.306187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.307500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.307500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.307500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.308047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:00:13.308336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:13.310178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:13.339620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3896/7805] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:00:13.340740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.351690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab72639-292b-4efa-91f0-fe2e264b63da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.376345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.376970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.377256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.377530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.378162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:13.380138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:13.553198 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3910/7806] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:00:13 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:00:13.561023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.583915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46e75b-d0b3-45eb-9403-40d843370daa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.687161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.687161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.687161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.687161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.687550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:13.689034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:13.825155 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3897/7807] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:00:13 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:00:13.829914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.842022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138dd8-ae77-494a-b019-56d3c4ec58e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.849464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.850411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.851169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.851922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.852783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:13.855450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:13.889909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3911/7808] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:13.895253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.911074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf3b4-304c-4cf9-95a4-1aa3eaf71af1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.939389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.940277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.940629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.940910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:13.941572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:13.943374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd920c-e012-4aaa-826f-80e457fc02e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:13.950508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:13.962702 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3898/7809] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:13.970982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:13.986555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5834-b534-444b-b611-fff0d111b5fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:13.992840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:13.993860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:13.994393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:13.994886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] PATH_INFO: `/v3/projects/d6442d6c3311483ab91eb92e60355025/users/a3a18dbb12594721a7498a246be4c1c5/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:14.015286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6442d6c3311483ab91eb92e60355025, user_id=a3a18dbb12594721a7498a246be4c1c5, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:14.018978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:14.081446 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3912/7810] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:00:13 2022] PUT /identity/v3/projects/d6442d6c3311483ab91eb92e60355025/users/a3a18dbb12594721a7498a246be4c1c5/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:00:14.098789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:14.099279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:14.099567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:14.142003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] MFA Rules not processed for user `a3a18dbb12594721a7498a246be4c1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:14.143618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:14.254427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3899/7811] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:14.264631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:14.267217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:14.342093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d446f-419d-463d-92d6-a07f92585392 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:14.348136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:14.348753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:14.349038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:14.349349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:14.357916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:14.360687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:14.362222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:14.372706 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3913/7812] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:16.976718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:16.978151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:17.070773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bde20-8c10-4d45-a714-a964c1c59d90 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:17.077321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:17.078072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:17.078898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:17.079176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:17.080904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:17.096275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:17.097888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:17.113290 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3900/7813] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:18.786518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:18.788251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:18.817435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55225e3-916a-44b2-840c-e16799de6f53 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:18.826657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:18.829202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:18.829202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:18.829202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:18.831459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:18.849315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:18.851313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef5938-5aa2-417f-b9fa-4b4683c12646 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:18.867979 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3914/7814] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:22.535106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:22.656212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb730a45-ce6f-4ab3-aaad-ac4c2351282f service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:22.673253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:22.674493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:22.676364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:22.676863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] PATH_INFO: `/v3/users/a3a18dbb12594721a7498a246be4c1c5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:22.679014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a18dbb12594721a7498a246be4c1c5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:22.682314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:22.721077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:22.993803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a18dbb12594721a7498a246be4c1c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:22.994521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a18dbb12594721a7498a246be4c1c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:23.170611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a18dbb12594721a7498a246be4c1c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:23.189903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a18dbb12594721a7498a246be4c1c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:23.190739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a18dbb12594721a7498a246be4c1c5'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:23.211856 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3901/7815] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:00:22 2022] DELETE /identity/v3/users/a3a18dbb12594721a7498a246be4c1c5 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:23.216220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:23.216760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:23.216760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:23.238192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:23.239453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:23.314312 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3915/7816] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:23.324854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:23.326944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:23.447921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331bdbd-c091-4ae2-9d28-b0fc5c30d273 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:23.463964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:23.465837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:23.466158 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:23.466430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:23.500762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:23.504116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893134-8bed-47c1-a8a1-02eca2a9dcc1 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:23.518427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3902/7817] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:24.164243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:24.167275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:24.191668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95c9e-ce63-4c46-b001-a6c12f08e317 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:24.198182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:24.199368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.203525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.203525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] PATH_INFO: `/v3/projects/d6442d6c3311483ab91eb92e60355025` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.203525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6442d6c3311483ab91eb92e60355025)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:24.206085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:24.367767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6442d6c3311483ab91eb92e60355025', 'request_id': 'req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:24.461375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6442d6c3311483ab91eb92e60355025', 'request_id': 'req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:24.468817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6442d6c3311483ab91eb92e60355025', 'request_id': 'req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:24.480792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] The token cache is being invalidate because project d6442d6c3311483ab91eb92e60355025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:00:24.481021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:24.481695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4849fec-63fe-4ad5-9476-6e60ce0dc4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:24.483247 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3916/7818] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:00:24 2022] DELETE /identity/v3/projects/d6442d6c3311483ab91eb92e60355025 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:24.488852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.489385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.489627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.511511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:24.512837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:24.578891 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3903/7819] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:24.587131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.587553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.593633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.610471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:24.611724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:24.620128 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3917/7820] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:24.624675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:24.634871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf71a1-3a98-49aa-9739-c9051c06ace6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:24.639829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:24.640482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.640762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.641038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.641690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:00:24.642179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:24.643832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:24.660938 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3904/7821] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:00:24.665778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:24.679681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd94da-a33d-4336-b2f2-b226da440268 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:24.684700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:24.685442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.685728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.686113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.686921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:24.688868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:24.789897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3918/7822] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:00:24 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:00:24.791430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:24.804994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096be75c-701d-445e-865a-8a05cb95db6d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:24.847593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:24.891130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:24.891843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:24.892187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:24.892523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:24.893356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:24.896189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:25.016265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3905/7823] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:00:24 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:00:25.022589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:25.059568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde332b6-7f7d-4951-b88c-93f53313c184 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:25.072462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:25.073348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:25.074462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:25.078115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:25.078115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:25.080111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:25.105745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3919/7824] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:25.108733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:25.129417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbdacd-22fa-46bf-aaac-146bfc9afdd3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:25.139862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:25.141355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:25.141796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:25.142319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:25.143165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:25.145126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04952c-fbee-4e6d-9434-91e190e9056c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:25.162669 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3906/7825] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:25.167593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:25.183688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16deaa-8b3a-4cf2-9c09-cee207193c3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:25.191759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:25.192630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:25.197530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:25.197530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] PATH_INFO: `/v3/projects/7200ff81fb0e4574ac1ff7706af564eb/users/01b49a8f1f964329b74c43437db02275/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:25.213391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7200ff81fb0e4574ac1ff7706af564eb, user_id=01b49a8f1f964329b74c43437db02275, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:25.216292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:25.350851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3920/7826] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:00:25 2022] PUT /identity/v3/projects/7200ff81fb0e4574ac1ff7706af564eb/users/01b49a8f1f964329b74c43437db02275/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:25.363236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:25.363529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:25.363810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:25.397297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] MFA Rules not processed for user `01b49a8f1f964329b74c43437db02275`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:25.398543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:25.494354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3907/7827] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:25.507814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:25.509620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:25.516348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:25.693483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b2aa-d649-4e58-90be-de07000ca21f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:25.698507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:25.699237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:25.699676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:25.700008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:25.714673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:25.716819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:25.743230 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3921/7828] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:00:30.064594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:30.066375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:30.157807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b23e92-464d-45fe-a79a-79b1f057081a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:30.162086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:30.163167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:30.163448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:30.163721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:30.165554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:30.240646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:30.268974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:30.270912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:30.303992 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3908/7829] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:00:35.728432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:36.659318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:36.662194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:36.688002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd13fa-368c-41d1-96da-95170a0e995f service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:36.693626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:36.694279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:36.694556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:36.694863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] PATH_INFO: `/v3/users/45a44e99d4dd4691ba4222fe166df89c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:36.696027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a44e99d4dd4691ba4222fe166df89c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:36.697949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:37.070834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a44e99d4dd4691ba4222fe166df89c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:37.072373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a44e99d4dd4691ba4222fe166df89c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:37.211224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a44e99d4dd4691ba4222fe166df89c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:37.239503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a44e99d4dd4691ba4222fe166df89c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:37.239503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd8a9c97-0d7a-4fae-8780-b9570cf3f3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a44e99d4dd4691ba4222fe166df89c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:37.281300 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3922/7830] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:00:36 2022] DELETE /identity/v3/users/45a44e99d4dd4691ba4222fe166df89c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:37.652020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:37.673410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa0363-946b-4730-a15d-9123f2229708 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:37.772720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:37.773624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:37.774099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:37.774930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] PATH_INFO: `/v3/projects/0614cdff75f94d2bad2e0ac75b52f131` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:37.777146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0614cdff75f94d2bad2e0ac75b52f131)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:37.784992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:37.957582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0614cdff75f94d2bad2e0ac75b52f131', 'request_id': 'req-158aa9fc-e808-4f64-8024-75c1519b84db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:38.056356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0614cdff75f94d2bad2e0ac75b52f131', 'request_id': 'req-158aa9fc-e808-4f64-8024-75c1519b84db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:38.064406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0614cdff75f94d2bad2e0ac75b52f131', 'request_id': 'req-158aa9fc-e808-4f64-8024-75c1519b84db'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:38.096184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] The token cache is being invalidate because project 0614cdff75f94d2bad2e0ac75b52f131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:00:38.096489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:38.097378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-158aa9fc-e808-4f64-8024-75c1519b84db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:38.099175 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3909/7831] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:00:37 2022] DELETE /identity/v3/projects/0614cdff75f94d2bad2e0ac75b52f131 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:38.106319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.106918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.107136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.155724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:38.170167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:38.307288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3923/7832] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:38.322025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.322304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.322967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.348715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:38.351507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:38.370651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3910/7833] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:38.375971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:38.402348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63ff3-0b6a-4270-ba67-7c2a4ea6068d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:38.416297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:38.417232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.422182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.422744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.424149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:00:38.424783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:38.427208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:38.460116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:38.463705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3924/7834] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:00:38.478401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f94818-bd0d-4b43-8bc6-2a5b24cc3319 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:38.489988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:38.491826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.492957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.494068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.495733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:38.501878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:38.664265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3911/7835] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:00:38 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:00:38.668737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:38.684846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86bd6-d0c4-4429-9806-12fda8614fad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:38.804750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:38.805385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.805886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.806229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.806936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:38.811198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:38.824415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:38.922073 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3925/7836] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:00:38 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:00:38.926270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:38.947330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381bc45-7bfa-4f27-99a0-6c191defb0c5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:38.954002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:38.954959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:38.955402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:38.955869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:38.956708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:38.958548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:38.978657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3912/7837] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:38.982673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:38.999159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95c13a-fecc-4d8d-88f8-b2ef46a185a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:39.006308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:39.007068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.010161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.010161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.010161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:39.010161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9de2b-02a0-487d-b53d-90f3f3bfbcb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:39.033402 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3926/7838] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:39.033929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:39.048254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf608c93-f0dc-4928-9ade-ce431c65b5fe admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:39.056408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:39.061735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.061735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.061735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] PATH_INFO: `/v3/projects/9682e2f9f623488d8f76e36e3a04c8a1/users/aeded9cf96b24b8bb6ffa2b0c1ec1f9b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.085218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9682e2f9f623488d8f76e36e3a04c8a1, user_id=aeded9cf96b24b8bb6ffa2b0c1ec1f9b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:39.088746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:39.168805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.169702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.170747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.175793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3913/7839] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:00:39 2022] PUT /identity/v3/projects/9682e2f9f623488d8f76e36e3a04c8a1/users/aeded9cf96b24b8bb6ffa2b0c1ec1f9b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:39.218998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:39.218998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:39.367280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3927/7840] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:39.378990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:39.380917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:39.402188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:39.469864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122b7a5-a4a4-4eec-8330-f4fe1eda8742 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:39.475478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:39.476163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.476634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.476898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.490342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:39.492850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c2b97-aae6-42ff-887e-8480898e1269 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:39.513477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3914/7841] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:47.764611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:47.775853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4e6ce-5209-46ce-8e06-cecaea273a41 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:47.780488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:47.781977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:47.783567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:47.784040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:47.795345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:47.811080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:47.813480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcad1b9-b91e-4eb6-98b9-04c38e9fba03 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:47.835559 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3928/7842] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:48.646882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:48.647419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:48.647419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:48.707407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] MFA Rules not processed for user `aeded9cf96b24b8bb6ffa2b0c1ec1f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:48.708959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:48.862653 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3915/7843] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:48.874419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:48.875028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:48.875028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:48.911179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] MFA Rules not processed for user `aeded9cf96b24b8bb6ffa2b0c1ec1f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:48.921716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:48.954550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3929/7844] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:48.968106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:48.969832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:49.075788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82237c16-8071-4711-bf44-8a93451cf5ce None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:49.091848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:49.093252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:49.094806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:49.104778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:49.105417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:49.105417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:49.110187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:49.113183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:49.148309 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3916/7845] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:49.152718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d029-5f50-4ea8-913c-bfbdbb6e2caf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:49.189060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:49.197914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:49.197914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:49.197914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] PATH_INFO: `/v3/users/c29c4522c3204e24adeeffb44d7031f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:49.197914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29c4522c3204e24adeeffb44d7031f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:49.204782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:49.510387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29c4522c3204e24adeeffb44d7031f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:49.511143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29c4522c3204e24adeeffb44d7031f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:49.616308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29c4522c3204e24adeeffb44d7031f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:49.634557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29c4522c3204e24adeeffb44d7031f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:49.635422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8039cf8-1d1e-499d-b9fb-8f8bc62c8de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29c4522c3204e24adeeffb44d7031f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:49.656334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3930/7846] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:00:49 2022] DELETE /identity/v3/users/c29c4522c3204e24adeeffb44d7031f5 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:50.056680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:50.064697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2759b3-ac14-49a8-9ad8-8290a867f1d0 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:50.115243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:50.171725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:50.172670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.173043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.173449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] PATH_INFO: `/v3/projects/acc0901ef4b847d995740fcfb6e3e3d7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.175826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc0901ef4b847d995740fcfb6e3e3d7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:50.180782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:50.388916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc0901ef4b847d995740fcfb6e3e3d7', 'request_id': 'req-abc96b3b-1552-4aa3-afbf-35e625ede00b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:50.519331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc0901ef4b847d995740fcfb6e3e3d7', 'request_id': 'req-abc96b3b-1552-4aa3-afbf-35e625ede00b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:50.528001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc0901ef4b847d995740fcfb6e3e3d7', 'request_id': 'req-abc96b3b-1552-4aa3-afbf-35e625ede00b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:50.544317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] The token cache is being invalidate because project acc0901ef4b847d995740fcfb6e3e3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:00:50.544622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:50.545499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-abc96b3b-1552-4aa3-afbf-35e625ede00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:00:50.547171 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3917/7847] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:00:50 2022] DELETE /identity/v3/projects/acc0901ef4b847d995740fcfb6e3e3d7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:50.560111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.565058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.565058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.596781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:50.598867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:50.632357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:50.682806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3931/7848] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:50.695296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.695912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.696196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.732957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:50.734682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:50.744435 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3918/7849] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:50.751031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:50.764771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645a8f-1aa3-404a-b352-32b73f754f5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:50.774239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:50.775212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.779683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.779683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.779683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:00:50.779683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:50.779683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:50.798349 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3932/7850] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:00:50.802657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:50.818238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05c195-5e29-4e62-a4c7-9e00f51799a4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:50.831863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:50.832766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.834330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.834858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.835691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:50.839145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.004537 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3919/7851] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:00:50 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:00:51.009418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:51.021166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6a18-8034-456d-8edf-f3a0c1dbf591 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.107050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.116010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.116010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.116010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.116010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.116010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.197190 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3933/7852] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:00:51 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:00:51.201784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:51.215068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cad3b-5868-4ade-b969-5755d6d7f951 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.221364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.222374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.222949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.223438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.224396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.226494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.244917 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3920/7853] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:51.250562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:51.268091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65069b-e4f0-4f8d-8a72-90485739239b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.275406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.277822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.279194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.279731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.280670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.288880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2f811-40b8-4e1d-8133-ad15a012ae65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.327093 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3934/7854] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:00:51.328516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:51.346054 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cf88e-4f73-4e7f-b25e-017ed17ec61f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.357415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.358697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.359087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.359431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] PATH_INFO: `/v3/projects/4a7cb7a681eb43c89918b756e0ae2767/users/ff3cbde05c7146cbb1cfb7ca51d299c6/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.398039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7cb7a681eb43c89918b756e0ae2767, user_id=ff3cbde05c7146cbb1cfb7ca51d299c6, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.401541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.527415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3921/7855] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:00:51 2022] PUT /identity/v3/projects/4a7cb7a681eb43c89918b756e0ae2767/users/ff3cbde05c7146cbb1cfb7ca51d299c6/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:00:51.544902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.546457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.547204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.598375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] MFA Rules not processed for user `ff3cbde05c7146cbb1cfb7ca51d299c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:51.598375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:51.681210 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3935/7856] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:51.693389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:51.698406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:51.846146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3493b-5433-45e9-9610-df2d3dc15d7c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.850887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.851532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.851815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.852089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.868607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.870092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.876564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:51.883445 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3922/7857] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:01.673363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:16.429513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:16.437867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:16.582327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700fb3-402e-4431-ba76-15eb6c7c5bfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:16.587553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:16.588294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:16.589127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:16.589610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] PATH_INFO: `/v3/users/aeded9cf96b24b8bb6ffa2b0c1ec1f9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:16.590871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeded9cf96b24b8bb6ffa2b0c1ec1f9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:16.595490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:16.824642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeded9cf96b24b8bb6ffa2b0c1ec1f9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:16.825474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeded9cf96b24b8bb6ffa2b0c1ec1f9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:16.892969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeded9cf96b24b8bb6ffa2b0c1ec1f9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:16.937865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeded9cf96b24b8bb6ffa2b0c1ec1f9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:16.939141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0bd9ba28-388d-4f8e-8386-3ff965e1b0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeded9cf96b24b8bb6ffa2b0c1ec1f9b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:16.962314 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3936/7858] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:01:16 2022] DELETE /identity/v3/users/aeded9cf96b24b8bb6ffa2b0c1ec1f9b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:17.334588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:17.346458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4a669-a6fe-43ae-96b4-f717f0e9776b service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:17.411229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:17.411878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:17.412170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:17.412499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] PATH_INFO: `/v3/projects/9682e2f9f623488d8f76e36e3a04c8a1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:17.413657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9682e2f9f623488d8f76e36e3a04c8a1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:17.415893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:17.571758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9682e2f9f623488d8f76e36e3a04c8a1', 'request_id': 'req-ffb18fda-30ab-4895-b7d2-130f16c13b99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:17.655206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9682e2f9f623488d8f76e36e3a04c8a1', 'request_id': 'req-ffb18fda-30ab-4895-b7d2-130f16c13b99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:17.662939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9682e2f9f623488d8f76e36e3a04c8a1', 'request_id': 'req-ffb18fda-30ab-4895-b7d2-130f16c13b99'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:17.676813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] The token cache is being invalidate because project 9682e2f9f623488d8f76e36e3a04c8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:01:17.677097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:17.677769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ffb18fda-30ab-4895-b7d2-130f16c13b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:17.679854 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3923/7859] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:01:17 2022] DELETE /identity/v3/projects/9682e2f9f623488d8f76e36e3a04c8a1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:01:17.686055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:17.686647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:17.686647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:17.708822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:17.710518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:17.789294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3937/7860] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:17.794440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:17.794762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:17.795045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:17.819988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:17.821209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:17.833067 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3924/7861] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:17.834896 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:17.846546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d879-5195-48c0-878a-d547c44a0260 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:17.852154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:17.861947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:17.879200 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3938/7862] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:01:17.890521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:17.904851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37275db-684a-47ba-9762-0440188c70a0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:17.910002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:17.911005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:17.911416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:17.911806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:17.912560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:17.915508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.117191 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3925/7863] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:01:17 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:01:18.118418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:18.129451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31f7a-451a-4ffb-9ad8-af482e0eb6c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:18.133618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:18.199999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:18.200614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.201070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.201353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.202000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:18.204052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.429909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3939/7864] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:01:18 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:01:18.434696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:18.446174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e942649-c6b4-4fd1-95cd-a0cab794a4a7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:18.452803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:18.453447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.453732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.454006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.454703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:18.456375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.467760 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3926/7865] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:18.471591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:18.482365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a2540-a1f5-4c74-abdb-1e2fbeedc56c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:18.487512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:18.488193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.488658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.489015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.489727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:18.491464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076c391-2060-44b0-86b1-c2b2296adca0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.504811 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3940/7866] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:18.509237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:18.520507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76217-1113-43d6-933b-f892b6ebc61a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:18.525354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:18.526057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.526335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.526837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] PATH_INFO: `/v3/projects/acf2c0461ca849c4bbc618b74aea818b/users/15a2561ee070414a96d78f3f5709de54/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.544473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2c0461ca849c4bbc618b74aea818b, user_id=15a2561ee070414a96d78f3f5709de54, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:18.547514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.656239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3927/7867] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:01:18 2022] PUT /identity/v3/projects/acf2c0461ca849c4bbc618b74aea818b/users/15a2561ee070414a96d78f3f5709de54/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:18.660194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.660679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.661203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.684220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:18.686261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:18.775888 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3941/7868] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:18.786376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:18.788146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:18.825395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:18.857448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146032a-0077-43b5-acd5-e9547c36675b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:18.861150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:18.861800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:18.862080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:18.862352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:18.875391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:18.876912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6e25-a49c-4010-8e57-32ef2129a9ac service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:18.887640 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3928/7869] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:21.599533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:21.605286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:21.627715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1546a2-c891-4940-87f3-a4b72f360bc5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:21.635884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:21.636964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:21.637415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:21.637866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] PATH_INFO: `/v3/users/ff3cbde05c7146cbb1cfb7ca51d299c6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:21.639622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3cbde05c7146cbb1cfb7ca51d299c6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:21.642187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:22.047082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3cbde05c7146cbb1cfb7ca51d299c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:22.049840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3cbde05c7146cbb1cfb7ca51d299c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:22.169030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3cbde05c7146cbb1cfb7ca51d299c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:22.186548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3cbde05c7146cbb1cfb7ca51d299c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:22.187289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3cbde05c7146cbb1cfb7ca51d299c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:22.198674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:22.206293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3942/7870] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:01:21 2022] DELETE /identity/v3/users/ff3cbde05c7146cbb1cfb7ca51d299c6 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:22.211050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:22.212312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:22.214156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:22.246593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:22.249124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:22.363144 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3929/7871] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:22.372427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:22.374307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:22.465541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9372c-1230-446b-88c8-d4f75810b691 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:22.471333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:22.472322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:22.473067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:22.473489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:22.484780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:22.486709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978fb7-c829-4637-8ed5-0fbbda45dd8b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:22.499256 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3943/7872] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:23.231349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:23.231349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:23.249500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788c88-29ec-4254-9c9f-135a89ef3b1e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:23.269150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:23.275970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:23.275970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:23.275970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] PATH_INFO: `/v3/projects/4a7cb7a681eb43c89918b756e0ae2767` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:23.275970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7cb7a681eb43c89918b756e0ae2767)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:23.277544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:23.499044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7cb7a681eb43c89918b756e0ae2767', 'request_id': 'req-dd71da68-e0a9-4714-9a55-37923e81ec62'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:23.652700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7cb7a681eb43c89918b756e0ae2767', 'request_id': 'req-dd71da68-e0a9-4714-9a55-37923e81ec62'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:23.659790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7cb7a681eb43c89918b756e0ae2767', 'request_id': 'req-dd71da68-e0a9-4714-9a55-37923e81ec62'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:23.677770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] The token cache is being invalidate because project 4a7cb7a681eb43c89918b756e0ae2767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:01:23.678226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:23.679139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd71da68-e0a9-4714-9a55-37923e81ec62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:23.681233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3930/7873] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:01:23 2022] DELETE /identity/v3/projects/4a7cb7a681eb43c89918b756e0ae2767 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:23.690030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:23.690575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:23.690575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:23.768181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:23.770867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:23.997561 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3944/7874] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:24.010918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.011223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.011777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.040356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:24.041722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:24.058446 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3931/7875] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:24.059917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.073775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617345-62a2-4253-aa35-29fc598a6b78 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.091919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.093955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.093955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.094502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.095168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:01:24.100117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.100117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.127067 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3945/7876] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:01:24.130766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.148421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bda5cd-e863-4408-a980-243fe1f749bf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.162236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.163008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.164111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.164111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.164644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.168185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.296038 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3932/7877] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:01:24 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:01:24.300580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.317328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393864f-7e7a-43bc-bfba-ec73c36977ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.436182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.437837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.438220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.438589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.439356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.441647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.581389 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3946/7878] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:01:24 2022] POST /identity/v3/users => generated 282 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:01:24.584904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.597114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c41d2-3f31-4c9c-9c9f-fa612bd11b4e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.602902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.603497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.605622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.605961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.606700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.609098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.621815 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3933/7879] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:24.625951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.638550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4dcad-d031-4197-ad14-438dde69c56a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.647065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.648641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.648641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.648641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.649164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.651040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78f9c8-03b9-47f7-ab4c-211000c9d10a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.664512 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3947/7880] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:24.669384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:24.680761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8f3b-7afa-4a27-9f8d-bace50caab54 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:24.687268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:24.687980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.688257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.688529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] PATH_INFO: `/v3/projects/8b061de54c89417ba93f673e340ac8c7/users/aa76d6c9535740a48e40424ed8b13ce8/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.703402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:24.713371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b061de54c89417ba93f673e340ac8c7, user_id=aa76d6c9535740a48e40424ed8b13ce8, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:24.716377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:24.943371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3934/7881] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:01:24 2022] PUT /identity/v3/projects/8b061de54c89417ba93f673e340ac8c7/users/aa76d6c9535740a48e40424ed8b13ce8/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:24.951689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e388-5dcc-42c8-b90d-d6e348a6874c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:24.951689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e388-5dcc-42c8-b90d-d6e348a6874c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:24.951689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3e388-5dcc-42c8-b90d-d6e348a6874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:24.964799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:24.972847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fe3e388-5dcc-42c8-b90d-d6e348a6874c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:24.974060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fe3e388-5dcc-42c8-b90d-d6e348a6874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:25.086596 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3948/7882] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:25.108696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:25.110820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:25.253296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f7be-71b2-4856-b321-fbb72abc6abb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:25.261571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:25.262256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:25.262545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:25.263723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:25.294798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:25.296570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebca53-9576-49f6-8412-3e225aeb1b8e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:25.345599 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3935/7883] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:26.627378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:26.627958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:26.627958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:26.691956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] MFA Rules not processed for user `15a2561ee070414a96d78f3f5709de54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:26.691956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:26.822517 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3949/7884] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:26.823849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:26.824334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:26.824449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:26.859193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] MFA Rules not processed for user `15a2561ee070414a96d78f3f5709de54`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:26.860352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:26.876539 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3936/7885] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:26.894424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:26.895159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:27.173686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:27.176672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d724fc-ce9e-4839-8864-a38cff975c96 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:27.187157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:27.187959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:27.188309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:27.188653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:27.199732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:27.202266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439f918-8894-41cc-836a-183fea8ab477 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:27.214510 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3950/7886] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:28.126211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:28.155923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7d98-2876-4c17-ad4c-a4e2808e8361 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:28.162681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:28.164077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:28.164486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:28.164607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:28.167712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:28.189934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:28.191762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7839817-6a1b-4dc1-835b-a786fc2924d4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:28.207120 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3937/7887] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:29.057681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:29.058260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:29.058260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:29.081998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] MFA Rules not processed for user `15a2561ee070414a96d78f3f5709de54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:29.083879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:29.095965 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3951/7888] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:36.369652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:36.370837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:36.371356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:36.434517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] MFA Rules not processed for user `aa76d6c9535740a48e40424ed8b13ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:36.444230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:36.606492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:36.612289 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3938/7889] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:36.617796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffadfb-9f7c-4305-887c-b2abd4f1c6c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:36.626322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:36.627748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:36.628283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:36.628902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:36.629966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:36.632869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:37.003970 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3952/7890] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:01:36 2022] POST /identity/v3/users => generated 288 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:01:37.007983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:37.020961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f7d-baf4-495f-b466-e31f691a87c7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:37.031462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:37.048375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:37.048375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:37.048375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:37.048375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:37.048375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2d71-e5e2-41de-92a2-405daccb812e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:37.055192 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3939/7891] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:37.060506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:37.078432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0999f-878d-4959-8238-b20b62c0f281 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:37.082409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:37.083258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:37.083910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:37.084498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] PATH_INFO: `/v3/system/users/c954be21dc0142afb7ff72387f22bab8/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:37.101727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c954be21dc0142afb7ff72387f22bab8, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:37.104214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:37.222794 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3953/7892] 10.222.0.13 () {60 vars in 1378 bytes} [Mon Oct 31 15:01:37 2022] PUT /identity/v3/system/users/c954be21dc0142afb7ff72387f22bab8/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:37.231650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668931b-4844-425a-ae43-e21150dca6be None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:37.235877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668931b-4844-425a-ae43-e21150dca6be None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:37.239508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668931b-4844-425a-ae43-e21150dca6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:37.331773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8668931b-4844-425a-ae43-e21150dca6be None None] MFA Rules not processed for user `c954be21dc0142afb7ff72387f22bab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:37.334251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8668931b-4844-425a-ae43-e21150dca6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:37.375122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:37.456589 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3940/7893] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:37 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 15:01:37.459676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:37.742197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75291ce-66c5-4f53-bcce-070e564aea67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:37.802963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c954be21dc0142afb7ff72387f22bab8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:37.804376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:37.804965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:37.805429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:37.807254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:37.811767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:37.829640 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3954/7894] 10.222.0.13 () {58 vars in 1110 bytes} [Mon Oct 31 15:01:37 2022] GET /identity/v3/services => generated 2191 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:37.834686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668931b-4844-425a-ae43-e21150dca6be None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:38.034050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668931b-4844-425a-ae43-e21150dca6be None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:38.102358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c954be21dc0142afb7ff72387f22bab8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:38.103044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:38.103329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:38.103618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] PATH_INFO: `/v3/limits` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:38.104319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:38.105785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 31 15:01:38.172915 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 31 15:01:38.174100 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:01:38.180335 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3941/7895] 10.222.0.13 () {60 vars in 1126 bytes} [Mon Oct 31 15:01:37 2022] POST /identity/v3/limits => generated 124 bytes in 341 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:01:38.180424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:38.189753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:38.471610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc467e-7c16-4d75-b08a-c19808c8713f None tempest-ImageQuotaTest-1004962513-system-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:38.558883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c954be21dc0142afb7ff72387f22bab8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:38.558883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:38.558883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:38.559403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:38.559403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:38.559403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:38.568613 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3955/7896] 10.222.0.13 () {58 vars in 1137 bytes} [Mon Oct 31 15:01:38 2022] GET /identity/v3/registered_limits => generated 129 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:01:38.579868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:38.625638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:38.836890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab565a-9f98-459f-835f-3b27da0fbd26 None tempest-ImageQuotaTest-1004962513-system-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:38.902596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c954be21dc0142afb7ff72387f22bab8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:38.903108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:38.903391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:38.903667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:38.904336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:38.905459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:38.912722 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3942/7897] 10.222.0.13 () {58 vars in 1137 bytes} [Mon Oct 31 15:01:38 2022] GET /identity/v3/registered_limits => generated 129 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:01:45.187365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:45.210345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96927153-8684-45f5-b116-b0c3e2db1a68 None tempest-ImageQuotaTest-1004962513-system-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:45.216646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:45.216646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:45.216646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:45.216646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] PATH_INFO: `/v3/users/aa76d6c9535740a48e40424ed8b13ce8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:45.221087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa76d6c9535740a48e40424ed8b13ce8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:45.228914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:45.528550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa76d6c9535740a48e40424ed8b13ce8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:45.530103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa76d6c9535740a48e40424ed8b13ce8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:45.624815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa76d6c9535740a48e40424ed8b13ce8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:45.653889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:45.660813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa76d6c9535740a48e40424ed8b13ce8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:45.663446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa76d6c9535740a48e40424ed8b13ce8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:45.716437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3956/7898] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:01:45 2022] DELETE /identity/v3/users/aa76d6c9535740a48e40424ed8b13ce8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:46.107019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:46.110699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.228988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a6313-2218-47e7-a879-0f4f9c273a17 None tempest-ImageQuotaTest-1004962513-system-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:46.236417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:46.237138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.237421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.237819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] PATH_INFO: `/v3/projects/8b061de54c89417ba93f673e340ac8c7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.239150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b061de54c89417ba93f673e340ac8c7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:46.241557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:46.270918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:46.377013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b061de54c89417ba93f673e340ac8c7', 'request_id': 'req-eb5c608f-acad-4e23-9784-8055aef1c7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.397961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:46.399982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.418109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8156a-b822-4400-b959-c20e91f3ac71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:46.486663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b061de54c89417ba93f673e340ac8c7', 'request_id': 'req-eb5c608f-acad-4e23-9784-8055aef1c7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.493711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b061de54c89417ba93f673e340ac8c7', 'request_id': 'req-eb5c608f-acad-4e23-9784-8055aef1c7ee'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.511539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] The token cache is being invalidate because project 8b061de54c89417ba93f673e340ac8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:01:46.512058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.513792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.514574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:46.515362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.515973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.518733 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3943/7899] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:01:46 2022] DELETE /identity/v3/projects/8b061de54c89417ba93f673e340ac8c7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:46.518921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] PATH_INFO: `/v3/users/01b49a8f1f964329b74c43437db02275` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.519836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b49a8f1f964329b74c43437db02275)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:46.522356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:46.523516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:46.527565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.543262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c608f-acad-4e23-9784-8055aef1c7ee admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:46.548720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:46.549707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.550214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.550770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] PATH_INFO: `/v3/users/c954be21dc0142afb7ff72387f22bab8` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.552548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c954be21dc0142afb7ff72387f22bab8)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:46.554878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:46.797163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b49a8f1f964329b74c43437db02275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.798497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b49a8f1f964329b74c43437db02275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.847371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c954be21dc0142afb7ff72387f22bab8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.848482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c954be21dc0142afb7ff72387f22bab8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.932073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b49a8f1f964329b74c43437db02275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.953083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b49a8f1f964329b74c43437db02275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.954249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98c193dc-008c-4259-852c-991fea2f4853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b49a8f1f964329b74c43437db02275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:46.988885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3957/7900] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:01:46 2022] DELETE /identity/v3/users/01b49a8f1f964329b74c43437db02275 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:46.994806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.995243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.995633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:47.018772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:47.020228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:47.081538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c954be21dc0142afb7ff72387f22bab8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:47.096613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c954be21dc0142afb7ff72387f22bab8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:47.097699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c954be21dc0142afb7ff72387f22bab8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:47.114818 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3944/7901] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:01:46 2022] DELETE /identity/v3/users/c954be21dc0142afb7ff72387f22bab8 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:47.122458 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3958/7902] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:47.130045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:47.131618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:47.238206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3474-954d-461a-b09b-d1495510632f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:47.245202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:47.246015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:47.246405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:47.246821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:47.282056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:47.382241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:47.384886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc06e-6562-40f3-b64d-eb2a341fd638 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:47.396471 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3945/7903] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:47.998134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:47.999783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:48.015411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f66a-04ab-45c4-8ddc-c90196a649f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.021518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.022527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.022903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.024221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] PATH_INFO: `/v3/projects/7200ff81fb0e4574ac1ff7706af564eb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.025097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7200ff81fb0e4574ac1ff7706af564eb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.027485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.033998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:48.134647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7200ff81fb0e4574ac1ff7706af564eb', 'request_id': 'req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:48.205697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7200ff81fb0e4574ac1ff7706af564eb', 'request_id': 'req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:48.216863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7200ff81fb0e4574ac1ff7706af564eb', 'request_id': 'req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:48.229824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] The token cache is being invalidate because project 7200ff81fb0e4574ac1ff7706af564eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:01:48.230111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:48.230796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0c75db-8aaa-42ab-9bdd-e0d891c55ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:01:48.232313 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3959/7904] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:01:47 2022] DELETE /identity/v3/projects/7200ff81fb0e4574ac1ff7706af564eb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:01:48.237164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.237642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.237743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.258988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:48.260315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:48.326242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3946/7905] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:48.341172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.341456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.341845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.362890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:48.364124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:48.373146 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3960/7906] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:48.377895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.389217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b607-4030-44c1-9b0c-8c8afda9c076 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.394106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.394796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.398828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.399274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.400122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:01:48.400435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.402144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.415725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3947/7907] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:01:48.420162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.430532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114b42d-17da-4632-bd6d-b5d85fcc486c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.435561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.436210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.436497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.436770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.437411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.439400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.533193 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3961/7908] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:01:48 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:01:48.537405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.548279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ef1b-2509-4192-85d9-6b9f422a82f8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.616262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.616868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.617671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.617942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.618608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.620632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.701519 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3948/7909] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:01:48 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:01:48.702734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.713898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ff32-d964-472e-8872-645fa1b23d16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.719017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.719730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.720167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.720503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.721207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.722945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.734254 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3962/7910] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:48.738370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.752391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e8afa-af50-448a-8110-84758f1fb7a7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.757166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.757837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.758118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.758393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.759219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.760850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37c8f3-ebc9-47e1-add3-7f7548e72b9e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.772856 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3949/7911] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:01:48.777935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:48.788654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272964b-1bcb-4958-ad24-63d1d59535c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:48.793916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:48.794580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.794892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.795169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] PATH_INFO: `/v3/projects/60b38c92403545339d822828c7158f64/users/5d35ea737af94e0a855965fb0a181fed/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.811761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b38c92403545339d822828c7158f64, user_id=5d35ea737af94e0a855965fb0a181fed, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:48.814400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:48.888058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3963/7912] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:01:48 2022] PUT /identity/v3/projects/60b38c92403545339d822828c7158f64/users/5d35ea737af94e0a855965fb0a181fed/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:01:48.900359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:48.900739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:48.901252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:48.931619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:48.935080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] MFA Rules not processed for user `5d35ea737af94e0a855965fb0a181fed`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:48.936337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:49.018127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3950/7913] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:01:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:49.029899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:49.031979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:49.100288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098024e-7505-4523-ab97-1ad835687e17 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:49.104533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:49.105231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:49.105647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:49.105929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:49.117579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:49.119300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:49.129014 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3964/7914] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:59.024150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=26 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:59.124471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:11.677936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:11.679672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:11.784474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4ae7-bd80-4ca2-b0b4-cbdcc21f7cda None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:11.789120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:11.791533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:11.791533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:11.791533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:11.792303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:11.879939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:11.881935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c4e00-c4ad-4397-8b4f-315fa30f968f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:11.901508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3951/7915] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:15.491250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:15.503496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4b36-7590-4d51-a2ee-a0f2a0af043b service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:15.507858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:15.508491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:15.508771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:15.509033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:15.511026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:15.530760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:15.532719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:15.550309 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3965/7916] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:21.889824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=59 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:25.540101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:52.684315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:52.685013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:52.685013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:52.705949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] MFA Rules not processed for user `15a2561ee070414a96d78f3f5709de54`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:52.707206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:52.783795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3952/7917] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:57.703057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:57.726310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e162d-9f58-4d2a-b3d0-5495405a5ef6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:57.733198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:57.733198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:57.733198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:57.733198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:57.735120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:57.749325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:57.751382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:57.763853 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3966/7918] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:58.932689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:58.934597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:58.957053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88733b-6aee-46e9-8b96-7ac7e25897d1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:58.963417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:58.964521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:58.964978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:58.965501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:58.968499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:59.070031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:59.072239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:59.095042 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3953/7919] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:03.812101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:03.814468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:03.849655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddebdae-25e1-488d-bc24-88316548dfdf service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:03.854954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:03.856055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:03.856598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:03.857259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:03.859857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:03.944518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:03.946314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dee458-7379-4fd1-a247-cbe236eaa704 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:03.962152 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3967/7920] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:03:09.092195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=66 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:10.648146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:10.669040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b700-f05e-4ab7-a122-ef77b27f2cb2 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:10.704037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:10.705995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:10.706706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:10.707872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:10.716630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:10.792570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:10.800001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:10.828518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3954/7921] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:11.853060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:11.853641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:11.853641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:11.890998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:11.893592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:11.902101 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3968/7922] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:12.275550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:12.289318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a687fa-a499-45c6-aeab-abe294319938 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:12.293834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:12.294945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:12.295466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:12.295971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:12.298853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:12.317424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:12.318914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f63452-de30-451a-972d-8f1e98ae68ad service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:12.331500 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3955/7923] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:20.904247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:20.980877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2b7a-2ac1-4d5a-89e0-49fbabee21b5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:20.985627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:20.986434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:20.986917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:20.987193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] PATH_INFO: `/v3/users/5d35ea737af94e0a855965fb0a181fed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:20.988518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d35ea737af94e0a855965fb0a181fed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:20.990468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:21.214542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d35ea737af94e0a855965fb0a181fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:21.215250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d35ea737af94e0a855965fb0a181fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:21.286714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d35ea737af94e0a855965fb0a181fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:21.308280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d35ea737af94e0a855965fb0a181fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:21.310237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d35ea737af94e0a855965fb0a181fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:21.314901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:21.335087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3969/7924] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:03:20 2022] DELETE /identity/v3/users/5d35ea737af94e0a855965fb0a181fed => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:03:21.340418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:21.341076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:21.341858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:21.373331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:21.374746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:21.447758 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3956/7925] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:21.459716 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:21.461103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:21.523019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7426f9-02b3-41b4-9752-ffec297be8c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:21.527001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:21.527722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:21.528141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:21.528498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:21.539873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:21.541301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:21.551553 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3970/7926] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:22.065632 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:22.067129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:22.082645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaecf4b-a2cb-4a74-8f90-7c97a1d4b925 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:22.088420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:22.088628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:22.088909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:22.089179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] PATH_INFO: `/v3/projects/60b38c92403545339d822828c7158f64` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:22.090315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b38c92403545339d822828c7158f64)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:22.092394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:22.216576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b38c92403545339d822828c7158f64', 'request_id': 'req-dfcfeb1d-9090-4855-8ace-c053a7042fd8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:22.342027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b38c92403545339d822828c7158f64', 'request_id': 'req-dfcfeb1d-9090-4855-8ace-c053a7042fd8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:22.350047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b38c92403545339d822828c7158f64', 'request_id': 'req-dfcfeb1d-9090-4855-8ace-c053a7042fd8'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:22.362203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] The token cache is being invalidate because project 60b38c92403545339d822828c7158f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:03:22.362539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:22.363217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dfcfeb1d-9090-4855-8ace-c053a7042fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:03:22.364728 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3957/7927] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:03:22 2022] DELETE /identity/v3/projects/60b38c92403545339d822828c7158f64 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:03:31.552936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=30 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:32.358627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:08.859058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:04:08.860699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:04:08.940370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a01ce4-f184-4540-9b5b-89f6c2236997 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:04:09.003738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:04:09.009145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:04:09.009145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:04:09.009145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:04:09.009145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:04:09.065713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:04:09.067338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:04:09.076108 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3971/7928] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:04:18.257374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:04:18.257894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:04:18.257894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:04:18.281217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] MFA Rules not processed for user `15a2561ee070414a96d78f3f5709de54`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:04:18.282702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:04:18.354681 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3958/7929] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:04:19.072133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:28.346145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=25 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:35.512311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:04:35.513824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:04:35.583480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a93b-7648-4b84-aecf-ce315dd09b17 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:04:35.587399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:04:35.588018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:04:35.588299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:04:35.588577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:04:35.591001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:04:35.604680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:04:35.606778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:04:35.618072 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3972/7930] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:04:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:04:45.611695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:07.484698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:07.487730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:08.138249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f5c1c-9300-4508-9fd5-170979033bea None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:08.138249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:08.138249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:08.138249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:08.149069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:08.149069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:08.149069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:08.149069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:08.149069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3959/7931] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:17.651522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=34 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:20.659364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:20.660839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:20.759884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e572c-9b37-4342-8c8d-b62776f6f90d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:20.764914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:20.765512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:20.765794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:20.766080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:20.767867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:20.783091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:20.784695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:20.798395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3973/7932] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:23.917076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:23.931727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713151f-7564-4b4e-9fc0-66a514359163 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:23.937459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:23.938112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:23.938387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:23.938687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:23.940452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:23.958385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:23.961744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:23.974610 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3960/7933] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:30.790990 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:33.967387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:35.342875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:35.344315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:35.360095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422fc75-be22-4c1d-b270-54349d0b8cb2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:35.365673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:35.368914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:35.368914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:35.368914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:35.368914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:35.385084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:35.386768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:35.401501 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3974/7934] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:35.475460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:35.476931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:35.563896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531a1d9-0c0c-4850-be5e-69ec488b2811 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:35.568502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:35.569138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:35.569412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:35.570322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] PATH_INFO: `/v3/users/15a2561ee070414a96d78f3f5709de54` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:35.571524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a2561ee070414a96d78f3f5709de54)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:35.573469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:35.801584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a2561ee070414a96d78f3f5709de54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:35.802295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a2561ee070414a96d78f3f5709de54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:35.867433 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a2561ee070414a96d78f3f5709de54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:35.881365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a2561ee070414a96d78f3f5709de54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:35.882702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d0d3174c-9008-4fe2-bd59-cc2c61a266e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a2561ee070414a96d78f3f5709de54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:35.895477 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3961/7935] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:35 2022] DELETE /identity/v3/users/15a2561ee070414a96d78f3f5709de54 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:36.142678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:36.155789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dea451-cdc5-4fa3-aa25-ef64f7aa9d05 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:36.220905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:36.221547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:36.221831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:36.222108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] PATH_INFO: `/v3/projects/acf2c0461ca849c4bbc618b74aea818b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:36.223280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf2c0461ca849c4bbc618b74aea818b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:36.225370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:36.362991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf2c0461ca849c4bbc618b74aea818b', 'request_id': 'req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:36.424211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf2c0461ca849c4bbc618b74aea818b', 'request_id': 'req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:36.431012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf2c0461ca849c4bbc618b74aea818b', 'request_id': 'req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:36.445427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] The token cache is being invalidate because project acf2c0461ca849c4bbc618b74aea818b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:36.446004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:36.446702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5ed3e6e-023c-4d83-b6d3-e8550ef84acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:36.448247 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3975/7936] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:36 2022] DELETE /identity/v3/projects/acf2c0461ca849c4bbc618b74aea818b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:36.453093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:36.453377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:36.453650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:36.525131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:36.527344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:36.586281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:36.606915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3962/7937] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:36.615382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:36.615668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:36.615944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:36.638213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:36.639402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:36.649027 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3976/7938] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:36.653425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:36.669406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eace85-63a4-49ab-a490-3e4a9d2bc654 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:36.675238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:36.675972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:36.676392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:36.676744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:36.677515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:36.677894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:36.679716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:36.698541 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3963/7939] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:05:36.703661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:36.716813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6540eb-2dac-49d9-a5c8-d4515bd63c4d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:36.723511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:36.724485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:36.724984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:36.725417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:36.726430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:36.729254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:36.941657 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3977/7940] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:36 2022] POST /identity/v3/projects => generated 361 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:36.942364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:36.953467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05700e9-3103-4f88-9177-ea705572440f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:37.012927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:37.013541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.013881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.014162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.014842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:37.016830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:37.110401 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3964/7941] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:36 2022] POST /identity/v3/users => generated 281 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:37.111592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:37.122571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a765e2-95ad-487f-83a4-bd562175b5e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:37.127444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:37.128266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.129243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.129535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.130167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:37.132010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:37.143816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3978/7942] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:37.147871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:37.158993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1c83-d9f6-487a-92a6-4b8ac1914aa6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:37.164605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:37.165291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.165656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.166061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.166872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:37.168696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9916fb-ffbc-4a0a-a430-23f0756b59c3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:37.180773 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3965/7943] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:37.184910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:37.196186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6a21a-8c87-4a43-b8d1-9821cb723018 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:37.201038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:37.201773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.202115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.202453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] PATH_INFO: `/v3/projects/0082032e9f0941f9a201229279b17010/users/02b37ef3d8b64c8d9234c964b77717a8/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.218512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0082032e9f0941f9a201229279b17010, user_id=02b37ef3d8b64c8d9234c964b77717a8, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:37.221289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:37.274172 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3979/7944] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:37 2022] PUT /identity/v3/projects/0082032e9f0941f9a201229279b17010/users/02b37ef3d8b64c8d9234c964b77717a8/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:37.285901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551946-da17-45d7-b4ac-be7f2a600769 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.286260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551946-da17-45d7-b4ac-be7f2a600769 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.286608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d551946-da17-45d7-b4ac-be7f2a600769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.316062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3d551946-da17-45d7-b4ac-be7f2a600769 None None] MFA Rules not processed for user `02b37ef3d8b64c8d9234c964b77717a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:37.317288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3d551946-da17-45d7-b4ac-be7f2a600769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:37.384841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3966/7945] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:37.435798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:37.441745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:37.497648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2ad80-c096-41e8-8197-5ec9def74660 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:37.502489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:37.506494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.506494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.506494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] PATH_INFO: `/v3/users/02b37ef3d8b64c8d9234c964b77717a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.506494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b37ef3d8b64c8d9234c964b77717a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:37.506993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:37.726380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b37ef3d8b64c8d9234c964b77717a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:37.727071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b37ef3d8b64c8d9234c964b77717a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:37.814997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b37ef3d8b64c8d9234c964b77717a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:37.827609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b37ef3d8b64c8d9234c964b77717a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:37.828243 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-234d8f8e-0bb5-469e-b72f-a0e596f1cdff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b37ef3d8b64c8d9234c964b77717a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:37.841283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3980/7946] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:37 2022] DELETE /identity/v3/users/02b37ef3d8b64c8d9234c964b77717a8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:37.845877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.846348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.846458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.866766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:37.868036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:37.905948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:37.928555 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3967/7947] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:37.938550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:37.938905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:37.939185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:37.986526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:37.987658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:38.048342 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3981/7948] 10.222.0.13 () {58 vars in 1062 bytes} [Mon Oct 31 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:38.054073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:38.064381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8eb2-3cfd-4631-9b23-01bd7c8e2059 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:38.068030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:38.068630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.068910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.069188 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.078776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:38.080209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377ba62-22c2-44b3-b423-9e73231c6b61 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:38.090089 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3968/7949] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:38.496799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:38.498319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:38.507696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:38.513835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9931c-27cc-4726-a185-7a687af2b810 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:38.518826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:38.521879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.521879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.521879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] PATH_INFO: `/v3/projects/0082032e9f0941f9a201229279b17010` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.521879 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0082032e9f0941f9a201229279b17010)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:38.523887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:38.641244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0082032e9f0941f9a201229279b17010', 'request_id': 'req-0f562849-533c-4b78-bac3-533ff5abc931'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:38.713011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0082032e9f0941f9a201229279b17010', 'request_id': 'req-0f562849-533c-4b78-bac3-533ff5abc931'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:38.722225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0082032e9f0941f9a201229279b17010', 'request_id': 'req-0f562849-533c-4b78-bac3-533ff5abc931'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:38.734983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] The token cache is being invalidate because project 0082032e9f0941f9a201229279b17010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:38.735284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:38.736433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f562849-533c-4b78-bac3-533ff5abc931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:38.737956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3982/7950] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:38 2022] DELETE /identity/v3/projects/0082032e9f0941f9a201229279b17010 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:38.744413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.744701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.745146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.766526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:38.767692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:38.828983 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3969/7951] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:38.836693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.836976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.837252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.856872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:38.859885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:38.866099 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3983/7952] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:38.871112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:38.881119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51702-ab81-4373-9834-5d15d9148426 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:38.886411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:38.887115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.887400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.887677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.888314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:38.888618 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:38.890276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:38.903124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3970/7953] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:38.914639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:38.923987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190670d7-a118-4b92-98fd-af4a35665314 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:38.929452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:38.930053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:38.930360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:38.930654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:38.931293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:38.933211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.055959 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3984/7954] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:39.059694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.070923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df837d4-94ac-4f0f-a202-b0bd94a466b8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.126737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.127338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.127616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.127886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.128531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.130446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.302186 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3971/7955] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:39 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:39.305162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.315614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf2a78-f707-419c-ac0f-8e9ae1b24399 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.320261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.320869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.321149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.321412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.322035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.323652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.333670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3985/7956] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:39.338025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.348075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dadf2-ea9a-408e-94e5-eb73fdf65b4e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.353863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.353863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.354121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.354401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.355076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.356673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4487ac-a43c-4899-99ad-19ad7c48152e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.367337 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3972/7957] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:39.371356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.381326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3e72-7313-42d0-ba51-99b988a0ca82 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.388134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.388821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.389094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.389357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] PATH_INFO: `/v3/projects/f30c111f8c534340a49a5da73bffdbd7/users/2b435cc692dd4623b736873c866aa3af/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.407961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30c111f8c534340a49a5da73bffdbd7, user_id=2b435cc692dd4623b736873c866aa3af, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.410778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.482728 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3986/7958] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:39 2022] PUT /identity/v3/projects/f30c111f8c534340a49a5da73bffdbd7/users/2b435cc692dd4623b736873c866aa3af/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:39.492976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.493091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.493431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.521720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] MFA Rules not processed for user `2b435cc692dd4623b736873c866aa3af`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:39.523434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:39.547767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:39.590764 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3973/7959] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:39.593177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.665445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371b0a-5c67-46f8-b18d-5a7fce7c72b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.677162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.677799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.678081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.678354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.679032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.680948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.799217 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3987/7960] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:39 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:39.803385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:39.815822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79779cbd-67b3-43a1-98d1-104a006646d1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:39.879768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:39.882995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:39.883269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:39.883533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:39.888293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:39.890380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:39.992951 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3974/7961] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:39 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:39.996989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.008010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e744fb-2056-436d-8adb-5307c906eb94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.012791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.013400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.013682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.013985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.014640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.016269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.017624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:40.029381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3988/7962] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:40.034072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.044723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28430a5-41b9-4407-b3dc-29b7890d890d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.049786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.050823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.051192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.051580 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] PATH_INFO: `/v3/projects/5972c9deba5942a4aa5016f14540c72a/users/6722db6261374bddb7d43e9e56c8b4bb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.070373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5972c9deba5942a4aa5016f14540c72a, user_id=6722db6261374bddb7d43e9e56c8b4bb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.073164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.171728 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3975/7963] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:40 2022] PUT /identity/v3/projects/5972c9deba5942a4aa5016f14540c72a/users/6722db6261374bddb7d43e9e56c8b4bb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:40.175928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.186475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29f3fe-dab2-4bb5-abb6-d78baea5cd33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.253596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.254210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.254492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.254812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.255458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.257060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58d6a9-3174-475d-b960-4dff3b107da7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.269364 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3989/7964] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:40.274296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.285253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2836c-369c-48cf-8b8f-ef5ca3ae3ec6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.290763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.291422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.291704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.291978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] PATH_INFO: `/v3/projects/5972c9deba5942a4aa5016f14540c72a/users/6722db6261374bddb7d43e9e56c8b4bb/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.294555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5972c9deba5942a4aa5016f14540c72a, user_id=6722db6261374bddb7d43e9e56c8b4bb, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.297886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.310348 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3976/7965] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:40 2022] PUT /identity/v3/projects/5972c9deba5942a4aa5016f14540c72a/users/6722db6261374bddb7d43e9e56c8b4bb/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:40.325432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.325747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.326026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.356996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] MFA Rules not processed for user `6722db6261374bddb7d43e9e56c8b4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:40.358220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:40.433708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3990/7966] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:40.438765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.450629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ede6-1c2d-4a68-bcaf-93a886695b1d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.455217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.455815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.456123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.456399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.457064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.458695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.541046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3977/7967] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 15:05:40 2022] POST /identity/v3/domains => generated 245 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:40.545339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.554803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3d33-7361-4b2c-a03c-5ad67ba4e2e1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.618921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.619599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.619843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.620118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.620760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.622840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.649560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:40.745766 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3991/7968] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:40 2022] POST /identity/v3/projects => generated 408 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:40.750008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.760974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95929daf-5a0e-4711-a8cf-11165fe736e2 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.820195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.823877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.823877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.823877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.823877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.824164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:40.834548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:40.964618 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3978/7969] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:40 2022] POST /identity/v3/users => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:40.969093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:40.981050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b047b-62b9-4f7e-aeef-9c9e65dd133e tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:40.985792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:40.986419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:40.986867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:40.987294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:40.987949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:40.989610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b2f16-c1df-4d9e-af5f-82ade5041856 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:41.001903 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3992/7970] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:41.006050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:41.018823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e59a-3a50-4c08-b5d9-9827d3b7ad54 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:41.024955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:41.025813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.026166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.026507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/projects/1a20de384fa34b79b8a629ca87932fa3/users/eb83aa0ff21a47419c2f285eaa3ab0de/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.043401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1a20de384fa34b79b8a629ca87932fa3, user_id=eb83aa0ff21a47419c2f285eaa3ab0de, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:41.046082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68bce-d8f4-43c5-b2b5-d0dd2357c7ad tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:41.158700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3979/7971] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:41 2022] PUT /identity/v3/projects/1a20de384fa34b79b8a629ca87932fa3/users/eb83aa0ff21a47419c2f285eaa3ab0de/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:41.163286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.171872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.171872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.266528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] MFA Rules not processed for user `eb83aa0ff21a47419c2f285eaa3ab0de`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:41.267747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:41.283408 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3993/7972] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:41.293777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.294060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.294335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.315562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] MFA Rules not processed for user `eb83aa0ff21a47419c2f285eaa3ab0de`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:41.316762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:41.324005 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3980/7973] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:41.328390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:41.338397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f5903-800d-47f1-8f39-72c60e4724a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:41.343202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb83aa0ff21a47419c2f285eaa3ab0de', 'user_domain_id': 'c0f6d4fd7b5d411481f1ac798e85f816', 'system_scope': None, 'project_id': '1a20de384fa34b79b8a629ca87932fa3', 'project_domain_id': 'c0f6d4fd7b5d411481f1ac798e85f816', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:41.343803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.344079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.344351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.352687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:41.355012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:41.363975 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3994/7974] 10.222.0.13 () {56 vars in 1284 bytes} [Mon Oct 31 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:41.368568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:41.434901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a1d32-5a59-48fa-86e4-ed3b88d093e0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:41.439469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:41.440097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.440378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.440651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/users/eb83aa0ff21a47419c2f285eaa3ab0de` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.441780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb83aa0ff21a47419c2f285eaa3ab0de)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:41.443760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:41.652419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb83aa0ff21a47419c2f285eaa3ab0de'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:41.653074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb83aa0ff21a47419c2f285eaa3ab0de'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:41.740775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb83aa0ff21a47419c2f285eaa3ab0de'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:41.757189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb83aa0ff21a47419c2f285eaa3ab0de'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:41.757189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb83aa0ff21a47419c2f285eaa3ab0de'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:41.769409 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3981/7975] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:41 2022] DELETE /identity/v3/users/eb83aa0ff21a47419c2f285eaa3ab0de => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:41.773831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:41.785429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac47292-9beb-42d7-82cf-8c1486d22981 tempest-test_project-510847818 tempest-user-231214868] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:41.843453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:41.844085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:41.844371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:41.844673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/projects/1a20de384fa34b79b8a629ca87932fa3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:41.845793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a20de384fa34b79b8a629ca87932fa3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:41.847743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:41.965058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:41.971222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a20de384fa34b79b8a629ca87932fa3', 'request_id': 'req-703ad2d9-93f6-467d-9d27-7eefed873847'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.083474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a20de384fa34b79b8a629ca87932fa3', 'request_id': 'req-703ad2d9-93f6-467d-9d27-7eefed873847'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.090786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a20de384fa34b79b8a629ca87932fa3', 'request_id': 'req-703ad2d9-93f6-467d-9d27-7eefed873847'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.101877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] The token cache is being invalidate because project 1a20de384fa34b79b8a629ca87932fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:42.102167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.102821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.104315 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3995/7976] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:41 2022] DELETE /identity/v3/projects/1a20de384fa34b79b8a629ca87932fa3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:42.110582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:42.110582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:42.124946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2027b-6725-41d7-8ad2-3958352ccdf6 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:42.167146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:42.183697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:42.184341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:42.184622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:42.184892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/domains/c0f6d4fd7b5d411481f1ac798e85f816` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:42.186174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c0f6d4fd7b5d411481f1ac798e85f816)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:42.187850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:42.209164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.209866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.305656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.306951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.312464 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3982/7977] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:42 2022] PATCH /identity/v3/domains/c0f6d4fd7b5d411481f1ac798e85f816 => generated 246 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:42.314489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:42.316108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:42.329233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad2d9-93f6-467d-9d27-7eefed873847 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:42.385402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6722db6261374bddb7d43e9e56c8b4bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972c9deba5942a4aa5016f14540c72a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:42.386028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:42.386308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:42.386713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] PATH_INFO: `/v3/domains/c0f6d4fd7b5d411481f1ac798e85f816` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:42.398901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c0f6d4fd7b5d411481f1ac798e85f816)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:42.400608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:42.423443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.426747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.545523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.632298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.638659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.650568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] The token cache is being invalidate because project c0f6d4fd7b5d411481f1ac798e85f816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:42.650915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.651522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.659331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.659984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.660608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c0f6d4fd7b5d411481f1ac798e85f816', 'request_id': 'req-2450a5dc-3ccf-45a8-aa66-6e23b9486eed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:42.669300 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3996/7978] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:42 2022] DELETE /identity/v3/domains/c0f6d4fd7b5d411481f1ac798e85f816 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:42.674563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:42.675995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:42.748068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5672f-2726-4a3d-824f-719ab82a1ea5 tempest-TestDefaultProjectId-1154577548 tempest-TestDefaultProjectId-1154577548-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:42.807566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:42.808206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:42.808484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:42.808799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] PATH_INFO: `/v3/users/2b435cc692dd4623b736873c866aa3af` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:42.809936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b435cc692dd4623b736873c866aa3af)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:42.811894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:43.018585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b435cc692dd4623b736873c866aa3af'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:43.019245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b435cc692dd4623b736873c866aa3af'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:43.094735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b435cc692dd4623b736873c866aa3af'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:43.097079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:43.108630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b435cc692dd4623b736873c866aa3af'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:43.109292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b435cc692dd4623b736873c866aa3af'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:43.121453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3983/7979] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:42 2022] DELETE /identity/v3/users/2b435cc692dd4623b736873c866aa3af => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:43.125994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:43.126419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:43.126685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:43.140408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:43.147012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:43.148244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:43.213326 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3997/7980] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:43.223327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:43.224750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:43.291083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676fcc-eca5-411e-bb66-e0fcd17ebbac admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:43.294910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:43.295518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:43.296983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:43.296983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:43.305482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:43.307018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:43.316684 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3984/7981] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:43.757892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:43.760211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:43.778513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcaef-394c-496b-b974-8afbf89badc2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:43.780004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:43.780719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:43.781071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:43.781434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] PATH_INFO: `/v3/projects/f30c111f8c534340a49a5da73bffdbd7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:43.782947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30c111f8c534340a49a5da73bffdbd7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:43.784994 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:43.899461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30c111f8c534340a49a5da73bffdbd7', 'request_id': 'req-3797f54d-fa24-4140-ad11-d97e9df32e7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.006829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30c111f8c534340a49a5da73bffdbd7', 'request_id': 'req-3797f54d-fa24-4140-ad11-d97e9df32e7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.013816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30c111f8c534340a49a5da73bffdbd7', 'request_id': 'req-3797f54d-fa24-4140-ad11-d97e9df32e7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.025551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] The token cache is being invalidate because project f30c111f8c534340a49a5da73bffdbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:44.025864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.026507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.028206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3998/7982] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:43 2022] DELETE /identity/v3/projects/f30c111f8c534340a49a5da73bffdbd7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:44.032517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:44.046890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd35cd-457c-4e4b-a1f9-ed95efd77c0b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:44.101297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:44.101956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:44.102231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:44.102531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] PATH_INFO: `/v3/users/6722db6261374bddb7d43e9e56c8b4bb` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:44.104248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6722db6261374bddb7d43e9e56c8b4bb)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:44.106160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:44.280396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6722db6261374bddb7d43e9e56c8b4bb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.281057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6722db6261374bddb7d43e9e56c8b4bb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.338381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6722db6261374bddb7d43e9e56c8b4bb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.353600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6722db6261374bddb7d43e9e56c8b4bb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.354251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-1328dc57-85ae-4a18-83e1-6cd2c1c033a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6722db6261374bddb7d43e9e56c8b4bb'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:44.359746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:44.366918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3985/7983] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:44 2022] DELETE /identity/v3/users/6722db6261374bddb7d43e9e56c8b4bb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:44.769793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:44.769793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:44.786266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797f54d-fa24-4140-ad11-d97e9df32e7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:44.849149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:44.849680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:44.849874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:44.850118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] PATH_INFO: `/v3/projects/5972c9deba5942a4aa5016f14540c72a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:44.851439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5972c9deba5942a4aa5016f14540c72a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:44.854067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.018175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:45.031618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5972c9deba5942a4aa5016f14540c72a', 'request_id': 'req-f75f3699-afcd-464c-a5d8-7e80f3432db7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:45.128995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5972c9deba5942a4aa5016f14540c72a', 'request_id': 'req-f75f3699-afcd-464c-a5d8-7e80f3432db7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:45.135963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5972c9deba5942a4aa5016f14540c72a', 'request_id': 'req-f75f3699-afcd-464c-a5d8-7e80f3432db7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:45.147351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] The token cache is being invalidate because project 5972c9deba5942a4aa5016f14540c72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:45.147646 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:45.148301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f75f3699-afcd-464c-a5d8-7e80f3432db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:45.150413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3999/7984] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:44 2022] DELETE /identity/v3/projects/5972c9deba5942a4aa5016f14540c72a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:45.155492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.155788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.156060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.178743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:45.180059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:45.239712 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3986/7985] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:45.248079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e06d-6cec-4217-8629-945378941673 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.248361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e06d-6cec-4217-8629-945378941673 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.248631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e06d-6cec-4217-8629-945378941673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.269244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00a1e06d-6cec-4217-8629-945378941673 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:45.270474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00a1e06d-6cec-4217-8629-945378941673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:45.278763 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4000/7986] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:45.283455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.293411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b99b71-a0b2-4a10-a87e-0f96b8fbaeff None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.299164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.299762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.300045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.300316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.300955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:45.301256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.302902 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.316404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3987/7987] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:45.321641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1e06d-6cec-4217-8629-945378941673 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.332845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1e06d-6cec-4217-8629-945378941673 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.337603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.338219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.338500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.338927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.339598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.341618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.439955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4001/7988] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:45.444209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.455764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db1c1-9eb3-431e-b0da-20bedee2ca4b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.521844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.522739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.523026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.523295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.523999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.525950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.629961 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3988/7989] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:45.634092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.644875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f049-bf81-446a-a1f3-baba0f79bd13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.649520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.650073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.650352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.650650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.651878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.653491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.663665 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4002/7990] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:45.668620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.678581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d614181-a159-4f3a-ac77-f636acd42514 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.684093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.684747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.685025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.685287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.685929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.687560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aae0b-d482-4fdb-91f2-8c6f8a9f2afc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.705344 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3989/7991] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:45.709478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.719773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef8ad4-84fa-405b-844f-569ebe4af606 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:45.724584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:45.725229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.725503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.725768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] PATH_INFO: `/v3/projects/c788e6d0ebb547c4825b55216f75c901/users/85ac734fb7b441f88fd8fbc842643c69/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.741966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c788e6d0ebb547c4825b55216f75c901, user_id=85ac734fb7b441f88fd8fbc842643c69, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:45.745385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:45.810192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4003/7992] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:45 2022] PUT /identity/v3/projects/c788e6d0ebb547c4825b55216f75c901/users/85ac734fb7b441f88fd8fbc842643c69/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:45.821135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:45.821422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:45.821732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:45.857394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] MFA Rules not processed for user `85ac734fb7b441f88fd8fbc842643c69`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:45.858608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:45.905772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:45.924423 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3990/7993] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:45.928945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:45.993267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc9fdb-fa12-4228-bc09-5696d49136cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.000186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.000186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.000186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.000186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.000642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.001812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.108712 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4004/7994] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:45 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:46.112824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.123596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e25d-797e-45fa-828a-724d8da444db None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.183710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.184380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.184663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.184941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.185572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.187543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.271307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3991/7995] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:46 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:46.275255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.285961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd9f46-fd63-4433-b150-85e63d9b4575 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.291262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.291859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.292141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.292413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.293047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.294701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.305263 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4005/7996] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:46.309450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.320107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0485c5-2204-420e-9c2c-454bbe12c8cb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.324832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.325481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.325761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.326035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] PATH_INFO: `/v3/projects/ed23a98f5b40454c959e4202eebbaa4d/users/7a5faa54624045bc9c282d5e2e692416/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.342093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed23a98f5b40454c959e4202eebbaa4d, user_id=7a5faa54624045bc9c282d5e2e692416, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.344805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.441395 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3992/7997] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:46 2022] PUT /identity/v3/projects/ed23a98f5b40454c959e4202eebbaa4d/users/7a5faa54624045bc9c282d5e2e692416/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:46.445480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.456369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e762ce-a867-4b9d-94ea-680ed4cfeb68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.486075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:46.513780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.514390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.514725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.515637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.516440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.518191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061adfe-60d4-464c-b028-80d9bb74772f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.533469 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4006/7998] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:46.534784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.545466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e391bec-1970-4da7-ab03-a559667c1fa5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.550187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.550860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.551141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.551415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] PATH_INFO: `/v3/projects/ed23a98f5b40454c959e4202eebbaa4d/users/7a5faa54624045bc9c282d5e2e692416/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.553439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed23a98f5b40454c959e4202eebbaa4d, user_id=7a5faa54624045bc9c282d5e2e692416, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.556244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.566743 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3993/7999] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:46 2022] PUT /identity/v3/projects/ed23a98f5b40454c959e4202eebbaa4d/users/7a5faa54624045bc9c282d5e2e692416/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:46.577466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.577752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.578029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.608382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] MFA Rules not processed for user `7a5faa54624045bc9c282d5e2e692416`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:46.609640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:46.679703 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4007/8000] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:46.684731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.701330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91ae8-2a4f-4708-b7be-229bb089b93a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.711456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.712159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.712987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.713257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.713956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.715694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:46.814721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3994/8001] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 15:05:46 2022] POST /identity/v3/domains => generated 276 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:46.815827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:46.826108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818db28-acb5-429f-8755-73ef81ebe6d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:46.890178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:46.890901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:46.891184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:46.891460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:46.892148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:46.893145 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:46.893145 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 15:05:46.893145 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 15:05:46.894026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.015269 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4008/8002] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 15:05:46 2022] PUT /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config => generated 138 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:47.018682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.029138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a290f5-67c1-40d6-b7f1-44155d702710 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.036342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.036920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.037207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.037499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.038715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02, group=identity)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.039799 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:47.039799 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 15:05:47.039799 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 15:05:47.040712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.048009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3995/8003] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Oct 31 15:05:47 2022] GET /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/identity => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:47.052417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.069652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b09ce-265a-4667-a83c-9de985b5bc57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.075199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.075869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.076170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.076426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/identity/driver` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.077589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02, group=identity, option=driver)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.078606 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:47.078606 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 15:05:47.078606 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 15:05:47.079534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.090059 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4009/8004] 10.222.0.13 () {58 vars in 1296 bytes} [Mon Oct 31 15:05:47 2022] GET /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/identity/driver => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:47.091690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.104066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e776a0-42b4-4d93-8ec9-19e061af49d0 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.109314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.109965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.110248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.110525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.111744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02, group=ldap)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.113356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.120091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3996/8005] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 15:05:47 2022] GET /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap => generated 106 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:47.124357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.135224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df8c1b-4f07-4d2f-9c1b-0d0867f87603 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.139976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.140672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.140918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.141224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap/url` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.142757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02, group=ldap, option=url)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.143963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.150536 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4010/8006] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Oct 31 15:05:47 2022] GET /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap/url => generated 46 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:47.159933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.171056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6581-06e0-42a7-bc73-e1ea05954830 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.175809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.176547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.176834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.177112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap/user_tree_dn` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.178262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02, group=ldap, option=user_tree_dn)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.179926 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.187399 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3997/8007] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Oct 31 15:05:47 2022] GET /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config/ldap/user_tree_dn => generated 63 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:47.191614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.202530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa006-c758-4ed6-a06e-c040051b2264 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.208127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.208767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.209054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.209334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.209922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3ea353aa5f8f494eba13966a85b18c02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.210971 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:47.210971 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 15:05:47.210971 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 15:05:47.211949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.214050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:47.301105 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4011/8008] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:47 2022] DELETE /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02/config => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:47.305450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.321443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faaabc-a134-43a5-8c65-4985f9c950fe tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.326574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.327462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.327845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.328133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.329432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3ea353aa5f8f494eba13966a85b18c02)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.331131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.355200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.355915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.454856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.455740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.461225 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3998/8009] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:47 2022] PATCH /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02 => generated 277 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:47.463176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.464941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:47.478815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bfc55-b44e-4139-b165-4fb80c494617 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.539335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.539980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.540945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.541246 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.553295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3ea353aa5f8f494eba13966a85b18c02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.554912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:47.578978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.582380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.698414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.780321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.787318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.800446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] The token cache is being invalidate because project 3ea353aa5f8f494eba13966a85b18c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:47.800737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.801401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.810228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.811019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.811926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3ea353aa5f8f494eba13966a85b18c02', 'request_id': 'req-a3c7cd45-f31e-475a-9d0f-7339720f6b10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:47.822239 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4012/8010] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:47 2022] DELETE /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:47.827605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:47.839179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d537f1-5f8f-4e40-833b-11f28e577dc8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:47.860685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:47.899329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:47.900523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:47.900810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:47.901078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:47.901745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:47.903398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.037469 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 3999/8011] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 15:05:47 2022] POST /identity/v3/domains => generated 277 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:48.041655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.043155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:48.056801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7cd45-f31e-475a-9d0f-7339720f6b10 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.090709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:48.117222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.117878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.118169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.119064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.119746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.121342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.225708 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4013/8012] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 15:05:48 2022] PUT /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 138 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:48.227463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.238386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dedb3-12d6-4cb8-8eb3-16cee505dc92 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.244252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.245039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.245328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.245608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.246290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.247383 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:48.247383 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 15:05:48.247383 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 15:05:48.248280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.335024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4000/8013] 10.222.0.13 () {60 vars in 1271 bytes} [Mon Oct 31 15:05:48 2022] PATCH /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 142 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:48.340468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.350864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389203b1-7654-41e4-be61-a96bd4061c5f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.355589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.356317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.356696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.357047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.358244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.359967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.364858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4014/8014] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:48 2022] GET /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 142 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:48.369550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.380200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc2c6-597b-4ac4-9348-4f74e5a129ac tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.385635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.386271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.386551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.386851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.387440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.388572 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:48.388572 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 15:05:48.388572 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 15:05:48.389459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.475880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4001/8015] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:48 2022] DELETE /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:48.480099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.490570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd75c-7534-446f-9663-438dc8f730b7 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.496169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.496811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.497093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.497366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.498521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.500151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find any options in domain configuration for domain 8f0b8b26803f467988fb4ba32836068f.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 8f0b8b26803f467988fb4ba32836068f. Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:48.509874 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 8f0b8b26803f467988fb4ba32836068f. Oct 31 15:05:48.510837 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:48.511294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4015/8016] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:48 2022] GET /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 151 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:48.515544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.525847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89fc84-7036-40f3-9af1-ee34f790fd29 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.530542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.531199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.531480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.532022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f/config` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.532600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.534200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.540260 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4002/8017] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:48 2022] DELETE /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f/config => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:48.544474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.555028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7b126-c15d-4618-8d44-da8ac3ed705b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.560296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.560928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.561209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.561488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.562769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.564383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.587906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.588666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.691832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.692455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.698042 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4016/8018] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:48 2022] PATCH /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f => generated 278 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:05:48.699432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:48.701182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:48.717426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898df800-ec4f-43f2-b506-e56fd466a34b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:48.775785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:48.776427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:48.776704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:48.776972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:48.788393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8f0b8b26803f467988fb4ba32836068f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:48.790559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:48.814198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.817677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8f0b8b26803f467988fb4ba32836068f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:48.912818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:48.925445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.003385 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.009877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.021877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] The token cache is being invalidate because project 8f0b8b26803f467988fb4ba32836068f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:49.022166 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.022920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.032275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.032948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.033595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8f0b8b26803f467988fb4ba32836068f', 'request_id': 'req-4e7c91ae-d06c-49e5-b965-3b17950842cf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:49.042597 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4003/8019] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:48 2022] DELETE /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:49.048042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.058572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5a25-abe8-4aec-be29-4ff483ae6629 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.116854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.117465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.117748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.118024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.118711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.120309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.186025 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4017/8020] 10.222.0.13 () {60 vars in 1149 bytes} [Mon Oct 31 15:05:49 2022] POST /identity/v3/domains => generated 277 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:49.190376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.191945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:49.205344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c91ae-d06c-49e5-b965-3b17950842cf tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.279071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.279815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.280163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.280506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.281255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.282597 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:49.282597 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 15:05:49.282597 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 15:05:49.283658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.377819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4004/8021] 10.222.0.13 () {60 vars in 1269 bytes} [Mon Oct 31 15:05:49 2022] PUT /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config => generated 138 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:49.382232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.393851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfa2e-f762-42df-9095-1143ed65b258 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.398728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.399416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.400285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.400566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.401257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.402321 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:49.402321 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 15:05:49.402321 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 15:05:49.403248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.492371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4018/8022] 10.222.0.13 () {60 vars in 1297 bytes} [Mon Oct 31 15:05:49 2022] PATCH /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity => generated 175 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:49.496508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.506934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53461a-b94e-45c1-bd01-697da9bea07d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.512099 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.514558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.514558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.514558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.514558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity, option=driver)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.515709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.610544 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4005/8023] 10.222.0.13 () {60 vars in 1318 bytes} [Mon Oct 31 15:05:49 2022] PATCH /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver => generated 175 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:05:49.612307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.622998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a5c00-2c7d-4594-bc38-8429021634e6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.627614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.628305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.628592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.628875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.629499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity, option=driver)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.631139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.632979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:49.707595 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4019/8024] 10.222.0.13 () {58 vars in 1299 bytes} [Mon Oct 31 15:05:49 2022] DELETE /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:49.713354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.733493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8fbd6-57b4-4f24-a23b-8c45d2fb22bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.740117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.740865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.741142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.741374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.742570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity, option=driver)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.744885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find option driver in group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:49.754392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:49.758007 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4006/8025] 10.222.0.13 () {58 vars in 1296 bytes} [Mon Oct 31 15:05:49 2022] GET /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity/driver => generated 171 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 15:05:49.760877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.770829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fa3c-aa07-461b-980d-91b5de67a1da tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.776092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.776721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.777003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.777393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.777984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.779611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.872295 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4020/8026] 10.222.0.13 () {58 vars in 1278 bytes} [Mon Oct 31 15:05:49 2022] DELETE /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:49.876513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.887988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b0336-24de-469c-96bc-2d935d5fc24a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.892640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.893295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.893574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.893844 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.895074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0, group=identity)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.896711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:49.906194 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:49.907403 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:49.907890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4007/8027] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Oct 31 15:05:49 2022] GET /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config/identity => generated 154 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:49.912315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:49.923491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387b2c-66e4-4884-9d65-6c871010c3b3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:49.928585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:49.929232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:49.929652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:49.929936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:49.930522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:49.932676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.003977 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4021/8028] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:49 2022] DELETE /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0/config => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:50.008350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.019286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b7143-08a8-4bb9-adb6-664d6503dced tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.024058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.024676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.024964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.025240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.026504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.028151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.049413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.050124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.057110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:50.125432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.126069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.128501 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4008/8029] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:50 2022] PATCH /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0 => generated 278 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:50.132749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.134494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:50.147755 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4628f69-49bf-4570-9a3d-d9cfe9b8d10d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.205635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.206230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.206511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.206821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.218000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=94dd9ae495fd4b05a6baf5c7e8376fb0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.219980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.243692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.246949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.356639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.435186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.441898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.454330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] The token cache is being invalidate because project 94dd9ae495fd4b05a6baf5c7e8376fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:50.454671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.455354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.463881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.464588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.465212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '94dd9ae495fd4b05a6baf5c7e8376fb0', 'request_id': 'req-ae121132-760d-4ac2-891c-7a41791ba999'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:50.466701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:50.474243 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4022/8030] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:50 2022] DELETE /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:50.480165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.490333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ff0-de6c-4f26-8fe3-e6514858794e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.549292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.549806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.550122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.550450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.555264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.559349 n-d-863055-2 devstack@keystone.service[82163]: WARNING py.warnings [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:50.559349 n-d-863055-2 devstack@keystone.service[82163]: warnings.warn(msg) Oct 31 15:05:50.559349 n-d-863055-2 devstack@keystone.service[82163]: Oct 31 15:05:50.559349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.569434 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4009/8031] 10.222.0.13 () {58 vars in 1173 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:50.570578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.572253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:50.596709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121132-760d-4ac2-891c-7a41791ba999 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.604204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.606827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.606827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.606827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.606827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.608161 n-d-863055-2 devstack@keystone.service[82161]: WARNING py.warnings [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:50.608161 n-d-863055-2 devstack@keystone.service[82161]: warnings.warn(msg) Oct 31 15:05:50.608161 n-d-863055-2 devstack@keystone.service[82161]: Oct 31 15:05:50.608681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.613585 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4023/8032] 10.222.0.13 () {58 vars in 1200 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.614806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.632797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191281-98e0-46d5-b359-0dbfa40172ed tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.637647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.638291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.638584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.638886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.639470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.641053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.642226 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4010/8033] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.646390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.658087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f799-8f87-46f3-93a8-e1948e46ec17 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.662801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.663416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.663943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.664380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.664875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.667195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.668276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4024/8034] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.672242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.682481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d12fa3-3079-4334-a0d7-53411efe1f41 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.688086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.688242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.688428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.688699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.692598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.692598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.692757 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4011/8035] 10.222.0.13 () {58 vars in 1188 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:50.696703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.715201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432c28f-80f7-486c-8b73-e85220997703 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.721291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.722089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.722475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.722988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.723696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.725609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.728357 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4025/8036] 10.222.0.13 () {58 vars in 1200 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.732259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.743208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ac92c-961e-4f56-bd3c-c66efde07fa8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.748169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.748825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.749102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.749372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.750001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.751703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.754662 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4012/8037] 10.222.0.13 () {58 vars in 1203 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.757134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.767678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee028f7-c8c7-4c27-a306-d35716520556 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.772935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.773558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.773836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.774158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.775427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.777201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.778574 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4026/8038] 10.222.0.13 () {58 vars in 1209 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:50.782846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.794027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777be36-6187-4f1e-b2b2-7b11eb54834f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.798743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.801800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.801800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.801800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.801800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.802228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.803356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4013/8039] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.807332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.818004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f78b-184b-40f0-a3c2-3b72ed870f3c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.823805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.824551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.825000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.825345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.826017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.827784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.829140 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4027/8040] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.833470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.846085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ad29-ba12-4630-8a1e-10141cc7369b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.851539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.852197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.853085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.853362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.857121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.857121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.857121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4014/8041] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.861204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.872397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172197f-a9a9-4594-b691-bc15b2757d47 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.877550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.878508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.879072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.879435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.880270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.882005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.883525 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4028/8042] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:50.891131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.903072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b4b1-a58e-4deb-b1fa-177a5a1def79 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.908296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.908949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.911238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.911238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.911238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.912057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.913311 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4015/8043] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.917602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.928723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38009809-2cef-4c1a-9f07-56073a721680 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.934380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.935081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.935368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.935713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.936259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.937892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.939209 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4029/8044] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:50.943227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.954776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d0f5-f52a-4e44-bd46-6f298058f2f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.960118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.960878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.961236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.961585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.963091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.964790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.966146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4016/8045] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:50.970247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:50.981085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0d222-35a9-45a6-892d-d2e364285ea5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:50.986023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:50.986769 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:50.987150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:50.987496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:50.988150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:50.989811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:50.994054 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4030/8046] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:50.995702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.006828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2976ce-f55f-42b2-9e34-cd344e377dd3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.012214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.012862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.013181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.013575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.014169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.015837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.016940 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4017/8047] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 15:05:50 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.020916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.032395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509188-e1cf-43ce-b452-394384de9541 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.037368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.038017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.038301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.038580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.039259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.040899 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.042266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4031/8048] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.046117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.056993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833562-d5ea-4b83-a115-6026ad3a99d1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.061942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.062769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.063151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.063532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.064276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.065995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.070113 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4018/8049] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.072762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.083907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cd2f-c759-41d3-8626-8df5b111240a tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.089803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.090550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.090900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.091182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.091903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.093619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.097746 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4032/8050] 10.222.0.13 () {58 vars in 1269 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.099111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.109917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425295-30ee-4266-8dbd-041502e40052 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.115467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.116218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.116605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.116985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.117677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.119531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.122670 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4019/8051] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.124722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.137379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a755a7-b7d8-461e-b4b4-ef5e58852342 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.142121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.142834 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.143120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.143399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.144111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.145830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.147203 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4033/8052] 10.222.0.13 () {58 vars in 1257 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.151590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.162818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61461d8-b444-4d69-b584-47878a1a75f3 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.167782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.168526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.168946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.169345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.170037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.171789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.175739 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4020/8053] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.177186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.187955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf346-616c-441a-8125-0da180bd4ef6 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.192897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.193551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.193835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.194114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.194770 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.196996 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.201233 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4034/8054] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.202248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.213212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8525-78b2-4adc-921a-19a5ed28668c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.217927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.218577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.218919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.219221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.219812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.221413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.225381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4021/8055] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.226753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.237369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff427422-4ebc-4efe-aa0b-4bb9ac646cba tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.242001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.242889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.243715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.243995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.244581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.246159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.247442 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4035/8056] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.251409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.263443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbfc96-2087-4238-81ec-f5a798e6d848 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.268458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.269211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.269645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.270025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.270814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.272525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.273721 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4022/8057] 10.222.0.13 () {58 vars in 1290 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.278002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.288732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb24d9-cec9-4a78-89d5-48155068e403 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.293436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.294081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.294367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.294697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.295291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.296881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.298057 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4036/8058] 10.222.0.13 () {58 vars in 1257 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.302069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.312986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241037-b23b-4556-91c5-eda307e06f3b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.317582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.318230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.318514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.318818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.319407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.321014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.325459 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4023/8059] 10.222.0.13 () {58 vars in 1266 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.326791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.337244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aba51-fc8b-4fa6-87b3-5fa6cc983c0e tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.342047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.342850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.343242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.343616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.344326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.346138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.347502 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4037/8060] 10.222.0.13 () {58 vars in 1308 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.351694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.362759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bcf38-0282-495d-a909-92dd2325f2d2 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.367530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.368848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.369245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.369707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.370331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.372098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.376190 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4024/8061] 10.222.0.13 () {58 vars in 1290 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.377391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.391091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d612-2dcc-407b-afd9-81cbb507b359 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.395953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.396614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.396901 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.397181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.397779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.399559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.400765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4038/8062] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.404706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.415464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3a9b-840f-4c2f-95d4-e316d634defc tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.420334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.421001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.421285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.421562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.422160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.423909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.425322 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4025/8063] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.429577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.442562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb59f-8db9-40e8-bdd6-7d7a13454715 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.448817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.449735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.450164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.450642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.451447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.453284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.455088 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4039/8064] 10.222.0.13 () {58 vars in 1242 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.459126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.470230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215e72-39a3-41be-ab89-c6753f9e5b32 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.475407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.476082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.476362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.476636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.477236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.479010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.483883 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4026/8065] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.486374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.496965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c77af-7dfb-435f-bf49-f6f36079406d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.501878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.503431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.503710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.503987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.505538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.507400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.512082 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4040/8066] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.513261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.525317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0288dc-ccca-4eeb-bc8b-b0ce5924e209 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.530134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.531236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.538180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.538180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.538180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.538180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.538180 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4027/8067] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.540924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.551930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac93a-6cde-4561-9975-f10f04c32f04 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.557206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.557852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.558129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.558428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.559060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.560633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.561968 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4041/8068] 10.222.0.13 () {58 vars in 1257 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.587626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.598052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa933-f749-4436-b59d-48304aa1e40d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.603613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.604256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.604540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.604820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.605410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.607076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.610775 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4028/8069] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.612314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.623735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bd18-2968-432a-b599-bcffec9020bd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.630271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.631103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.631483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.631869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.632588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.634654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.636445 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4042/8070] 10.222.0.13 () {58 vars in 1257 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.640041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.652332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d0bf-ca0f-4ab7-8dc3-5e1b3ae5c863 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.657661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.658369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.658827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.659115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.659715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.661306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.666667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4029/8071] 10.222.0.13 () {58 vars in 1293 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.667586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.686775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c90737-780b-4bb1-9bd2-30bae5be4c8b tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.686775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.686775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.687048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.687048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.687048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.687410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.690656 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4043/8072] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.692638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.703616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b9db0-a05a-498c-8359-19f8f5c01fe1 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.708912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.709561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.709839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.710111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.710755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.712393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.713664 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4030/8073] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.723884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.735266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca847ae-5c1f-42f0-9140-31be713cbf03 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.740187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.740860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.741138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.741448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.741983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.744146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.745882 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4044/8074] 10.222.0.13 () {58 vars in 1212 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.749742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.760049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5298351-1611-43ea-b13b-2a3e1377ad33 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.764689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.765323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.765607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.765884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.766468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.768140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.769233 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4031/8075] 10.222.0.13 () {58 vars in 1227 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.773180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.783689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eba89-fc82-422c-9bc5-ddd000d422f8 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.788400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.789027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.789306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.789576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.790773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.792338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.796063 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4045/8076] 10.222.0.13 () {58 vars in 1215 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.797177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.808003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18ba5b-bfdb-4ff3-bb75-84c09a07b8b5 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.812646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.813278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.813562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.813838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.814418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.816062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.817165 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4032/8077] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.820968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.831307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24ac5-c9e3-4101-a4c5-2280ecc01053 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.836120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.836767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.837051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.837329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.837960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.839558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.840732 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4046/8078] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.844588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.855165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e142-8f47-40c0-ae44-bd39d070b244 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.859803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.860437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.860719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.860997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.861582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.863201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.864422 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4033/8079] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.868719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.878866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc63f2-938b-43ca-8e7e-52a6f9ae82cd tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.883580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.886777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.886777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.886777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.886777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.887079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.890858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4047/8080] 10.222.0.13 () {58 vars in 1260 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 31 15:05:51.892153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.902352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baedc0d-e00c-484e-8172-3e1d1f426b4c tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.907464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.908058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.908320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.908596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.909182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.910802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.911879 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4034/8081] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.916255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.926992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef92a9-be3d-43c2-8542-e76d1549ee31 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.932645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.933422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.933808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.934154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.934881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.936590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.940537 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4048/8082] 10.222.0.13 () {58 vars in 1230 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.941663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.951869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afbb3c-8e7b-45d2-9155-6abf0f9eccf4 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.957685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.958326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.958610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.958923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.959506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.961139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.962780 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4035/8083] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.966495 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:51.976546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b909-2d44-402e-abd4-cea6883fa47d tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:51.982099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:51.982865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:51.983231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:51.983577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:51.984237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:51.985895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:51.987189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4049/8084] 10.222.0.13 () {58 vars in 1278 bytes} [Mon Oct 31 15:05:51 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 31 15:05:51.993485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:52.003723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5133-f796-4052-ac93-320358af4a91 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:52.008387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:52.009020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.009303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.009573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.016498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find domain: 94dd9ae495fd4b05a6baf5c7e8376fb0.: keystone.exception.DomainNotFound: Could not find domain: 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:52.021415 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:52.022429 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 15:05:52.027001 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 94dd9ae495fd4b05a6baf5c7e8376fb0. Oct 31 15:05:52.028087 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.028087 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4036/8085] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:51 2022] PATCH /identity/v3/domains/94dd9ae495fd4b05a6baf5c7e8376fb0 => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 31 15:05:52.028240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:52.037627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585152f6-ea5b-47e8-8515-78bf1f7cf09f tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:52.042946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:52.043611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.043894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.044172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/8f0b8b26803f467988fb4ba32836068f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.051939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find domain: 8f0b8b26803f467988fb4ba32836068f.: keystone.exception.DomainNotFound: Could not find domain: 8f0b8b26803f467988fb4ba32836068f. Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8f0b8b26803f467988fb4ba32836068f. Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:52.057191 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:52.058219 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 15:05:52.059263 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8f0b8b26803f467988fb4ba32836068f. Oct 31 15:05:52.060322 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:52.060322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4050/8086] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:52 2022] PATCH /identity/v3/domains/8f0b8b26803f467988fb4ba32836068f => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:52.063318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:52.073869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e48cc-36c8-4fa5-bcc1-a4fb69a1e241 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:52.078831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a5faa54624045bc9c282d5e2e692416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed23a98f5b40454c959e4202eebbaa4d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:52.079480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.079762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.080047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] PATH_INFO: `/v3/domains/3ea353aa5f8f494eba13966a85b18c02` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.088287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-961f1085-529e-4443-be06-8dfdf4174e57 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Could not find domain: 3ea353aa5f8f494eba13966a85b18c02.: keystone.exception.DomainNotFound: Could not find domain: 3ea353aa5f8f494eba13966a85b18c02. Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ea353aa5f8f494eba13966a85b18c02. Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:52.093339 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:52.094368 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application with Lock( Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._enter() Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.creator() Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application created_value = creator( Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 15:05:52.095392 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ea353aa5f8f494eba13966a85b18c02. Oct 31 15:05:52.096518 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:52.097091 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4037/8087] 10.222.0.13 () {60 vars in 1249 bytes} [Mon Oct 31 15:05:52 2022] PATCH /identity/v3/domains/3ea353aa5f8f494eba13966a85b18c02 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:52.098847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:52.101536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:52.169203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a68-69e0-473e-9550-204d16b43401 tempest-DomainConfigurationTestJSON-1682817429 tempest-DomainConfigurationTestJSON-1682817429-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:52.173885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:52.174506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.174806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.175079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] PATH_INFO: `/v3/users/85ac734fb7b441f88fd8fbc842643c69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.176203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ac734fb7b441f88fd8fbc842643c69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:52.178307 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:52.273877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.358768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ac734fb7b441f88fd8fbc842643c69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:52.359397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ac734fb7b441f88fd8fbc842643c69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:52.458849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ac734fb7b441f88fd8fbc842643c69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:52.472298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ac734fb7b441f88fd8fbc842643c69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:52.473115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ac734fb7b441f88fd8fbc842643c69'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:52.486064 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4051/8088] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:52 2022] DELETE /identity/v3/users/85ac734fb7b441f88fd8fbc842643c69 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:52.490497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.491016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.491107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.511203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:52.512408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:52.524514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:52.574027 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4038/8089] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:52.584015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:52.585442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:52.647186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629062-f940-499e-84b5-1b13154f7765 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:52.651058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:52.651673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:52.651947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:52.652374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:52.662803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:52.664254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:52.675171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4052/8090] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:05:53.116179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:53.117720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:53.130138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52fe34-9d3b-4885-a4d5-595105077a1a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:53.135723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:53.136445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:53.136847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:53.137292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] PATH_INFO: `/v3/projects/c788e6d0ebb547c4825b55216f75c901` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:53.138570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c788e6d0ebb547c4825b55216f75c901)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:53.140730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:53.261802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c788e6d0ebb547c4825b55216f75c901', 'request_id': 'req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.328869 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c788e6d0ebb547c4825b55216f75c901', 'request_id': 'req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.336051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c788e6d0ebb547c4825b55216f75c901', 'request_id': 'req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.349194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] The token cache is being invalidate because project c788e6d0ebb547c4825b55216f75c901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:53.349591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.350417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.352019 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4039/8091] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:53 2022] DELETE /identity/v3/projects/c788e6d0ebb547c4825b55216f75c901 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:53.356240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:53.366652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce17d63-886c-4529-b7c9-5a4b0f503ccb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:53.426334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:53.427005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:53.427288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:53.427566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] PATH_INFO: `/v3/users/7a5faa54624045bc9c282d5e2e692416` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:53.428744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5faa54624045bc9c282d5e2e692416)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:53.430708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:53.626589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5faa54624045bc9c282d5e2e692416'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.627298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5faa54624045bc9c282d5e2e692416'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.629902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:53.737985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5faa54624045bc9c282d5e2e692416'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.753210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5faa54624045bc9c282d5e2e692416'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.753911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5faa54624045bc9c282d5e2e692416'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:53.778241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4053/8092] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:53 2022] DELETE /identity/v3/users/7a5faa54624045bc9c282d5e2e692416 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:53.801582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:53.803169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:53.818461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085165e-5008-4995-ab7f-2c3c4aa0b0d6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:53.893763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:53.894558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:53.894919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:53.895202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] PATH_INFO: `/v3/users/50c50e7204f849468895977db1d2856f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:53.896376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c50e7204f849468895977db1d2856f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:53.898317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:54.168267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:54.170883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c50e7204f849468895977db1d2856f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.171599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c50e7204f849468895977db1d2856f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.244352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.245910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.260597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f28f8-cff5-40fd-91e7-b53f535d67be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:54.267165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c50e7204f849468895977db1d2856f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.270178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:54.270884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.271170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.271448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] PATH_INFO: `/v3/projects/ed23a98f5b40454c959e4202eebbaa4d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.273556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed23a98f5b40454c959e4202eebbaa4d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:54.276511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:54.299588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c50e7204f849468895977db1d2856f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.300340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb9e61f0-524f-409f-b4ff-bfa8d58d7b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c50e7204f849468895977db1d2856f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.317002 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4040/8093] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:53 2022] DELETE /identity/v3/users/50c50e7204f849468895977db1d2856f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:54.321550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.321829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.322102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.342499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:54.343798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.396298 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed23a98f5b40454c959e4202eebbaa4d', 'request_id': 'req-2cd58bc1-49b4-441d-bbca-0661f424a5a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.419433 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4041/8094] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:54.430581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.433107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.491429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b98dd-8729-4faa-99a1-5995105781a7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:54.499902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed23a98f5b40454c959e4202eebbaa4d', 'request_id': 'req-2cd58bc1-49b4-441d-bbca-0661f424a5a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.507808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed23a98f5b40454c959e4202eebbaa4d', 'request_id': 'req-2cd58bc1-49b4-441d-bbca-0661f424a5a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.521808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] The token cache is being invalidate because project ed23a98f5b40454c959e4202eebbaa4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:54.522097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.522913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd58bc1-49b4-441d-bbca-0661f424a5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:54.528610 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4054/8095] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:54 2022] DELETE /identity/v3/projects/ed23a98f5b40454c959e4202eebbaa4d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:54.529897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8ff4-ac9f-4d5e-845b-b4060f28cf81 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.530184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8ff4-ac9f-4d5e-845b-b4060f28cf81 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.530459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8ff4-ac9f-4d5e-845b-b4060f28cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.549011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:54.550034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.550321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.550599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.552549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.555926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1efb8ff4-ac9f-4d5e-845b-b4060f28cf81 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:54.557269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1efb8ff4-ac9f-4d5e-845b-b4060f28cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.586130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:54.625165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:54.627039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:54.628831 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4055/8096] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:54.638541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.638854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.639130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.642518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4042/8097] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:05:54.662925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:54.664317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.673411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4056/8098] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:54.677683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.687813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03805-e4d2-47e3-97b8-d7752f10fe67 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:54.697383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:54.698071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.698359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.701016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.701016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:54.701016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:54.701530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:54.725810 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4043/8099] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:54.730522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.740556 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11646-36e8-4684-be71-6cf81b9800f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:54.745632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:54.746235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.747758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.747758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.748314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:54.750206 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:54.891437 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4057/8100] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:54 2022] POST /identity/v3/projects => generated 395 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:54.895726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.906977 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4316ec-13b1-47ec-9bea-3c2706d6a717 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:54.923016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:54.925006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:54.963987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:54.969715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:54.970333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:54.970657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:54.970918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:54.972595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:54.973530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.004606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde93c0-6c0e-4a0f-9291-d73551e86023 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.010438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.011100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.011379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.011647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] PATH_INFO: `/v3/projects/cb61fbaac6734eefa8ae55116930eeae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.012784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb61fbaac6734eefa8ae55116930eeae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.014714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.115657 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4044/8101] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:54 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:55.120162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.130259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b1f29-36ef-44c0-b8b1-abbaab16b2a3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.135436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.136020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.136300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.136572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.137203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.138846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.149381 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4045/8102] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:55.153125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.164399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3b64-a5a0-4716-9263-ab4bdd81bf2d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.174421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb61fbaac6734eefa8ae55116930eeae', 'request_id': 'req-7ab873e7-f1f6-4438-bd7b-e4af5983e168'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:55.223189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.223750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.224032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.224308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.224947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.226573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.236705 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4046/8103] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:55.240792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.250966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409aa9-e64e-47f4-afa0-c868d3d26ba3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.252057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb61fbaac6734eefa8ae55116930eeae', 'request_id': 'req-7ab873e7-f1f6-4438-bd7b-e4af5983e168'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:55.255660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.256286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.256562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.256832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] PATH_INFO: `/v3/projects/6ec192d8bd544c38a49759f90c6b3d41/users/ba1cfbfc4ce747519bee1af555e1d698/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.258301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb61fbaac6734eefa8ae55116930eeae', 'request_id': 'req-7ab873e7-f1f6-4438-bd7b-e4af5983e168'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:55.270841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] The token cache is being invalidate because project cb61fbaac6734eefa8ae55116930eeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:55.271122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:55.271840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ab873e7-f1f6-4438-bd7b-e4af5983e168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:55.272800 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec192d8bd544c38a49759f90c6b3d41, user_id=ba1cfbfc4ce747519bee1af555e1d698, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.273756 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4058/8104] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:54 2022] DELETE /identity/v3/projects/cb61fbaac6734eefa8ae55116930eeae => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:55.276788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8560d4-a2ea-4579-8561-126f27373cd2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.278106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f5f1-edd4-482b-8e93-738e7b620370 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.278393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f5f1-edd4-482b-8e93-738e7b620370 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.278695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f5f1-edd4-482b-8e93-738e7b620370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.298175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6b2f5f1-edd4-482b-8e93-738e7b620370 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:55.299412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6b2f5f1-edd4-482b-8e93-738e7b620370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:55.307843 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4059/8105] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:55.315558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.315843 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.316120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.336679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:55.337864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:55.340497 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4047/8106] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:55 2022] PUT /identity/v3/projects/6ec192d8bd544c38a49759f90c6b3d41/users/ba1cfbfc4ce747519bee1af555e1d698/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:55.350760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.351041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.351472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.359867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:55.381086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] MFA Rules not processed for user `ba1cfbfc4ce747519bee1af555e1d698`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:55.383238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:55.402266 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4060/8107] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:55.406521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.416490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79753184-da32-4ffc-8f7c-391413d921d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.421287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.421891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.422201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.422475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.423157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:55.423468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.425894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.438725 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4061/8108] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:05:55.443203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.453234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c66eb-5964-473c-a0f9-55d4592ca6aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.458103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.458802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.459084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.459357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.459980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.461147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4048/8109] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:55.462122 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.464019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.464136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:55.478767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd6f2-a77b-4c54-8dfa-aa3274dadba0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.483645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.484326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.484543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.484818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.485448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.487519 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.599058 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4062/8110] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/projects => generated 397 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:55.603873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.616768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:55.630599 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4049/8111] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/projects => generated 395 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:55.631889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.676723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7615-075b-45b4-8bde-79dd0809b260 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.706802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd93b-50d1-4499-844f-e4f30dd1eea8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.712127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.712744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.713023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.713290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.713919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.715877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.742009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.742544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.742894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.743164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.743778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.745709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.816177 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4050/8112] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/users => generated 304 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:55.820274 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.832239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062deae-a644-4d6c-a079-60bf59e69945 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.838378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.844053 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4063/8113] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:55 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:05:55.844205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.844205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.844205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.844205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.844205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.845585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.854784 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4051/8114] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:55.856629 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0b6a-e26e-4206-b32d-083ecc561c85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.858910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.861820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.862422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.862727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.863001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.863633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.865227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.869035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e34b8-f27a-43c0-a13e-746058a51046 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.873922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.874880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.875167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.875445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] PATH_INFO: `/v3/projects/edc4204ed2014956934be096795429d1/users/8b7eb542257e495b819998485aaa79da/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.878709 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4064/8115] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:55.879427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.889182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfc981-60e7-4999-b7a9-2c7c4db99ec4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.902657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.902657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.902657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.902657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.903163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.903163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.909420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc4204ed2014956934be096795429d1, user_id=8b7eb542257e495b819998485aaa79da, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.914547 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4065/8116] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:55.916168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:55.919475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:55.927304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777dbe9-40e1-46bb-9e1a-f30ac95e9f0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:55.932011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:55.932722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:55.933009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:55.933207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] PATH_INFO: `/v3/projects/b15a7c8dc2d345428f291214bd26c028/users/17a07e6817214f0ba80b38e6d12200ee/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:55.948140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15a7c8dc2d345428f291214bd26c028, user_id=17a07e6817214f0ba80b38e6d12200ee, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:55.950850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2660d9e-1e7e-44f4-ae08-de1242e05177 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.064645 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4052/8117] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:55 2022] PUT /identity/v3/projects/edc4204ed2014956934be096795429d1/users/8b7eb542257e495b819998485aaa79da/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:56.068751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.090814 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4066/8118] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:55 2022] PUT /identity/v3/projects/b15a7c8dc2d345428f291214bd26c028/users/17a07e6817214f0ba80b38e6d12200ee/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:56.109056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.109429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.109775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.112165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:56.140162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] MFA Rules not processed for user `17a07e6817214f0ba80b38e6d12200ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:56.141390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:56.147298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e845e92-a984-495e-922d-69c23f54214c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.196642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:56.209294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.209527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.210943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.210943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.210943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.212937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.216765 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4067/8119] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:56.229489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.230901 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4053/8120] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:05:56.234322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:56.235016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.249515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626112c-6b79-4a36-93ee-b08e5e156336 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.257104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.257948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.258912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.261509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] PATH_INFO: `/v3/projects/edc4204ed2014956934be096795429d1/users/8b7eb542257e495b819998485aaa79da/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.262829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc4204ed2014956934be096795429d1, user_id=8b7eb542257e495b819998485aaa79da, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.266919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7587eb7-37de-47ab-9a4c-2b0cda2df883 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.290479 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4054/8121] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:56 2022] PUT /identity/v3/projects/edc4204ed2014956934be096795429d1/users/8b7eb542257e495b819998485aaa79da/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:56.301777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.302320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.302761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.326884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3a50-52f6-4ee4-a843-c4f4d1b64ad6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.340597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] MFA Rules not processed for user `8b7eb542257e495b819998485aaa79da`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:56.342331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:56.395011 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.395674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.395960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.396240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.435188 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4055/8122] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:56.440215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.482394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.484230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.496915 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4068/8123] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:05:56.497113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:56.516699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520057f8-0818-47eb-ae0c-68c965f1f961 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.521950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1cfbfc4ce747519bee1af555e1d698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ec192d8bd544c38a49759f90c6b3d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.522791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.523150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.523504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.524243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 31 15:05:56.531869 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 31 15:05:56.532951 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.538995 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4056/8124] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/projects => generated 136 bytes in 95 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 31 15:05:56.540503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.554433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f8f5e-2fb5-45d9-b405-81b74f8405f0 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.561448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.562200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.562555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.563033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.563800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.565871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invalid input for field 'name': '' is too short Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: Failed validating 'minLength' in schema['properties']['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: On instance['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: '' Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.573335 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 15:05:56.579399 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application '' Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.580484 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4069/8125] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/projects => generated 283 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 15:05:56.582212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.596328 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971082f2-ab87-4ba6-8c38-7eefc0814aed tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.601290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.601967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.602437 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.602854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.603480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.605356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: On instance['name']: Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: Failed validating 'maxLength' in schema['properties']['name']: Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: On instance['name']: Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise error Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 15:05:56.612510 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application On instance['name']: Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:56.615236 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application On instance['name']: Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:05:56.616438 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.619217 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4057/8126] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/projects => generated 412 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 31 15:05:56.628452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.645686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaf95d-d487-4d9c-bf6f-2a6b63b6a4e0 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.653383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.654155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.654654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.654912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects/d4b29e136dd04f09b0df4cc38da8cd62` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.664959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4b29e136dd04f09b0df4cc38da8cd62)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.671059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Could not find project: d4b29e136dd04f09b0df4cc38da8cd62.: keystone.exception.ProjectNotFound: Could not find project: d4b29e136dd04f09b0df4cc38da8cd62. Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 31 15:05:56.683575 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4b29e136dd04f09b0df4cc38da8cd62. Oct 31 15:05:56.684362 n-d-863055-2 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 31 15:05:56.685176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4070/8127] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:56 2022] DELETE /identity/v3/projects/d4b29e136dd04f09b0df4cc38da8cd62 => generated 113 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:56.691128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.704825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f539f-c418-4a7e-b205-88bce6ddff36 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.710376 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1cfbfc4ce747519bee1af555e1d698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ec192d8bd544c38a49759f90c6b3d41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.711103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.711539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.711854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.712706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 31 15:05:56.719976 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self._list_projects() Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 31 15:05:56.721216 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:56.724356 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4058/8128] 10.222.0.13 () {58 vars in 1131 bytes} [Mon Oct 31 15:05:56 2022] GET /identity/v3/projects => generated 135 bytes in 34 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 31 15:05:56.728814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.740398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3aa7-8c26-401a-8d47-00b4e00a7b8c tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.747400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.748129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.748481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.748842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.749631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.754226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:56.853030 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4071/8129] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:56.860377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:56.873466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d5a1-9f5f-43bb-822e-20934acc6125 tempest-ProjectsNegativeStaticTestJSON-496495964 tempest-ProjectsNegativeStaticTestJSON-496495964-project] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:56.937730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:56.938440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:56.938821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:56.939169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:56.939872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:56.941952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:57.014897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.sql.core [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-170155496' for key 'project.ixu_project_name_domain_id'") Oct 31 15:05:57.014897 n-d-863055-2 devstack@keystone.service[82163]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 15:05:57.014897 n-d-863055-2 devstack@keystone.service[82163]: [parameters: {'id': 'c2d65e0238cd46a5b92c6272f7cf95f3', 'name': 'tempest-project-dup-170155496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 15:05:57.014897 n-d-863055-2 devstack@keystone.service[82163]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-170155496, project id c2d65e0238cd46a5b92c6272f7cf95f3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-170155496, project id c2d65e0238cd46a5b92c6272f7cf95f3. Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application conn.query(q) Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:05:57.024912 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result.read() Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-170155496' for key 'project.ixu_project_name_domain_id'") Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 15:05:57.026108 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application next(self.gen) Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application yield resource Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application next(self.gen) Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise self.value Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 15:05:57.027747 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application session.commit() Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.session.flush() Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application compat.raise_( Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 15:05:57.029445 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 15:05:57.031128 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application conn.query(q) Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application result.read() Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:05:57.032968 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-170155496' for key 'project.ixu_project_name_domain_id'") Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application [parameters: {'id': 'c2d65e0238cd46a5b92c6272f7cf95f3', 'name': 'tempest-project-dup-170155496', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:57.034963 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-170155496 at domain ID default. Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 15:05:57.036301 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-170155496, project id c2d65e0238cd46a5b92c6272f7cf95f3. Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: ERROR keystone.server.flask.application Oct 31 15:05:57.037766 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4059/8130] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Oct 31 15:05:56 2022] POST /identity/v3/projects => generated 284 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 15:05:57.038728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:57.046476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ec7d9-39b9-46a0-b4b3-dcd75192304b tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:57.051821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b7eb542257e495b819998485aaa79da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc4204ed2014956934be096795429d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:57.052616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:57.052905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:57.059370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] PATH_INFO: `/v3/projects/a5d3a8dd0e01468c84526572ca455f33` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:57.059370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5d3a8dd0e01468c84526572ca455f33)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:57.059871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:57.070418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:57.238985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d3a8dd0e01468c84526572ca455f33', 'request_id': 'req-bf985d38-9535-4811-9d3c-14d5377ccb14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.323627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d3a8dd0e01468c84526572ca455f33', 'request_id': 'req-bf985d38-9535-4811-9d3c-14d5377ccb14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.330014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d3a8dd0e01468c84526572ca455f33', 'request_id': 'req-bf985d38-9535-4811-9d3c-14d5377ccb14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.343004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] The token cache is being invalidate because project a5d3a8dd0e01468c84526572ca455f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:57.343291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.344112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf985d38-9535-4811-9d3c-14d5377ccb14 tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.345667 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4072/8131] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:57 2022] DELETE /identity/v3/projects/a5d3a8dd0e01468c84526572ca455f33 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:57.350952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:57.353443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:57.426091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40736db2-90d6-4122-9197-5c2c28af0a2e tempest-ProjectsNegativeStaticTestJSON-717197256 tempest-ProjectsNegativeStaticTestJSON-717197256-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:57.525059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:57.525807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:57.526145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:57.526481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] PATH_INFO: `/v3/users/ba1cfbfc4ce747519bee1af555e1d698` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:57.529083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1cfbfc4ce747519bee1af555e1d698)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:57.532283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:57.562840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:57.864936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1cfbfc4ce747519bee1af555e1d698'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.865811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1cfbfc4ce747519bee1af555e1d698'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.951559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1cfbfc4ce747519bee1af555e1d698'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.967224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1cfbfc4ce747519bee1af555e1d698'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.968178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1cfbfc4ce747519bee1af555e1d698'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:57.984997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4060/8132] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:57 2022] DELETE /identity/v3/users/ba1cfbfc4ce747519bee1af555e1d698 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:57.990095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:57.990590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:57.990859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:58.019656 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:58.021121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:58.081538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4073/8133] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:58.091804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:58.093293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:58.157895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fad51-3393-4576-ae0b-f8bfb4aaa351 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:58.162074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:58.162775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:58.163104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:58.163436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:58.189339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:58.190828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:58.202256 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4061/8134] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:58.646201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:58.647850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:58.666650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f5f6-b8a0-4f1f-9b09-8c316d8e55e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:58.673839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:58.674818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:58.675103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:58.675393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] PATH_INFO: `/v3/projects/6ec192d8bd544c38a49759f90c6b3d41` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:58.676780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec192d8bd544c38a49759f90c6b3d41)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:58.678828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:58.803611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec192d8bd544c38a49759f90c6b3d41', 'request_id': 'req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:58.885897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec192d8bd544c38a49759f90c6b3d41', 'request_id': 'req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:58.892155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec192d8bd544c38a49759f90c6b3d41', 'request_id': 'req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:58.903981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] The token cache is being invalidate because project 6ec192d8bd544c38a49759f90c6b3d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:58.904271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:58.904906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:58.906448 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4074/8135] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:58 2022] DELETE /identity/v3/projects/6ec192d8bd544c38a49759f90c6b3d41 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:58.910799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:58.921927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57e391-f95b-489d-9103-518d9c63dff0 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:58.987132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:58.987916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:58.988090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:58.988284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] PATH_INFO: `/v3/users/8b7eb542257e495b819998485aaa79da` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:58.989416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7eb542257e495b819998485aaa79da)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:58.991387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:59.193129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:59.199563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7eb542257e495b819998485aaa79da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:59.200259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7eb542257e495b819998485aaa79da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:59.349526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7eb542257e495b819998485aaa79da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:59.362560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7eb542257e495b819998485aaa79da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:59.463654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-21551773-bba3-4dfc-b639-cc75b4c15dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7eb542257e495b819998485aaa79da'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:59.463654 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4062/8136] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:58 2022] DELETE /identity/v3/users/8b7eb542257e495b819998485aaa79da => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:05:59.967798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:59.971136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:59.989688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8128d0-e0f2-41dd-a0ff-f20e7e8468e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.010098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:00.056704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.057348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.057626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.057900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] PATH_INFO: `/v3/projects/edc4204ed2014956934be096795429d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.059222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc4204ed2014956934be096795429d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.061143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.228023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc4204ed2014956934be096795429d1', 'request_id': 'req-cc3d4d26-4481-40cc-bff5-73e36244c7f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:00.315823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc4204ed2014956934be096795429d1', 'request_id': 'req-cc3d4d26-4481-40cc-bff5-73e36244c7f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:00.322162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc4204ed2014956934be096795429d1', 'request_id': 'req-cc3d4d26-4481-40cc-bff5-73e36244c7f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:00.334543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] The token cache is being invalidate because project edc4204ed2014956934be096795429d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:00.334863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:00.335681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc3d4d26-4481-40cc-bff5-73e36244c7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:00.337927 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4075/8137] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:59 2022] DELETE /identity/v3/projects/edc4204ed2014956934be096795429d1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:00.344460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.345013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.345104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.366086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:00.367317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:00.445974 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4063/8138] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:00.453917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.454226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.454508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.476978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:00.478855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:00.490221 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4076/8139] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:00.491646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.503539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be909-c0a5-45f0-8612-e80086dfea0e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.508758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.509552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.509901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.510358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.511021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:00.511401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.513068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.534268 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4064/8140] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:06:00.535744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.549840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeee10f-344b-4040-b9a8-7d549b8f791b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.553877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.554611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.554987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.555412 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.556374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.558325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.651039 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4077/8141] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:00 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:00.652230 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.663889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfbe9-149b-4de3-adab-7eb00a43c234 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.728071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.728693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.729021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.729251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.730013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.732192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.828276 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4065/8142] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:00 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:00.829623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.842299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ab33-9284-43df-b8e2-2537c2296698 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.848061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.848696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.848993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.849225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.849862 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.851630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.866759 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4078/8143] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:00.868511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.879700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa869867-371a-4086-ab7d-2b9e5c375af7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.885280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.885954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.888199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.888199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.888199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.889059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af496f5-3c71-407a-8e20-299b8b252811 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:00.904432 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4066/8144] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:00.905682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:00.917961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d56424-7602-4d5f-8a36-bb035d7dcdc7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:00.923420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:00.924322 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:00.924757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:00.925200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] PATH_INFO: `/v3/projects/947ef6510905428db958befc676725ec/users/4a65a9c654cf4af19004b54d3ba405f0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:00.944532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=947ef6510905428db958befc676725ec, user_id=4a65a9c654cf4af19004b54d3ba405f0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:00.947874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d70a3-eea7-49a8-a0d9-de7560e4ee5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:01.042181 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4079/8145] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:00 2022] PUT /identity/v3/projects/947ef6510905428db958befc676725ec/users/4a65a9c654cf4af19004b54d3ba405f0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:01.055033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:01.055729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:01.056947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:01.102930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] MFA Rules not processed for user `4a65a9c654cf4af19004b54d3ba405f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:01.104308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:01.119597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:01.207725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4067/8146] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:01.224960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:01.225326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:01.225539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:01.271869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] MFA Rules not processed for user `22e15ff208c1453ab8318e64575dc2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:01.273264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:01.306447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:01.334777 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4080/8147] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 31 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:01.341559 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:01.354573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52f1e-9ebb-48fa-9452-639badd35e18 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:01.359613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:01.360438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:01.360879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:01.361321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:01.376750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:01.378658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d89b0-fbf7-4a5e-8b89-beda4df78f51 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:01.395995 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4068/8148] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:01.506653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:01.583351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82709-8e43-4168-82ff-1f33f083d370 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:01.588327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:01.589054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:01.589408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:01.589753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] PATH_INFO: `/v3/users/4a65a9c654cf4af19004b54d3ba405f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:01.591065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a65a9c654cf4af19004b54d3ba405f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:01.593075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:01.772094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a65a9c654cf4af19004b54d3ba405f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:01.773788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a65a9c654cf4af19004b54d3ba405f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:01.888932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a65a9c654cf4af19004b54d3ba405f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:01.905196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a65a9c654cf4af19004b54d3ba405f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:01.906083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a65a9c654cf4af19004b54d3ba405f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:01.924910 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4081/8149] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:01 2022] DELETE /identity/v3/users/4a65a9c654cf4af19004b54d3ba405f0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:01.930247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:01.930793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:01.931209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:01.952937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:01.960619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:02.035179 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4069/8150] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:02.046778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:02.048383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:02.120165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae9f3-1b24-4a78-9a5f-b2e19e3c0f80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:02.125157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:02.125724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:02.126006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:02.126278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:02.147861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:02.149245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687284f-c952-4e30-bf06-372c328b884e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:02.160614 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4082/8151] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:02.723349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:02.725612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:02.749485 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02187-443f-4c83-93af-80f6f62826b2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:02.762374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:02.763321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:02.763706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:02.764037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] PATH_INFO: `/v3/projects/947ef6510905428db958befc676725ec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:02.765491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947ef6510905428db958befc676725ec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:02.767583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:02.890894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947ef6510905428db958befc676725ec', 'request_id': 'req-f67366a1-4e84-4e24-a0ee-6a8b1f987905'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:02.963441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947ef6510905428db958befc676725ec', 'request_id': 'req-f67366a1-4e84-4e24-a0ee-6a8b1f987905'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:02.969746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947ef6510905428db958befc676725ec', 'request_id': 'req-f67366a1-4e84-4e24-a0ee-6a8b1f987905'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:02.981650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] The token cache is being invalidate because project 947ef6510905428db958befc676725ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:02.981938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:02.982599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-f67366a1-4e84-4e24-a0ee-6a8b1f987905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:02.984568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4070/8152] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:02 2022] DELETE /identity/v3/projects/947ef6510905428db958befc676725ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:02.989073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:02.989420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:02.989756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:02.998732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.011614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:03.014278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:03.075935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4083/8153] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:03.083882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.084316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.084737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.105592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:03.106841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:03.115712 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4071/8154] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:03.121998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.132803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c121-be51-48dd-b6da-c0c88951d064 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.138491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.138792 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.139099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.139383 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.140023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:03.140325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.141913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.161015 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4084/8155] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:03.165474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.175878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae03beb-c608-45e0-b9b9-d3d688738031 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.185898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.188809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.188809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.189114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.189847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.192180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.215686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.314637 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4072/8156] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:03 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:03.318983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.334123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760cf02-37d4-41f4-9372-79e7077281f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.402000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.402730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.403080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.403421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.404147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.406157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.537770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4085/8157] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:03 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:03.538924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.550656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c9be-1715-4846-b22a-ec3d6f253300 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.557224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.557224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.557224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.557224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.558031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.559688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.575325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.575777 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4073/8158] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:03.586033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c5ca3-5cbd-4a12-aa88-d604b20ff32f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.591633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.592819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.593285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.593863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.594802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.597084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257825ca-b370-410a-90e3-ca94688ba19a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.610675 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4086/8159] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:03.614810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.626134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744ab1-bfc9-4ca8-91e0-54f0080a10d1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.631141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.631918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.632177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.632451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] PATH_INFO: `/v3/projects/fa1fda42a4fe4f37a2b52bef68ebbf51/users/2e1dfb49aa16415facdf0aff86963a32/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.650337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1fda42a4fe4f37a2b52bef68ebbf51, user_id=2e1dfb49aa16415facdf0aff86963a32, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.653189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.729400 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4074/8160] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:03 2022] PUT /identity/v3/projects/fa1fda42a4fe4f37a2b52bef68ebbf51/users/2e1dfb49aa16415facdf0aff86963a32/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:03.730955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.731258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.731573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.764598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] MFA Rules not processed for user `2e1dfb49aa16415facdf0aff86963a32`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:03.765780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:03.854141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:03.865467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4087/8161] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:03.875360 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:03.877337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:03.948781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d85e9-9e68-4cfb-ba92-544ebe674f83 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:03.952491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:03.953113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:03.953395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:03.953663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:03.963201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:03.964654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734ae87-e7bf-4a11-90de-57ad235fc8b6 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:03.973745 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4075/8162] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:05.882987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:05.955503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652abb6-0033-42ea-a56d-c1e84903d372 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:05.961179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:05.961954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:05.962263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:05.962540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] PATH_INFO: `/v3/users/2e1dfb49aa16415facdf0aff86963a32` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:05.970750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1dfb49aa16415facdf0aff86963a32)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:05.970750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:06.250596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1dfb49aa16415facdf0aff86963a32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:06.251238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1dfb49aa16415facdf0aff86963a32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:06.352415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1dfb49aa16415facdf0aff86963a32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:06.368274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1dfb49aa16415facdf0aff86963a32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:06.368981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1dfb49aa16415facdf0aff86963a32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:06.389229 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4088/8163] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:05 2022] DELETE /identity/v3/users/2e1dfb49aa16415facdf0aff86963a32 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:06.394861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:06.395373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:06.395782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:06.431932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:06.433353 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:06.504915 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4076/8164] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:06.518313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:06.522842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:06.600283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fab1-b7db-4a36-a18b-a54a577671ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:06.605091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:06.606526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:06.607241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:06.608141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:06.619984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:06.621766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11290803-d7cf-4879-8dbf-19687f8f1124 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:06.636045 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4089/8165] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:07.174289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:07.183956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:07.200349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf0cb6-f88d-49fa-b4b2-6f6fffd634fe None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:07.208123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:07.209286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.209506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.209749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] PATH_INFO: `/v3/projects/fa1fda42a4fe4f37a2b52bef68ebbf51` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.212006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1fda42a4fe4f37a2b52bef68ebbf51)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:07.214065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:07.348112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1fda42a4fe4f37a2b52bef68ebbf51', 'request_id': 'req-73fe6d68-540f-483b-93e0-4e28890f2723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:07.435373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1fda42a4fe4f37a2b52bef68ebbf51', 'request_id': 'req-73fe6d68-540f-483b-93e0-4e28890f2723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:07.440889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:07.448395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1fda42a4fe4f37a2b52bef68ebbf51', 'request_id': 'req-73fe6d68-540f-483b-93e0-4e28890f2723'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:07.472444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] The token cache is being invalidate because project fa1fda42a4fe4f37a2b52bef68ebbf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:07.472910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:07.474172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-73fe6d68-540f-483b-93e0-4e28890f2723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:07.478294 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4077/8166] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:07 2022] DELETE /identity/v3/projects/fa1fda42a4fe4f37a2b52bef68ebbf51 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:07.486287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.486805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.487165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.512024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:07.513473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:07.536964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:07.591062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4090/8167] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:07.599409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.599698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.599973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.622272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:07.623517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:07.632229 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4078/8168] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:07.636659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:07.647814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7f794-2859-4490-a128-aab09f8f340a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:07.652503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:07.653100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.653368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.653751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.654287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:07.654589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:07.656248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:07.674164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4091/8169] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:07.679199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:07.688996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a3d9c-b2fe-4460-92cc-465da5ad85f4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:07.694773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:07.695358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.703685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.703685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.703685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:07.703685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:07.860458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4079/8170] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:07 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:07.870443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:07.881145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05685d-f193-4f1f-9924-e6d85b847816 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:07.964034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:07.964662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:07.964944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:07.965217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:07.965861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:07.967911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:08.141864 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4092/8171] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:07 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:08.147347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:08.159587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e2bf-91b6-4514-b377-5f1d4ffb3f56 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:08.164297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:08.164885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:08.165160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:08.165429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:08.166156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:08.167797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:08.179393 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4080/8172] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:08.184217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:08.196791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b436f6b-edd2-452e-85ed-bf90b07407bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:08.203661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:08.204207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:08.204579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:08.204949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:08.205894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:08.208029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04332be-95df-4269-8042-977e8a24a361 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:08.226114 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4093/8173] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:08.230450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:08.240803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07fed2-44ca-4ead-872e-8e03de9d7ca8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:08.249400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:08.250280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:08.250608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:08.250968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] PATH_INFO: `/v3/projects/432fc5ade86f4d3f91f55f85817b444c/users/5e3959a191524a2e8aed4ce718ed234f/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:08.271490 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=432fc5ade86f4d3f91f55f85817b444c, user_id=5e3959a191524a2e8aed4ce718ed234f, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:08.271682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:08.366370 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4081/8174] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:08 2022] PUT /identity/v3/projects/432fc5ade86f4d3f91f55f85817b444c/users/5e3959a191524a2e8aed4ce718ed234f/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:08.377719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:08.378002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:08.378275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:08.411612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] MFA Rules not processed for user `5e3959a191524a2e8aed4ce718ed234f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:08.413313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:08.495041 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4094/8175] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:08.509954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:08.513068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:08.611315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab02064-85ec-4491-bcc1-c52a6a34d38e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:08.615280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:08.615896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:08.616177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:08.616450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:08.626585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:08.628056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:08.645418 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4082/8176] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:09.015018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:09.016489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:09.040526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:09.096673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9038444-3f01-4995-9b7f-1fe041a75fd1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:09.104685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:09.105358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.106082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.106082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] PATH_INFO: `/v3/users/17a07e6817214f0ba80b38e6d12200ee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.107112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a07e6817214f0ba80b38e6d12200ee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:09.109433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:09.276799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:09.288924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bf78-b4c4-4733-aa11-520d0c29b0e1 service glance] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:09.293945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:09.294567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.294892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.295148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] PATH_INFO: `/v3/users/5e3959a191524a2e8aed4ce718ed234f` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.296279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3959a191524a2e8aed4ce718ed234f)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:09.298236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:09.359939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a07e6817214f0ba80b38e6d12200ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.360508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a07e6817214f0ba80b38e6d12200ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.464157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a07e6817214f0ba80b38e6d12200ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.479749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a07e6817214f0ba80b38e6d12200ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.480472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55d7dd9b-e70e-40b8-9bbb-b2fe3f284c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a07e6817214f0ba80b38e6d12200ee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.497501 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4095/8177] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:09 2022] DELETE /identity/v3/users/17a07e6817214f0ba80b38e6d12200ee => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:09.502366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.502690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.502972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.528798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:09.532772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:09.557130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3959a191524a2e8aed4ce718ed234f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.558198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3959a191524a2e8aed4ce718ed234f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.621163 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4096/8178] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:09.631547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:09.633208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:09.687423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:09.691442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3959a191524a2e8aed4ce718ed234f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.704119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774c4e3-2c87-467f-a4eb-b51732f77ae1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:09.714564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:09.716846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.718324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.718650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.719259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3959a191524a2e8aed4ce718ed234f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.720672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fec65216-498b-4854-89a7-cb6ea1eef645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3959a191524a2e8aed4ce718ed234f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:09.731772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:09.742701 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4083/8179] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:09 2022] DELETE /identity/v3/users/5e3959a191524a2e8aed4ce718ed234f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:09.747227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.747514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.747812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.749120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:09.751328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:09.769244 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4097/8180] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:09.779915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:09.781592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:09.857395 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4084/8181] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:09.869827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:09.876722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:09.897766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426016b-576e-46c5-b199-bc5d2ec7c491 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:09.954584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:09.955244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:09.955519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:09.955787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:09.966039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:09.967614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:09.988577 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4098/8182] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:10.328277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:10.329847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:10.344157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51865d90-cc91-4738-849b-79bb7070b0f4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:10.352201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:10.352652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.353068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.354197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] PATH_INFO: `/v3/projects/b15a7c8dc2d345428f291214bd26c028` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.356052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15a7c8dc2d345428f291214bd26c028)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:10.358029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:10.485288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15a7c8dc2d345428f291214bd26c028', 'request_id': 'req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.518355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:10.518829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:10.540152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641140ee-5f0b-4dc8-b3c1-ce5980f50cb5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:10.610683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15a7c8dc2d345428f291214bd26c028', 'request_id': 'req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.612069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:10.612717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.613001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.613276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] PATH_INFO: `/v3/projects/432fc5ade86f4d3f91f55f85817b444c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.614439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432fc5ade86f4d3f91f55f85817b444c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:10.616516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:10.618768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15a7c8dc2d345428f291214bd26c028', 'request_id': 'req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.632051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] The token cache is being invalidate because project b15a7c8dc2d345428f291214bd26c028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:10.632507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.636374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-356f9f13-0dcd-4fec-ba9b-8cca4b50822e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.637782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4085/8183] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:10 2022] DELETE /identity/v3/projects/b15a7c8dc2d345428f291214bd26c028 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:10.642746 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4da13-4a9c-473a-bfef-4a8fef89bd35 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.643037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4da13-4a9c-473a-bfef-4a8fef89bd35 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.643320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4da13-4a9c-473a-bfef-4a8fef89bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.664641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-07e4da13-4a9c-473a-bfef-4a8fef89bd35 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:10.665773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-07e4da13-4a9c-473a-bfef-4a8fef89bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:10.675137 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4086/8184] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:10.684965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.689447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.689447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.716931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:10.718212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:10.728146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4087/8185] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:10.733717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:10.744511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b0a0-3827-4a50-bf1b-67445ff76b8b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:10.751696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:10.752293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.752572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.752841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.753503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:10.753825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:10.756454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:10.770110 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4088/8186] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:10.776217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:10.787022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432fc5ade86f4d3f91f55f85817b444c', 'request_id': 'req-3600fc09-efca-4789-8b41-1e6829b2e773'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.787633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e24b3-52df-4af5-81f2-c9f406397000 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:10.847076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:10.854515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:10.855160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.855441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.855715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.856352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:10.858337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:10.905293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432fc5ade86f4d3f91f55f85817b444c', 'request_id': 'req-3600fc09-efca-4789-8b41-1e6829b2e773'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.912116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432fc5ade86f4d3f91f55f85817b444c', 'request_id': 'req-3600fc09-efca-4789-8b41-1e6829b2e773'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.924835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] The token cache is being invalidate because project 432fc5ade86f4d3f91f55f85817b444c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:10.925122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.925788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3600fc09-efca-4789-8b41-1e6829b2e773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:10.927411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4099/8187] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:10 2022] DELETE /identity/v3/projects/432fc5ade86f4d3f91f55f85817b444c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:10.935251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169433e-ea42-4bb2-99e4-e34af7b6c5e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.935794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169433e-ea42-4bb2-99e4-e34af7b6c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.936138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169433e-ea42-4bb2-99e4-e34af7b6c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:10.965746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2169433e-ea42-4bb2-99e4-e34af7b6c5e1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:10.968328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2169433e-ea42-4bb2-99e4-e34af7b6c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:10.980378 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4100/8188] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:10.988089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:10.988372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:10.988685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.003249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:11.013460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:11.020976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:11.023062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4101/8189] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:11.027681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.038737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9d755-07ae-43ba-8f14-732bb56b7d64 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.044441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.045036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.045316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.045586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.046306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:11.046609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.048301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.060991 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4089/8190] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:10 2022] POST /identity/v3/projects => generated 393 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:11.061595 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4102/8191] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:06:11.062257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.064176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:11.065740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.076064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4596ef-583d-476a-9709-9ae2198ddcf2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.141395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19f89-e80f-4cca-b3f2-28574966d652 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.143269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.143919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.144199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.144478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.145115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.146999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.147172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.147649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.148058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.148336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.149013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.151078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.287134 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4090/8192] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:11.291820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.302221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7394-c82a-4234-8beb-a24147f7c2cc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.307867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.308647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.308896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.309051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.309714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.311479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.324213 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4091/8193] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:11.325424 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4103/8194] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/projects => generated 411 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:11.329405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.329542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.341601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bf8d6-55d1-4a5b-be27-49c3fd93dc2c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.407030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad66a-e28f-40a8-82fd-d75d898b92c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.409369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.410118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.410394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.410691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.411326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.412365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.412931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.413048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.413263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.413537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.415022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.416658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.428117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4092/8195] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:11.429408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.439974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6be765-9d96-48f3-a72a-b97935b3dace admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.444687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.445323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.445601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.445876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] PATH_INFO: `/v3/projects/976a0ef7e6fa42e0bcd24fcf3bc1a441/users/8ee06c8e55ff40c38321f01491099d47/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.464030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976a0ef7e6fa42e0bcd24fcf3bc1a441, user_id=8ee06c8e55ff40c38321f01491099d47, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.466729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dcab0-2a83-4ff3-aa48-e36a86d8a7a6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.580722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4104/8196] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/users => generated 306 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:11.585016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.595479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0c19-76be-4234-9178-7d2519127242 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.600216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.602026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.602026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.602262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.602884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.604593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.618709 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4105/8197] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:11.622595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.633337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69293d5-cdd3-444e-93a1-5c650dfbfb05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.638312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.638955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.639252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.639516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.640149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.641737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.654885 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4106/8198] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:11.659659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.666214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4093/8199] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:11 2022] PUT /identity/v3/projects/976a0ef7e6fa42e0bcd24fcf3bc1a441/users/8ee06c8e55ff40c38321f01491099d47/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:11.677129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.677418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.677694 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.678786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f82bf-bf99-47e5-9ffc-0b234471e3ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.706375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] MFA Rules not processed for user `8ee06c8e55ff40c38321f01491099d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:11.709020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:11.744133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:11.756685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:11.777964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.779198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.781096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.782501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] PATH_INFO: `/v3/projects/6e9d01ab34ae41a78cb0d65eb76a7f35/users/a4d10d81a6c549bca1385251ab95be6b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.823129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9d01ab34ae41a78cb0d65eb76a7f35, user_id=a4d10d81a6c549bca1385251ab95be6b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.827157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321b50-928e-4cf0-ac8f-ca5eba632111 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.836981 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4094/8200] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:11.842331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:11.854319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081d80-b692-4a50-8c79-0abcf19affd4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:11.859659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:11.860436 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.861616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.862532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.863351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:11.865774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:11.927055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4107/8201] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:11 2022] PUT /identity/v3/projects/6e9d01ab34ae41a78cb0d65eb76a7f35/users/a4d10d81a6c549bca1385251ab95be6b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:11.943323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:11.943680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:11.944030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:11.984411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] MFA Rules not processed for user `a4d10d81a6c549bca1385251ab95be6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:11.985953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:12.075097 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4095/8202] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:12.077286 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4108/8203] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:12.079937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.081923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.160732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7a8a-29ac-4ea7-a75e-db42a8e7bb6a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.168646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.169728 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.170247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.170247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.170921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.171750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a65c1-6a4c-4744-a60f-3a84c6646532 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.172871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.176932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.177570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.177852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.178126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.178830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.181402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.269302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4096/8204] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:12 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:12.274265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.285999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977e71-e494-4280-a035-18719d6f818d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.291803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.292646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.292932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.293203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.293860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.295569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.300187 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4109/8205] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:12 2022] POST /identity/v3/projects => generated 411 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:12.304697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.309699 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4097/8206] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:12.313764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.326846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42ddf1-6ed6-47fc-9e5c-889544a90931 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.363709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:12.392258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3d117-8c0b-40d9-9ee4-57217c6da518 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.398734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.401042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.401534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.401763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.402316 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.404485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.413686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.416144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.416731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.416965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] PATH_INFO: `/v3/projects/47b2a3d4208c41f8a97269996638b4a0/users/4db70bce50e7405a99ad45ed4edc016d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.439628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b2a3d4208c41f8a97269996638b4a0, user_id=4db70bce50e7405a99ad45ed4edc016d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.443048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.579812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4110/8207] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:12 2022] POST /identity/v3/users => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:12.586012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.598738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d56d3-0bd3-4c7f-b14d-3eb0e296ec63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.604960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.605591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.605860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.606133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.613640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.613640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.620359 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4111/8208] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:12.620853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:12.624410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.628651 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4098/8209] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:12 2022] PUT /identity/v3/projects/47b2a3d4208c41f8a97269996638b4a0/users/4db70bce50e7405a99ad45ed4edc016d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:12.632658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.640017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814e23-e7a5-40cb-8e85-04c39d68a7ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.710402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.711029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.711310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.711696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] PATH_INFO: `/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c/users/30b038465bd94f88a0286222a92e0dc9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.732834 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b3a85-1ab0-4bf8-bdfc-3479b775be58 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.737384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922db1260fbc4e9e9d8d022a221ffd6c, user_id=30b038465bd94f88a0286222a92e0dc9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.740223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.740443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.741289 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.741952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.742302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.744384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.747638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.759665 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4099/8210] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:12.764267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.774991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb7e13-77a0-47da-9cfd-02b506b64764 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.779633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.780266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.780543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.780821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] PATH_INFO: `/v3/projects/47b2a3d4208c41f8a97269996638b4a0/users/4db70bce50e7405a99ad45ed4edc016d/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.783390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b2a3d4208c41f8a97269996638b4a0, user_id=4db70bce50e7405a99ad45ed4edc016d, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.790209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ceb61a-e56f-4dc4-aa06-56daad2cad66 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:12.807403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4100/8211] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:12 2022] PUT /identity/v3/projects/47b2a3d4208c41f8a97269996638b4a0/users/4db70bce50e7405a99ad45ed4edc016d/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:12.821443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798a15-9499-4458-862f-a557e35d86de None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.821819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798a15-9499-4458-862f-a557e35d86de None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.822033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798a15-9499-4458-862f-a557e35d86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.861190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f6798a15-9499-4458-862f-a557e35d86de None None] MFA Rules not processed for user `4db70bce50e7405a99ad45ed4edc016d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:12.862471 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4112/8212] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:12 2022] PUT /identity/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c/users/30b038465bd94f88a0286222a92e0dc9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:12.863379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f6798a15-9499-4458-862f-a557e35d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:12.869515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:12.975286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ca3f3-bd48-4153-88d2-5af3980db4c0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:12.988848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4101/8213] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:12.993662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:12.994719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:12.995263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:12.995499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:12.996416 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:12.998408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:13.007629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6798a15-9499-4458-862f-a557e35d86de None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:13.011041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f6798a15-9499-4458-862f-a557e35d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:13.011176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4113/8214] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:13.014454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:13.030082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d0ed-3e4c-46cd-a913-efa6350bc769 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:13.037218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:13.038327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:13.041002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:13.041002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] PATH_INFO: `/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c/users/30b038465bd94f88a0286222a92e0dc9/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:13.043357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=922db1260fbc4e9e9d8d022a221ffd6c, user_id=30b038465bd94f88a0286222a92e0dc9, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:13.048172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e10e-31f0-4cb3-938f-42bb58983bfd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:13.065856 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4114/8215] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:13 2022] PUT /identity/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c/users/30b038465bd94f88a0286222a92e0dc9/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:13.081853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:13.082778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:13.083069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:13.123478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] MFA Rules not processed for user `30b038465bd94f88a0286222a92e0dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:13.125225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:13.125348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6798a15-9499-4458-862f-a557e35d86de None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:13.130296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:13.137837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:13.219911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:13.220637 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:13.220959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:13.221256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:13.224524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4115/8216] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:13.238221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:13.240534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:13.307029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:13.309058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:13.325354 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4102/8217] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:13.337926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48230523-2c73-41ba-86cc-f7f159fcacd1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:13.342268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:13.342971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:13.343195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:13.343745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:13.357361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:13.358688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c1b3c-54d9-4458-9cf2-e3387fd287ac service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:13.370371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4116/8218] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:16.555705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:16.659658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d2ca-230b-4ded-8be6-91fe3b50b5b2 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:16.665913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:16.666454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:16.666981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:16.667249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] PATH_INFO: `/v3/users/a4d10d81a6c549bca1385251ab95be6b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:16.668847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d10d81a6c549bca1385251ab95be6b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:16.670705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:17.020627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:17.022421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d10d81a6c549bca1385251ab95be6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:17.023108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d10d81a6c549bca1385251ab95be6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:17.131241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d10d81a6c549bca1385251ab95be6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:17.153663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d10d81a6c549bca1385251ab95be6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:17.154642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d10d81a6c549bca1385251ab95be6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:17.188674 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4103/8219] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:16 2022] DELETE /identity/v3/users/a4d10d81a6c549bca1385251ab95be6b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:17.189018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:17.189018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:17.189018 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:17.203169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:17.205318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:17.300086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4117/8220] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:17.310278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:17.311715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:17.382292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1cf45-3a0e-496d-8695-fc68dea573ee admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:17.386396 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:17.387882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:17.387882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:17.387882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:17.399044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:17.400893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:17.412878 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4104/8221] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:18.144456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:18.146671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:18.163499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d53290-bcbd-4fdb-b21a-3356cba3f986 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:18.173084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:18.180269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:18.180269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:18.180269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] PATH_INFO: `/v3/projects/6e9d01ab34ae41a78cb0d65eb76a7f35` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:18.180269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9d01ab34ae41a78cb0d65eb76a7f35)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:18.181738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:18.361567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:18.365293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9d01ab34ae41a78cb0d65eb76a7f35', 'request_id': 'req-a50e2bc3-bead-44d8-b26c-7cadce542a2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.460258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9d01ab34ae41a78cb0d65eb76a7f35', 'request_id': 'req-a50e2bc3-bead-44d8-b26c-7cadce542a2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.469490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9d01ab34ae41a78cb0d65eb76a7f35', 'request_id': 'req-a50e2bc3-bead-44d8-b26c-7cadce542a2c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.488586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] The token cache is being invalidate because project 6e9d01ab34ae41a78cb0d65eb76a7f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:18.488921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.490762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.492864 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4118/8222] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:18 2022] DELETE /identity/v3/projects/6e9d01ab34ae41a78cb0d65eb76a7f35 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:18.497649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:18.515009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ba56d-c61f-4a2b-8517-c96a387d503b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:18.645612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:18.646930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:18.647607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:18.648040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] PATH_INFO: `/v3/users/30b038465bd94f88a0286222a92e0dc9` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:18.649645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b038465bd94f88a0286222a92e0dc9)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:18.652814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:18.985568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b038465bd94f88a0286222a92e0dc9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:18.986343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b038465bd94f88a0286222a92e0dc9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.080662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b038465bd94f88a0286222a92e0dc9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.104344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:19.108622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b038465bd94f88a0286222a92e0dc9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.110275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5304ebf0-c437-464f-a3a9-a694b24388a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b038465bd94f88a0286222a92e0dc9'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.132781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4105/8223] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:18 2022] DELETE /identity/v3/users/30b038465bd94f88a0286222a92e0dc9 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:19.470395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:19.472900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:19.491105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2bc3-bead-44d8-b26c-7cadce542a2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:19.590751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:19.591507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:19.591845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:19.592182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] PATH_INFO: `/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:19.593827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922db1260fbc4e9e9d8d022a221ffd6c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:19.597626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:19.745081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922db1260fbc4e9e9d8d022a221ffd6c', 'request_id': 'req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.836781 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922db1260fbc4e9e9d8d022a221ffd6c', 'request_id': 'req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.844101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922db1260fbc4e9e9d8d022a221ffd6c', 'request_id': 'req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.865475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] The token cache is being invalidate because project 922db1260fbc4e9e9d8d022a221ffd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:19.865958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.867703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4fd4202a-dd3d-4d16-8581-e9745ab3ffd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:19.870413 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4119/8224] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:19 2022] DELETE /identity/v3/projects/922db1260fbc4e9e9d8d022a221ffd6c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:19.875756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:19.876325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:19.876325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:19.911653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:19.913035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:19.999825 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4106/8225] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:20.008547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.013337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.013337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.036443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:20.037674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:20.050858 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4120/8226] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:20.055625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.067340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bd4e3-53b7-493b-bd01-19c0abb0c52a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.075687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.076307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.076600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.082097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.082097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:20.082097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.082097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.098032 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4107/8227] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:20.102822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.115203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f64b-7300-4bda-a352-2bb33967a56f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.120721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.121321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.121697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.121971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.122609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.124543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.260545 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4121/8228] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:20.265895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.277555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac934a-9768-4e37-b64b-92a527714430 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.346883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.347613 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.347901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.348175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.348809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.351691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.507360 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4108/8229] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:20 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:20.512743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.525210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dff75-73dd-4329-ada4-18327ff520f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.530719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.531940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.532346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.532894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.533808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.536242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.557550 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4122/8230] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:20.558912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.570006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bec64-2e2f-4457-865b-3be39a04e650 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.575502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.576138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.576417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.576710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.577339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.578999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8a0a3-9bae-4321-8cbc-abbb5c351b89 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.592230 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4109/8231] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:20.597395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.608956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07708e2-8099-4630-b454-6d943d23ca3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.613944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.614647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.614930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.615212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] PATH_INFO: `/v3/projects/2486326fdf434d81a795312cfbbbc897/users/8008a963ce58467f9dac3e06e9a42372/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.632368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2486326fdf434d81a795312cfbbbc897, user_id=8008a963ce58467f9dac3e06e9a42372, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.635882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:20.735311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:20.740077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4123/8232] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:20 2022] PUT /identity/v3/projects/2486326fdf434d81a795312cfbbbc897/users/8008a963ce58467f9dac3e06e9a42372/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:20.750945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.751229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.751518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.786663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] MFA Rules not processed for user `8008a963ce58467f9dac3e06e9a42372`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:20.786663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:20.830684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:20.858069 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4110/8233] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:20.862908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:20.959919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f1ae-ac1f-4a38-b124-984120035b4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:20.969971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:20.970837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:20.971220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:20.971617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:20.972420 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:20.974474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.125598 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4124/8234] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:20 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:21.127389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.151439 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf16cd3-6ef1-40fe-bea2-bbdd71f38873 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.159676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.162279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:21.236668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a347728-a68c-4db9-804c-00ed41a07a8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.243561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.244192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.244459 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.244744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.246597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:21.262402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.263222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.263503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.264690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.264690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.268109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.333097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.335898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.348576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4125/8235] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:21.392001 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4111/8236] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:21 2022] POST /identity/v3/users => generated 295 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:21.397910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.410300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ce26a-2f5f-4716-81e6-0acc04837501 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.416297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.417374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.418786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.418786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.418786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.420585 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.433293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4126/8237] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:21.439391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.452195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b8fe8-62e5-44d4-acc7-b7fc4470ed56 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.459622 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.460538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.461642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.462022 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] PATH_INFO: `/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1/users/899136b402c04ef681f9eb3624d49ed0/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.480791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec15f5e44314de7a0327e7e4d1559c1, user_id=899136b402c04ef681f9eb3624d49ed0, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.483765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.604484 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4112/8238] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:21 2022] PUT /identity/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1/users/899136b402c04ef681f9eb3624d49ed0/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:21.608073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.624971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0efa-ae67-409c-b102-b76124321888 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.651699 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:21.721560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.725277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.726351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.727516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.729023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.730930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afefe2-25ab-494d-a627-0732940ad4cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.747546 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4127/8239] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:06:21.749741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.772712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce7617-b531-4037-9262-caddb3bdb4d9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:21.782306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:21.783689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.784515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.785103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] PATH_INFO: `/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1/users/899136b402c04ef681f9eb3624d49ed0/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.788662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec15f5e44314de7a0327e7e4d1559c1, user_id=899136b402c04ef681f9eb3624d49ed0, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:21.794341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:21.818585 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4113/8240] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:21 2022] PUT /identity/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1/users/899136b402c04ef681f9eb3624d49ed0/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:21.837991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:21.839733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:21.841153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:21.886845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] MFA Rules not processed for user `899136b402c04ef681f9eb3624d49ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:21.888266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:21.974164 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4128/8241] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:21.984326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:21.987296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:22.056513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075c76-3210-4367-a28b-0e1d8b77670d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:22.060363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:22.060978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:22.061260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:22.061655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:22.072111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:22.073588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398d03-c11f-4eb3-a289-aa4bda10c214 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:22.086546 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4114/8242] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:25.806493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:25.940914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1cd6-426b-46bd-a00c-c0779b125059 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:25.955060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:25.956870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:25.959022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:25.959573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] PATH_INFO: `/v3/users/8008a963ce58467f9dac3e06e9a42372` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:25.966203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8008a963ce58467f9dac3e06e9a42372)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:25.972981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:26.164267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c0c6-6ba5-4f27-8483-f26255405076 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:26.165498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c0c6-6ba5-4f27-8483-f26255405076 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:26.166189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c0c6-6ba5-4f27-8483-f26255405076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:26.196227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9e64c0c6-6ba5-4f27-8483-f26255405076 None None] MFA Rules not processed for user `48118e993f724d93a15ec0636bf27517`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:26.197461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9e64c0c6-6ba5-4f27-8483-f26255405076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:26.239168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:26.242338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8008a963ce58467f9dac3e06e9a42372'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:26.244321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8008a963ce58467f9dac3e06e9a42372'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:26.252329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:26.275152 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4115/8243] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:26.354904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8008a963ce58467f9dac3e06e9a42372'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:26.371150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8008a963ce58467f9dac3e06e9a42372'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:26.372306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8008a963ce58467f9dac3e06e9a42372'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:26.392935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4129/8244] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:25 2022] DELETE /identity/v3/users/8008a963ce58467f9dac3e06e9a42372 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:26.400636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:26.401610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:26.404981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:26.433920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:26.435260 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:26.547749 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4116/8245] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:26.559078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:26.563370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:26.681262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b40b8-f098-4db9-9c90-4e5d54c87512 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:26.690105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:26.691889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:26.692241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:26.692737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:26.711253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:26.712833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d797bdd-24d6-417d-885a-978d004a59b7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:26.734232 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4130/8246] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:27.526994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:27.528975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:27.549961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5392-0703-424a-8be0-914203cfd948 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:27.559848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:27.562384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:27.562948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:27.566419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] PATH_INFO: `/v3/projects/2486326fdf434d81a795312cfbbbc897` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:27.566419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2486326fdf434d81a795312cfbbbc897)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:27.570352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:27.709214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2486326fdf434d81a795312cfbbbc897', 'request_id': 'req-6ecd3138-cf27-49cb-b824-1e74d95db231'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:27.805380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2486326fdf434d81a795312cfbbbc897', 'request_id': 'req-6ecd3138-cf27-49cb-b824-1e74d95db231'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:27.807612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186907eb-1025-41b5-ae95-f53480c270cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:27.808074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186907eb-1025-41b5-ae95-f53480c270cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:27.808467 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186907eb-1025-41b5-ae95-f53480c270cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:27.818001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2486326fdf434d81a795312cfbbbc897', 'request_id': 'req-6ecd3138-cf27-49cb-b824-1e74d95db231'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:27.834101 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] The token cache is being invalidate because project 2486326fdf434d81a795312cfbbbc897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:27.837209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:27.837209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:27.838538 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4117/8247] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:27 2022] DELETE /identity/v3/projects/2486326fdf434d81a795312cfbbbc897 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:27.843069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:27.844446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-186907eb-1025-41b5-ae95-f53480c270cb None None] MFA Rules not processed for user `8ee06c8e55ff40c38321f01491099d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:27.845694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-186907eb-1025-41b5-ae95-f53480c270cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:27.848123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:27.933891 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4131/8248] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:27.955473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd3138-cf27-49cb-b824-1e74d95db231 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:27.961994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:27.963120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:27.963366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:27.963751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] PATH_INFO: `/v3/users/899136b402c04ef681f9eb3624d49ed0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:27.965565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899136b402c04ef681f9eb3624d49ed0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:27.967812 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:27.973259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:28.124995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:28.125348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:28.125730 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:28.178060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:28.180183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:28.272930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:28.296893 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4132/8249] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:06:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:28.314222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:28.315151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899136b402c04ef681f9eb3624d49ed0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:28.316452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899136b402c04ef681f9eb3624d49ed0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:28.318437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:28.349311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d396e-d835-4dba-8117-1dddd550ac49 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:28.358949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:28.359814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:28.360360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:28.360902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:28.364714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:28.381431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899136b402c04ef681f9eb3624d49ed0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:28.383475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:28.387084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67188-5700-42fe-9374-222fce6d2dd4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:28.408830 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4133/8250] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:28.416739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899136b402c04ef681f9eb3624d49ed0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:28.417641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899136b402c04ef681f9eb3624d49ed0'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:28.446774 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4118/8251] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:06:27 2022] DELETE /identity/v3/users/899136b402c04ef681f9eb3624d49ed0 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:29.110189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.110690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.110784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.129343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:29.132875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:29.158163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:29.162293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:29.290296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415c25e-df0d-4938-8c06-02e64908f5e7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:29.313645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:29.316066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.316544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.317169 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] PATH_INFO: `/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.318667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec15f5e44314de7a0327e7e4d1559c1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:29.320816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:29.337800 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4134/8252] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:29.344948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:29.349411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:29.382157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10fbc-3acf-4fab-8c0b-e16e612f2516 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:29.388218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:29.388838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.389117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.389636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.399266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:29.400859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba36cf7-6206-4991-9a23-2c2277ad9ff2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:29.414037 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4135/8253] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:06:29.491320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec15f5e44314de7a0327e7e4d1559c1', 'request_id': 'req-5af96dbc-64e1-4f0c-8530-6ef52509ef58'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:29.607418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec15f5e44314de7a0327e7e4d1559c1', 'request_id': 'req-5af96dbc-64e1-4f0c-8530-6ef52509ef58'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:29.616475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec15f5e44314de7a0327e7e4d1559c1', 'request_id': 'req-5af96dbc-64e1-4f0c-8530-6ef52509ef58'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:29.630297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] The token cache is being invalidate because project 4ec15f5e44314de7a0327e7e4d1559c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:29.630576 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:29.631309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5af96dbc-64e1-4f0c-8530-6ef52509ef58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:29.632848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4119/8254] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:29 2022] DELETE /identity/v3/projects/4ec15f5e44314de7a0327e7e4d1559c1 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:29.638812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4805-c437-420f-9955-567f71977649 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.639198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4805-c437-420f-9955-567f71977649 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.639579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4805-c437-420f-9955-567f71977649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.672313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df1a4805-c437-420f-9955-567f71977649 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:29.674413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df1a4805-c437-420f-9955-567f71977649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:29.769918 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4136/8255] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:29.773200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.773200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.773200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.822609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:29.823867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:29.832431 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4120/8256] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:29.837415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4805-c437-420f-9955-567f71977649 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:29.847960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4805-c437-420f-9955-567f71977649 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:29.852796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:29.853414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.853696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.853977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.854669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:29.854982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:29.856592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:29.871317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4137/8257] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:29.875856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:29.887510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8712a9-b057-4791-a670-20e60d18fde7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:29.895540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:29.896346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:29.896711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:29.897081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:29.898411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:29.902931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:29.907979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:30.219616 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4121/8258] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:29 2022] POST /identity/v3/projects => generated 369 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:06:30.222261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:30.222261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e163-a454-4210-8083-b62b039c38cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:30.287617 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:30.291913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:30.292543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.292818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.293115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.293750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:30.295809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:30.484176 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4138/8259] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:30 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:30.488515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:30.504791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48ae8-fcdb-4562-8798-ffff0476ee3d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:30.510029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:30.510777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.511320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.511789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.512516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:30.514442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:30.527692 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4122/8260] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:30.540266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:30.551633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a25bd-6469-414b-81c6-9219497cc976 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:30.561624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:30.562374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.563139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.563139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.563746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:30.565587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcf144-7dad-48a2-9667-f6746d7869c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:30.582188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4139/8261] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:30.584965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:30.606563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a10c0b-e009-465b-9c8f-f7f0eaf7ee27 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:30.612887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:30.613368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.613653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.613930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] PATH_INFO: `/v3/projects/6aa8f96d585a4c53ae3f339b3b799f61/users/d08be8b22f994c57aaecd042e64745fe/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.634236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa8f96d585a4c53ae3f339b3b799f61, user_id=d08be8b22f994c57aaecd042e64745fe, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:30.636682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:30.758214 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4123/8262] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:30 2022] PUT /identity/v3/projects/6aa8f96d585a4c53ae3f339b3b799f61/users/d08be8b22f994c57aaecd042e64745fe/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:30.769738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.770102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.770462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.801332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] MFA Rules not processed for user `d08be8b22f994c57aaecd042e64745fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:30.802700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:30.884874 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4140/8263] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:06:30.890048 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:30.958419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ef78-6514-446f-91b1-e3139b32f69d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:30.963105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:30.963807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:30.964093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:30.964362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:30.965017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:30.967027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.082850 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4124/8264] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:30 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:31.086998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.098208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951f4a7-0d49-4bfa-b3f3-b333dd0599c3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.162089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.162754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.163042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.163319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.163995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:31.165965 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.301189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4141/8265] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:06:31 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:31.305808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.316593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e0ac-44cb-4151-86ab-b0d573b4a661 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.325245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.325245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.325245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.325245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.325651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:31.325651 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.336559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4125/8266] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:31.340819 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.351397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2dcb8-d366-4b66-8947-353c8eec8bdd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.359749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.359749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.359749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.359749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] PATH_INFO: `/v3/projects/6ea15b98433e425e9a1d48f34df46649/users/e9e808ae708e47aeaceadcfb3aa0e889/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.372869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea15b98433e425e9a1d48f34df46649, user_id=e9e808ae708e47aeaceadcfb3aa0e889, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:31.375562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.540460 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4142/8267] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:31 2022] PUT /identity/v3/projects/6ea15b98433e425e9a1d48f34df46649/users/e9e808ae708e47aeaceadcfb3aa0e889/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:31.551719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.573010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7861e0-f014-4725-8fa0-51d370a4df11 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.640172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.640712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.640994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.641278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.641942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:31.643805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f155d96-b557-41f7-b250-88a7aa9a539c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.658499 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4126/8268] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:06:31.659160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.670509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96d7f3-d899-4a9f-832b-5ab7fe30f21b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.675650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.680114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.680114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.680114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] PATH_INFO: `/v3/projects/6ea15b98433e425e9a1d48f34df46649/users/e9e808ae708e47aeaceadcfb3aa0e889/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.680114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea15b98433e425e9a1d48f34df46649, user_id=e9e808ae708e47aeaceadcfb3aa0e889, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:31.682421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:31.701538 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4143/8269] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:06:31 2022] PUT /identity/v3/projects/6ea15b98433e425e9a1d48f34df46649/users/e9e808ae708e47aeaceadcfb3aa0e889/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:06:31.799675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.799964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:31.800237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:31.829583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] MFA Rules not processed for user `e9e808ae708e47aeaceadcfb3aa0e889`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:31.830759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:31.843655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:31.908524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4127/8270] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:31.919824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:31.921567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:31.937379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:31.989382 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6488e3-7199-42a6-becf-d1487e22f3e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:31.996538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:31.997507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:31.997507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:32.000113 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:32.057738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:32.057738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:32.057738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4144/8271] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:42.001052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:42.002664 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:42.088372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da989b-3f8e-4d90-a21d-954707d17acd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:42.093541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:42.094151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:42.094464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:42.094767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:42.096757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:42.113608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:42.115275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:42.130747 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4128/8272] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:42.246129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:42.256144 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf8f1a-1adf-40b7-a5a2-5eb4f447f31f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:42.262799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9e808ae708e47aeaceadcfb3aa0e889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea15b98433e425e9a1d48f34df46649', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:42.263430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:42.263714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:42.263998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:42.264729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:42.265036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:42.266768 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:42.282809 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4145/8273] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:42.284621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:42.306220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051afcff-d655-4868-b271-c80c3e73214c service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:42.312628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9e808ae708e47aeaceadcfb3aa0e889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea15b98433e425e9a1d48f34df46649', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:42.313463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:42.313979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:42.314414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:42.315251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:42.320909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:42.460403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4129/8274] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:06:42 2022] POST /identity/v3/projects => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:06:42.463917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:42.474257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572e365-0c22-414f-a544-78aade5c7df4 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:42.551812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9e808ae708e47aeaceadcfb3aa0e889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea15b98433e425e9a1d48f34df46649', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:42.552514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:42.552874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:42.553745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:42.554536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:06:42.554955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:42.556636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:42.572508 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4146/8275] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:06:43.581152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:43.582024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:43.582409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:43.597162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249fb76-2539-4a23-8137-f4485b11ea4d tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:43.602346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9e808ae708e47aeaceadcfb3aa0e889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ea15b98433e425e9a1d48f34df46649', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:43.603076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:43.603363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:43.603641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] PATH_INFO: `/v3/projects/8a0db40fb5b24c0d8696168fb0b19d62` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:43.605935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a0db40fb5b24c0d8696168fb0b19d62)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:43.607974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:43.697043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:43.715647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55495b3-f505-4869-82d3-f65d9fd9adc9 tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:43.723735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:43.724654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:43.725079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:43.725315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:43.727873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:43.747947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:43.749893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:43.768181 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4130/8276] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:43.774492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0db40fb5b24c0d8696168fb0b19d62', 'request_id': 'req-c5e1be2d-13ec-4793-92db-d5868bdfea5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:43.858816 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0db40fb5b24c0d8696168fb0b19d62', 'request_id': 'req-c5e1be2d-13ec-4793-92db-d5868bdfea5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:43.867398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0db40fb5b24c0d8696168fb0b19d62', 'request_id': 'req-c5e1be2d-13ec-4793-92db-d5868bdfea5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:43.881174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] The token cache is being invalidate because project 8a0db40fb5b24c0d8696168fb0b19d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:06:43.882760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:43.882760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5e1be2d-13ec-4793-92db-d5868bdfea5b tempest-RoutersAdminTest-1808189759 tempest-RoutersAdminTest-1808189759-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:06:43.884572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4147/8277] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:06:43 2022] DELETE /identity/v3/projects/8a0db40fb5b24c0d8696168fb0b19d62 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:06:43.898949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:43.976024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dec71-c242-4bd5-ba38-bc1d21e10892 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:44.028741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:44.029358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:44.029642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:44.029918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:44.031741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:44.091700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:44.093085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:44.103285 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4131/8278] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:52.773988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:52.774433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:52.774642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:52.796754 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:06:52.798301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:52.805990 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4148/8279] 10.222.0.13 () {58 vars in 1062 bytes} [Mon Oct 31 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:06:52.811474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:06:52.852051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f43e0-ef1e-4a17-9ba9-a733ac0b9dc7 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:06:52.856541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:06:52.857159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:06:52.861067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:06:52.861067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:06:52.861067 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:06:52.952272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:52.988098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:06:52.989574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbefaa1-1909-4326-a5cd-cc4bb8d1f750 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:06:53.014795 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4132/8280] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:06:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:02.791058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:03.113125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=15 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:18.664108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:18.665764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:18.742966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c09dc-6563-4ec9-b19f-5c2e59b88a23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:18.748785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:18.751059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:18.751059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:18.751059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] PATH_INFO: `/v3/users/d08be8b22f994c57aaecd042e64745fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:18.751354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08be8b22f994c57aaecd042e64745fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:18.753968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:18.994472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08be8b22f994c57aaecd042e64745fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:18.995478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08be8b22f994c57aaecd042e64745fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:19.084772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08be8b22f994c57aaecd042e64745fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:19.097811 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08be8b22f994c57aaecd042e64745fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:19.098445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08be8b22f994c57aaecd042e64745fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:19.111001 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4149/8281] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:07:18 2022] DELETE /identity/v3/users/d08be8b22f994c57aaecd042e64745fe => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:19.116215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:19.116683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:19.116790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:19.136913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:19.138112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:19.196880 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4133/8282] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:19.206943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:19.208428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:19.269097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd461b-5c7a-4997-b07b-b4f9416edc09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:19.272690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:19.273289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:19.273570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:19.273844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:19.284783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:19.288007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:19.297171 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4150/8283] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:19.766713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:19.768133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:19.780450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aa02c-5266-4189-b6ed-6d4f55949b04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:19.785043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:19.785667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:19.787400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:19.793378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] PATH_INFO: `/v3/projects/6aa8f96d585a4c53ae3f339b3b799f61` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:19.793378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa8f96d585a4c53ae3f339b3b799f61)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:19.793378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:19.921592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa8f96d585a4c53ae3f339b3b799f61', 'request_id': 'req-cb14cc94-71b7-4297-89f5-62b5d1b42c95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:19.999320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa8f96d585a4c53ae3f339b3b799f61', 'request_id': 'req-cb14cc94-71b7-4297-89f5-62b5d1b42c95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.005507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa8f96d585a4c53ae3f339b3b799f61', 'request_id': 'req-cb14cc94-71b7-4297-89f5-62b5d1b42c95'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.016841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] The token cache is being invalidate because project 6aa8f96d585a4c53ae3f339b3b799f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:07:20.017199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.017852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.019407 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4134/8284] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:07:19 2022] DELETE /identity/v3/projects/6aa8f96d585a4c53ae3f339b3b799f61 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:20.024038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:20.034020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33aa1-48ed-4f47-954b-2e9c3c9cb7b3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:20.053164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:20.092394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:20.092986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:20.093263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:20.093536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] PATH_INFO: `/v3/users/e9e808ae708e47aeaceadcfb3aa0e889` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:20.094717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e808ae708e47aeaceadcfb3aa0e889)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:20.096593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:20.302838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e808ae708e47aeaceadcfb3aa0e889'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.303357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e808ae708e47aeaceadcfb3aa0e889'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.416872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e808ae708e47aeaceadcfb3aa0e889'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.432850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e808ae708e47aeaceadcfb3aa0e889'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.433609 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c065648c-44e4-4ae6-a2ba-017569339eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e808ae708e47aeaceadcfb3aa0e889'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:20.448109 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4151/8285] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:07:20 2022] DELETE /identity/v3/users/e9e808ae708e47aeaceadcfb3aa0e889 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:20.761859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:20.763410 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:20.782372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14cc94-71b7-4297-89f5-62b5d1b42c95 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:20.846306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:20.846887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:20.847163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:20.847435 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] PATH_INFO: `/v3/projects/6ea15b98433e425e9a1d48f34df46649` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:20.848566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea15b98433e425e9a1d48f34df46649)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:20.851060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:20.965009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:20.981760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea15b98433e425e9a1d48f34df46649', 'request_id': 'req-5ac5419f-7ebb-4787-929f-61451b7b897c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:21.146649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea15b98433e425e9a1d48f34df46649', 'request_id': 'req-5ac5419f-7ebb-4787-929f-61451b7b897c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:21.153444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea15b98433e425e9a1d48f34df46649', 'request_id': 'req-5ac5419f-7ebb-4787-929f-61451b7b897c'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:21.165898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] The token cache is being invalidate because project 6ea15b98433e425e9a1d48f34df46649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:07:21.166187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:21.166879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5ac5419f-7ebb-4787-929f-61451b7b897c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:21.168380 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4135/8286] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:07:20 2022] DELETE /identity/v3/projects/6ea15b98433e425e9a1d48f34df46649 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:21.173812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.174350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.174937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.195347 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:21.198176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:21.256652 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4152/8287] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:21.264655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.264937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.265205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.288465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:21.289719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:21.297655 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4136/8288] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:21.302130 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.312522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9711-0f5a-40ce-8ba9-bb0f154195b5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.317397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.322047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.334116 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4153/8289] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:07:21.338462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.348511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81812-2429-4f20-a08e-01a3d48dcffd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.353938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.354539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.354843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.355110 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.355739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.357689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.427960 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4137/8290] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:07:21 2022] POST /identity/v3/projects => generated 397 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:07:21.432165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.442367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80fe9-ab56-419e-928e-f71096c42b71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.469355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:21.500997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.501606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.501885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.502161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.502823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.504804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.598471 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4154/8291] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:07:21 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:07:21.602567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.612999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbdc3d-6d2e-452a-81d5-b04c14ea57fd admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.617598 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.618217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.618553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.623814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.623814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.623814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.632073 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4138/8292] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:07:21.636583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.647430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e80d-970b-4c69-bf5a-4a490d745968 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.652139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.652734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.653016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.653287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.653921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.655595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5ad87-0fc0-4664-9a50-723c86e3e8d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.666026 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4155/8293] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:07:21.670319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.680628 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae90d5-d7ec-47a2-9a57-f3d2b3d3e383 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.686732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.687589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.687875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.688222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] PATH_INFO: `/v3/projects/02f2931080324e1c832e52b27159392e/users/42c22cf76bcb4d57b846aee2f80a578b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.704842 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f2931080324e1c832e52b27159392e, user_id=42c22cf76bcb4d57b846aee2f80a578b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:21.707796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:21.794366 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4139/8294] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:07:21 2022] PUT /identity/v3/projects/02f2931080324e1c832e52b27159392e/users/42c22cf76bcb4d57b846aee2f80a578b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:21.806315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.806598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.807015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:21.838037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] MFA Rules not processed for user `42c22cf76bcb4d57b846aee2f80a578b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:21.839314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:21.910552 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4156/8295] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:21.921095 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:21.922890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:21.986373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab4bb-4b89-4a60-b409-32af5c80fdc9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:21.990528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:21.991177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:21.991460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:21.991733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:22.003325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:22.004791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:22.015011 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4140/8296] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:22.376757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:22.378516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:22.393162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169382-2337-4a87-b4d5-288c96ca87db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:22.398367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:22.399134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:22.401172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:22.401172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:22.401477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:22.504267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:22.505916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:22.532279 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4157/8297] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:23.062884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:23.072322 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e269cfd-9a63-4ca4-8217-d2a138dbdbad service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:23.076176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:23.076790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:23.077071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:23.077659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:23.079497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:23.096915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:23.098455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:23.113557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4141/8298] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:23.751210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:23.756179 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:23.762162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079d67-9894-412a-91ba-64233cc92c02 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:23.770992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:23.770992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:23.770992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:23.770992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:23.771402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:23.783080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:23.784581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:23.799954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4158/8299] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:23.838372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:23.840023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:23.897874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:23.934963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb995f-b568-49d5-a589-8889f188f551 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:23.948907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:23.949697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:23.949976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:23.950244 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:23.952334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:23.971821 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:23.973443 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf1097-f384-4212-9e7d-12788704c845 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:23.988921 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4142/8300] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:24.630738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:24.640107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0622-0287-4fa7-bed4-7f53e8eeec5c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:24.643923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:24.644531 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:24.644820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:24.645094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:24.647685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:24.663407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:24.665555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:24.686292 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4159/8301] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:24.898064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:24.899117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:24.899117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:24.954111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:24.956019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:24.971099 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4143/8302] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:24.987274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:24.988722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:25.010189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c39b5-00eb-4129-b1ab-5a613dcd2e7e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:25.019630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:25.020272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:25.020558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:25.020874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:25.036523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:25.038869 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:25.049025 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4160/8303] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:25.439898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:25.452192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0de7c-9d7f-492c-b6dd-fb0d7ab15ea9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:25.456589 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:25.457209 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:25.457491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:25.457764 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:25.459643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:25.499284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:25.500865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f30207-2d73-4cbb-94f9-6531b464f271 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:25.521642 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4144/8304] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:35.044373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=17 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:35.511257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=23 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:37.027390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:37.091944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8903a-ec91-4447-adc2-d6094fed9bbf service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:37.096750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:37.097379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:37.097652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:37.097924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] PATH_INFO: `/v3/users/42c22cf76bcb4d57b846aee2f80a578b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:37.099086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c22cf76bcb4d57b846aee2f80a578b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:37.101126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:37.275248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c22cf76bcb4d57b846aee2f80a578b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:37.275812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c22cf76bcb4d57b846aee2f80a578b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:37.381506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c22cf76bcb4d57b846aee2f80a578b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:37.395098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c22cf76bcb4d57b846aee2f80a578b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:37.395772 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c22cf76bcb4d57b846aee2f80a578b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:37.408330 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4161/8305] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:07:37 2022] DELETE /identity/v3/users/42c22cf76bcb4d57b846aee2f80a578b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:37.413822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:37.414330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:37.414445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:37.434893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:37.436117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:37.514740 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4145/8306] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:07:37.526764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:37.527821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:37.589611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dfbda-295f-4d99-93ce-143f3bfb7fdd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:37.598505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:37.598505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:37.598505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:37.598505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:37.604128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:37.605569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b64036-a0cb-4b37-8568-20c9125fb5b2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:37.616530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4162/8307] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:37.892378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:37.894803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:37.909747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2b029-de65-4cff-a822-5005b3b1ab70 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:37.915170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:37.915826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:37.916104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:37.916379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] PATH_INFO: `/v3/projects/02f2931080324e1c832e52b27159392e` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:37.917593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f2931080324e1c832e52b27159392e)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:37.919568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.064584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f2931080324e1c832e52b27159392e', 'request_id': 'req-a17afe81-e75f-481b-a45a-3bc496fd57aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:38.130868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f2931080324e1c832e52b27159392e', 'request_id': 'req-a17afe81-e75f-481b-a45a-3bc496fd57aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:38.141466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f2931080324e1c832e52b27159392e', 'request_id': 'req-a17afe81-e75f-481b-a45a-3bc496fd57aa'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:38.150458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] The token cache is being invalidate because project 02f2931080324e1c832e52b27159392e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:07:38.150787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:38.151483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-a17afe81-e75f-481b-a45a-3bc496fd57aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:38.153016 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4146/8308] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:07:37 2022] DELETE /identity/v3/projects/02f2931080324e1c832e52b27159392e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:38.158894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.159351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.159534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.181667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:38.187576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:38.202028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:38.250873 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4163/8309] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:38.258831 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.259118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.259399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.281202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:38.282464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:38.291220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4147/8310] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:38.295926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.306456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac9aa-2c88-4063-8a77-74bb6f84c943 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.311176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.311763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.312041 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.312315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.312958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:07:38.313259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.314890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.327488 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4164/8311] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:07:38.332123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.342680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41b87-4195-4197-9ee3-d8a8c2384a8f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.347991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.348634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.348917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.349734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.350386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.352400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.469222 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4148/8312] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:07:38.473570 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.485080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03171d-6322-4725-b66c-3d8a7425f9fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.549735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.550360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.550666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.550952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.551584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.553502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.698044 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4165/8313] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:07:38 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:07:38.713547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.726889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb868cc1-5c58-4203-b713-d4f887963abb admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.732268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.732994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.733269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.733541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.734227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.735915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.747639 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4149/8314] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:07:38.752931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.766439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0560-cfbd-459b-9026-6f4d11da47de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.774403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.775068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.775348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.775618 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.776273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.777894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a2404-5a74-406d-8140-58fe43f0efb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.791322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4166/8315] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:07:38.795950 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:38.807118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195079d6-bc3c-4e39-b312-52676b63fb74 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:38.812174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:38.812865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.813150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.813428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] PATH_INFO: `/v3/projects/eff85e4b34294b05a754fa77b4bc30d6/users/9502b100fc904ea79a88a13232bad159/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.831638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff85e4b34294b05a754fa77b4bc30d6, user_id=9502b100fc904ea79a88a13232bad159, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:38.835387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:38.897666 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4150/8316] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:07:38 2022] PUT /identity/v3/projects/eff85e4b34294b05a754fa77b4bc30d6/users/9502b100fc904ea79a88a13232bad159/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:07:38.908536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:38.908826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:38.909022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:38.940667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] MFA Rules not processed for user `9502b100fc904ea79a88a13232bad159`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:38.942469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:39.034258 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4167/8317] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:39.046144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:39.047931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:39.071319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:39.120774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17ce1-5bfd-4273-96df-ffedeb3b6739 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:39.125506 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:39.126136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:39.126421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:39.126794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:39.136940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:39.138469 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476244ef-302b-4281-ac99-d26e74489f7e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:39.148971 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4151/8318] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:49.030800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:49.168123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=17 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:54.236184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:54.302367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c9cb-59e5-4411-a63f-2df4d931404c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:54.306835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:54.307469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:54.307746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:54.308016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] PATH_INFO: `/v3/users/9502b100fc904ea79a88a13232bad159` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:54.309150 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9502b100fc904ea79a88a13232bad159)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:54.311116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:54.674916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9502b100fc904ea79a88a13232bad159'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:54.675665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9502b100fc904ea79a88a13232bad159'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:54.746446 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9502b100fc904ea79a88a13232bad159'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:54.760671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9502b100fc904ea79a88a13232bad159'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:54.761426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9502b100fc904ea79a88a13232bad159'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:54.774995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4168/8319] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:07:54 2022] DELETE /identity/v3/users/9502b100fc904ea79a88a13232bad159 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:54.779477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:54.779954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:54.780046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:54.799550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:54.800753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:54.860159 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4152/8320] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:54.870641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:54.872116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:54.931266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c543b0-2f32-4651-8996-94622d813d93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:54.935176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:54.935813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:54.936094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:54.936365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:54.946519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:54.947976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ab42-3a4d-44ba-b195-ff829a5be26d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:54.958159 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4169/8321] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:55.222591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.224127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:55.239735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ca83-abb6-44dd-b7e3-20c95b5a5e1d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.245740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.249431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.249431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.249431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] PATH_INFO: `/v3/projects/eff85e4b34294b05a754fa77b4bc30d6` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.249431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff85e4b34294b05a754fa77b4bc30d6)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.250215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.364923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff85e4b34294b05a754fa77b4bc30d6', 'request_id': 'req-94ed6755-2398-49d6-a717-965235024809'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:55.432016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff85e4b34294b05a754fa77b4bc30d6', 'request_id': 'req-94ed6755-2398-49d6-a717-965235024809'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:55.438154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff85e4b34294b05a754fa77b4bc30d6', 'request_id': 'req-94ed6755-2398-49d6-a717-965235024809'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:55.449653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] The token cache is being invalidate because project eff85e4b34294b05a754fa77b4bc30d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:07:55.449961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:55.454138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-94ed6755-2398-49d6-a717-965235024809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:07:55.454138 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4153/8322] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:07:55 2022] DELETE /identity/v3/projects/eff85e4b34294b05a754fa77b4bc30d6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:55.457171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.457654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.457746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.477980 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:55.479213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:55.500065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:55.544158 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4170/8323] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:55.552508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.552789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.553062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.573189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:55.574397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:55.582285 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4154/8324] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:55.586637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.597676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e830f7-56c6-457a-a2d3-cf4069174bd7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.603218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.603824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.604099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.604368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.605014 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:07:55.605309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.607075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.619877 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4171/8325] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:07:55.624662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.634814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a66b3-cdf6-4fb2-9019-78cb939ee39b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.639790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.640404 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.640686 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.640957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.641605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.643700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.722665 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4155/8326] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:07:55.724743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.735371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d16e-4dd4-4279-9c75-3eb8a4a9aa2a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.792894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.793502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.793782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.801970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.801970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.801970 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.882524 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4172/8327] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:07:55 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:07:55.886754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.898059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9930-f91e-4799-9b20-5e6773b311a6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.902882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.903486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.903770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.904047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.904693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.906355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.917489 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4156/8328] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:07:55.921612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.932239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b50b8-9bd1-40b5-a900-677f6e0d6473 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.936918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.937525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.937808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.938111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.938801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.940390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eaba1-b8d8-4fbf-96e3-b6e83682067d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:55.950591 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4173/8329] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:07:55.954908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:55.965566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b519-22b0-4358-b62a-3051ea731f67 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:55.970290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:55.970978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:55.971268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:55.971528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] PATH_INFO: `/v3/projects/3d0a90bd418c427a84d61e37bd84d78c/users/ccc916ce6edc4dc29f9095adafecf466/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:55.987306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a90bd418c427a84d61e37bd84d78c, user_id=ccc916ce6edc4dc29f9095adafecf466, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:55.990018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:56.088629 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4157/8330] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:07:55 2022] PUT /identity/v3/projects/3d0a90bd418c427a84d61e37bd84d78c/users/ccc916ce6edc4dc29f9095adafecf466/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:07:56.099068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:56.099533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:56.099807 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:56.128522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] MFA Rules not processed for user `ccc916ce6edc4dc29f9095adafecf466`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:56.130263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:56.195068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4174/8331] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:56.205261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:56.207010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:56.230177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:56.268052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123e99-9e9b-4715-b775-e0f566210925 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:56.272668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:56.273297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:56.273943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:56.274371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:56.283138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:56.287811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f0da-35fb-4e57-bcfd-725ebbfa92e8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:56.294009 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4158/8332] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:06.191598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:06.443711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=17 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:20.487389 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:20.552588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcbe5-4935-46d2-9f82-bee9875209f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:20.557187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:20.557892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:20.558173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:20.558444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] PATH_INFO: `/v3/users/ccc916ce6edc4dc29f9095adafecf466` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:20.559752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc916ce6edc4dc29f9095adafecf466)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:20.561637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:20.803777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc916ce6edc4dc29f9095adafecf466'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:20.804006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc916ce6edc4dc29f9095adafecf466'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:20.905411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc916ce6edc4dc29f9095adafecf466'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:20.920569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc916ce6edc4dc29f9095adafecf466'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:20.921320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc916ce6edc4dc29f9095adafecf466'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:20.935866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4175/8333] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:08:20 2022] DELETE /identity/v3/users/ccc916ce6edc4dc29f9095adafecf466 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:20.940422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:20.941444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:20.941670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:20.963627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:20.964508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:21.026239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4159/8334] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:21.037163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:21.038563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:21.098849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df883d4-ead9-491b-90fc-0a8bd4dc6cf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:21.102397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:21.103026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.103303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.103575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.113264 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:21.114809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c781-4c35-4cb4-a914-5f98f04ea41e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:21.125232 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4176/8335] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:21.477365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:21.478956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:21.492959 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4836-f9a9-49ed-88b2-04198f327dae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:21.499774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:21.500487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.501627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.501627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] PATH_INFO: `/v3/projects/3d0a90bd418c427a84d61e37bd84d78c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.505525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0a90bd418c427a84d61e37bd84d78c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:21.507851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:21.643633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0a90bd418c427a84d61e37bd84d78c', 'request_id': 'req-72ea5438-4949-4c0b-a74e-b3e643654fb4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:21.704422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0a90bd418c427a84d61e37bd84d78c', 'request_id': 'req-72ea5438-4949-4c0b-a74e-b3e643654fb4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:21.711721 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0a90bd418c427a84d61e37bd84d78c', 'request_id': 'req-72ea5438-4949-4c0b-a74e-b3e643654fb4'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:21.726010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] The token cache is being invalidate because project 3d0a90bd418c427a84d61e37bd84d78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:08:21.726300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:21.727049 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-72ea5438-4949-4c0b-a74e-b3e643654fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:21.728554 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4160/8336] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:08:21 2022] DELETE /identity/v3/projects/3d0a90bd418c427a84d61e37bd84d78c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:21.733672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.734152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.734241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.754454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:21.755697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:21.773458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:21.817774 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4177/8337] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:21.826018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.826314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.826590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.848081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:21.849287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:21.857788 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4161/8338] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:21.862058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:21.872737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ca43-2893-4ee9-a634-a32c2f280a0d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:21.877587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:21.878192 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.878472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.878783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.879431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:08:21.879735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:21.881332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:21.895144 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4178/8339] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:08:21.900551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:21.911458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c494-25c5-4828-a3cd-2e23155fceb7 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:21.916157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:21.916759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:21.917036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:21.917305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:21.918045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:21.919942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.095592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4162/8340] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:08:21 2022] POST /identity/v3/projects => generated 357 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:22.100455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:22.111226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c47ab-31f2-46d5-a0de-c5739771c311 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:22.175090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:22.175694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.175992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.176363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.176887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:22.178982 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.308341 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4179/8341] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:08:22 2022] POST /identity/v3/users => generated 279 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:22.312639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:22.323896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a4f13-2053-436f-a6e7-9b0937b6490e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:22.328583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:22.329192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.337798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.337798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.337798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:22.337798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.347220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4163/8342] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:08:22.351300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:22.362212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de008e2c-dc48-4393-a062-deda4858a365 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:22.367511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:22.368114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.368395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.368672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.369337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:22.371001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd9979-d4b4-462d-81e0-b32fd4e895ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.383329 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4180/8343] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:08:22.387685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:22.399683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d827cb-f6e8-488f-9122-3e7d4340c658 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:22.404306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:22.405011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.405373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.405645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] PATH_INFO: `/v3/projects/f1af63e970d244239ce1dc07465a8c49/users/676a3b748749471f968de53b2496eb45/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.421078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1af63e970d244239ce1dc07465a8c49, user_id=676a3b748749471f968de53b2496eb45, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:22.423824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.498794 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4164/8344] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:08:22 2022] PUT /identity/v3/projects/f1af63e970d244239ce1dc07465a8c49/users/676a3b748749471f968de53b2496eb45/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:08:22.514071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.514405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.514612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.545541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] MFA Rules not processed for user `676a3b748749471f968de53b2496eb45`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:22.546803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:22.615546 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4181/8345] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:22.626120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:22.627923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:22.651284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:22.689463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906a54-237b-4e2b-a20e-5a080541d385 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:22.693928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:22.694541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:22.694846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:22.695114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:22.703720 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:22.705270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44300a9-d408-443f-a3cd-7cb9db154199 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:22.716365 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4165/8346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:32.612453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:32.985267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=17 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:33.553654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:33.623127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0733f4-fdad-4c1c-b1d4-8fd276569097 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:33.628597 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:33.629241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:33.629527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:33.629802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] PATH_INFO: `/v3/users/676a3b748749471f968de53b2496eb45` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:33.630968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=676a3b748749471f968de53b2496eb45)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:33.633063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:33.878608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676a3b748749471f968de53b2496eb45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:33.879338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676a3b748749471f968de53b2496eb45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.048187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676a3b748749471f968de53b2496eb45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.063654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676a3b748749471f968de53b2496eb45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.064462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676a3b748749471f968de53b2496eb45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.078147 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4182/8347] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:08:33 2022] DELETE /identity/v3/users/676a3b748749471f968de53b2496eb45 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:34.082932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.083462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.083582 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.102765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:34.103969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:34.168476 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4166/8348] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:08:34.179875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:34.181294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:34.240540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0df2-c357-4ab2-ae83-d0729de304a8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:34.244162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:34.244960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.245169 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.245436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.256101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:34.257542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b68711-c6a5-4589-9983-f3780f2f2d0d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:34.267758 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4183/8349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:34.529227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:34.533529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:34.545291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee586-3e19-4567-bff9-cb72fda26eb0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:34.552336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:34.553178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.553646 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.553993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] PATH_INFO: `/v3/projects/f1af63e970d244239ce1dc07465a8c49` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.555313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1af63e970d244239ce1dc07465a8c49)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:34.557241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:34.692965 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1af63e970d244239ce1dc07465a8c49', 'request_id': 'req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.812153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1af63e970d244239ce1dc07465a8c49', 'request_id': 'req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.818657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1af63e970d244239ce1dc07465a8c49', 'request_id': 'req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.831285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] The token cache is being invalidate because project f1af63e970d244239ce1dc07465a8c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:08:34.831569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.832251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b3ffd4a2-1761-4cf1-8408-a74885b9a79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:08:34.833725 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4167/8350] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:08:34 2022] DELETE /identity/v3/projects/f1af63e970d244239ce1dc07465a8c49 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:34.838912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.839381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.839479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.859564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:34.860747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:34.878434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:34.921966 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4184/8351] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:34.931539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.931960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.932270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.952696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:34.953792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:34.961841 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4168/8352] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:34.966578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:34.976035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405809f-1ca6-4a54-b48b-759504f5b85c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:34.980600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:34.981193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:34.981473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:34.981746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:34.982421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:08:34.982765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:34.984341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:34.996576 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4185/8353] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:08:35.000793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.011794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceca83-01aa-4de4-9f7c-e3f57e91f960 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.016749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.017348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.017620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.017887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.018538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.020455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.123478 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4169/8354] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:08:34 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:35.128384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.138808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0f4c-6a9b-4063-9593-4c0f412224ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.196831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.197533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.197801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.198004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.198663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.200589 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.294125 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4186/8355] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:08:35 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:35.299129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.316479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d8672-535b-4d70-a07d-49ae80e22bd7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.321472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.322091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.322372 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.322747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.323399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.325052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.337015 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4170/8356] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:08:35.341095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.351740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4397337-68bf-4b85-bbbb-3d94883de71f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.356541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.357140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.357481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.357749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.358384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.360355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196521b5-1d80-4770-b43c-4296180ea487 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.379516 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4187/8357] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:08:35.383947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.394692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7ab3-e66f-4981-b6ad-5d459935b452 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.399511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.400183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.400462 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.400735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] PATH_INFO: `/v3/projects/451c385402d04e59a062c9bbcdd6143a/users/1376f77892ca49eab2d784baa6f5fd51/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.416405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c385402d04e59a062c9bbcdd6143a, user_id=1376f77892ca49eab2d784baa6f5fd51, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.419109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.495167 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4171/8358] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:08:35 2022] PUT /identity/v3/projects/451c385402d04e59a062c9bbcdd6143a/users/1376f77892ca49eab2d784baa6f5fd51/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:35.507191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.507697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.508104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.536449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] MFA Rules not processed for user `1376f77892ca49eab2d784baa6f5fd51`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:35.537710 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:35.604999 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4188/8359] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:35.609805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.632629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:35.676114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac535ff-37e4-459b-b48f-d680e8dfe68f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.680910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.681565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.681918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.682114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.682777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.684758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.793329 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4172/8360] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:08:35 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:35.797466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:35.809481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976c10c-c9ee-4e21-b30d-e08924bf6df2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:35.822329 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:35.868313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:35.868987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:35.869155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:35.869638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:35.870524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:35.873034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:35.995724 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4189/8361] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:08:35 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:08:35.999884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.010235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747099f-d5e4-4c9b-9abe-0acd8b9d2fc2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.015034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.015658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.016796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.016796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.016968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.018553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.029244 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4173/8362] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:08:36.033458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.044764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48637-e6ec-4e9d-8c55-fb5065fee7d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.050136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.050844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.051129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.051422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] PATH_INFO: `/v3/projects/46b0a27d7d254cdc82c144add571d8d7/users/e218dc2d7fce4b16811491d820790070/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.067218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b0a27d7d254cdc82c144add571d8d7, user_id=e218dc2d7fce4b16811491d820790070, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.069891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.174439 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4190/8363] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:08:36 2022] PUT /identity/v3/projects/46b0a27d7d254cdc82c144add571d8d7/users/e218dc2d7fce4b16811491d820790070/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:36.178835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.189330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ea1a9-35f8-4ad0-86c3-2423014587b9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.246395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.247034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.247313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.247590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.248228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.249833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e231c-6981-482f-841e-1d7bcfb722de admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.260248 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4174/8364] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:08:36.264678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.276274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293be3a-238f-4002-aad8-6ea71f5cc67e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.281154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.281833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.282866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.283114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] PATH_INFO: `/v3/projects/46b0a27d7d254cdc82c144add571d8d7/users/e218dc2d7fce4b16811491d820790070/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.289368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b0a27d7d254cdc82c144add571d8d7, user_id=e218dc2d7fce4b16811491d820790070, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.292074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.303277 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4191/8365] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:08:36 2022] PUT /identity/v3/projects/46b0a27d7d254cdc82c144add571d8d7/users/e218dc2d7fce4b16811491d820790070/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:08:36.314077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.314356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.314634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.345132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] MFA Rules not processed for user `e218dc2d7fce4b16811491d820790070`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:08:36.348271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:36.422415 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4175/8366] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:08:36.435481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.437193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:36.515462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb2272-4cc8-4d57-81d1-973c8c56c02d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.519623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.520294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.520565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.520835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.530092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.531566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.541434 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4192/8367] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:36.793973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:36.806742 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72609b-1c10-4dbc-b64a-865a5f5e2550 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:36.810338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:36.810991 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:36.811266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:36.811535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:36.824440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:36.882216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:36.883723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9e384-91a3-4d3a-8dec-35a1a50733f2 service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:36.893466 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4176/8368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:45.746661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:08:45.749488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:45.831927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:45.860886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b04f-fe8f-4563-830d-f789179e7275 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:08:45.874257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:08:45.874931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:08:45.875233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:08:45.875493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:08:45.880733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:08:45.901171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:08:45.902842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:08:45.918169 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4193/8369] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:46.939062 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=21 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:56.140700 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:04.778921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:04.779352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:04.779352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:04.806430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] MFA Rules not processed for user `8ee06c8e55ff40c38321f01491099d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:04.807749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:04.893805 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4177/8370] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.361477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.363082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.432887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edba6f-c75f-46f5-a1f6-b9f4a71d9bb5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.441084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.441084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.441084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.441084 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.441788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.452311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.454271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.466851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4194/8371] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:09.715085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:09.717069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:09.731590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07ea61-638e-41b5-9df4-03f1fe5cf1bc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:09.736400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:09.737427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:09.738097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:09.738294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:09.743457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:09.759561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:09.761774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:09.798965 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4178/8372] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:15.459897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:19.772890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=31 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:26.457101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:26.466249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34e766-e8b8-44b5-9ba4-eee8a423f30a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:26.471851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:26.471851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:26.471851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:26.471851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:26.473472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:26.543055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:26.544581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:26.554572 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4195/8373] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:36.550066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=28 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:46.496446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.506839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fcb27-7688-4d84-a879-b549b0a0a8e8 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.511600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.512232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.512542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.513011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.517296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:46.531327 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.532784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031e328-4faa-41c6-b556-ac2a8f08d340 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.545420 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4179/8374] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:51.498089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:51.578553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d638d0-856c-4830-bdf0-ce902b28019e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:51.583407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.584081 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.584385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.584660 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] PATH_INFO: `/v3/users/1376f77892ca49eab2d784baa6f5fd51` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.585945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1376f77892ca49eab2d784baa6f5fd51)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.588693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.823397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1376f77892ca49eab2d784baa6f5fd51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.824131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1376f77892ca49eab2d784baa6f5fd51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.902020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1376f77892ca49eab2d784baa6f5fd51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.916543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1376f77892ca49eab2d784baa6f5fd51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.917473 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1376f77892ca49eab2d784baa6f5fd51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.934434 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4196/8375] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:51 2022] DELETE /identity/v3/users/1376f77892ca49eab2d784baa6f5fd51 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:51.939061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.939640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.939640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.960916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:51.962115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.041845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4180/8376] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:52.052361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:52.053956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.126102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cac64-80da-45e9-9230-46d1651cbb93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:52.136040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:52.137624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:52.138044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:52.138453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:52.156220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:52.159166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:52.180012 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4197/8377] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:52.676536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:52.677880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.691311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04e08-6280-41c7-9af7-3ae51f72ca56 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:52.696679 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:52.697325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:52.697601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:52.697884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] PATH_INFO: `/v3/projects/451c385402d04e59a062c9bbcdd6143a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:52.699074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=451c385402d04e59a062c9bbcdd6143a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:52.701065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:52.819044 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451c385402d04e59a062c9bbcdd6143a', 'request_id': 'req-fd3565f7-2693-419e-ab55-a1c5f6ec739d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.932086 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451c385402d04e59a062c9bbcdd6143a', 'request_id': 'req-fd3565f7-2693-419e-ab55-a1c5f6ec739d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.942789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451c385402d04e59a062c9bbcdd6143a', 'request_id': 'req-fd3565f7-2693-419e-ab55-a1c5f6ec739d'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.962228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] The token cache is being invalidate because project 451c385402d04e59a062c9bbcdd6143a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:52.962525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.963460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.965055 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4181/8378] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:52 2022] DELETE /identity/v3/projects/451c385402d04e59a062c9bbcdd6143a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:52.969541 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:52.988405 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c324-aa02-44d7-a9a5-e8ad0a9d7e85 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:53.002592 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:53.044546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:53.045823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:53.046098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:53.046414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] PATH_INFO: `/v3/users/e218dc2d7fce4b16811491d820790070` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:53.047642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e218dc2d7fce4b16811491d820790070)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:53.049833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:53.303651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e218dc2d7fce4b16811491d820790070'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.304265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e218dc2d7fce4b16811491d820790070'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.421457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e218dc2d7fce4b16811491d820790070'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.434875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e218dc2d7fce4b16811491d820790070'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.435620 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7ea8ae44-a695-41bd-a438-95873ac03892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e218dc2d7fce4b16811491d820790070'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.448262 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4198/8379] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:52 2022] DELETE /identity/v3/users/e218dc2d7fce4b16811491d820790070 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:53.911699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:53.913214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:53.927762 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3565f7-2693-419e-ab55-a1c5f6ec739d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:53.995973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:53.996733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:53.998995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:53.998995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] PATH_INFO: `/v3/projects/46b0a27d7d254cdc82c144add571d8d7` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:53.999183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b0a27d7d254cdc82c144add571d8d7)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.000997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.018024 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:54.155897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b0a27d7d254cdc82c144add571d8d7', 'request_id': 'req-05bf8011-bb77-4671-b1a4-52acbe042338'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:54.250579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b0a27d7d254cdc82c144add571d8d7', 'request_id': 'req-05bf8011-bb77-4671-b1a4-52acbe042338'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:54.257144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b0a27d7d254cdc82c144add571d8d7', 'request_id': 'req-05bf8011-bb77-4671-b1a4-52acbe042338'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:54.275557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] The token cache is being invalidate because project 46b0a27d7d254cdc82c144add571d8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:54.275910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:54.276995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05bf8011-bb77-4671-b1a4-52acbe042338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:54.278908 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4182/8380] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:53 2022] DELETE /identity/v3/projects/46b0a27d7d254cdc82c144add571d8d7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:54.284474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.285313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.285313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.308454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:54.309685 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:54.381271 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4199/8381] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:54.389825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.390223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.390509 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.415085 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:54.416565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:54.428439 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4183/8382] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:54.432952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.444528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1438d-e69c-4646-a4c1-1a27d60ab150 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.449502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.450114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.450388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.450679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.451337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:54.451633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.453236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.465866 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4200/8383] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:54.470497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.482153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6779dc8-3ed0-4367-ba49-002857468a66 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.486471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.487138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.487422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.487697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.488363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.490375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.594782 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4184/8384] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:54 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:54.602210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.610548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864b3d-a5d4-4f67-9cee-ae5558eb7eee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.638024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:54.676303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.676892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.677260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.677733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.678448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.680954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.788705 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4201/8385] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:54 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:54.793314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.804445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185895bd-cd96-4960-a864-dfb68fcf414c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.808997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.809609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.809885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.810156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.810920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.812779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.825529 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4185/8386] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:54.829694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.840155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5992d-740c-4cfa-abe2-25086b34ad3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.845799 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.846411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.846729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.847002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.847664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.849313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a162a63-3c2c-439d-bc8b-e8374fed2f26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.861003 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4202/8387] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:54.865319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.876154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76531f-4e96-4587-a38a-0fda02d19a18 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.880874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.881625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.881905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.882174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] PATH_INFO: `/v3/projects/6d958e1a08314f9cb8612c2c92ac131b/users/0bfc49f6899749b59ddd0751ef8374fe/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.902216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d958e1a08314f9cb8612c2c92ac131b, user_id=0bfc49f6899749b59ddd0751ef8374fe, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.905533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.983775 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4186/8388] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:54 2022] PUT /identity/v3/projects/6d958e1a08314f9cb8612c2c92ac131b/users/0bfc49f6899749b59ddd0751ef8374fe/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:54.995343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.995655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.996798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.028042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] MFA Rules not processed for user `0bfc49f6899749b59ddd0751ef8374fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:55.031344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:55.106364 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4203/8389] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:55.110916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.195211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d079aa1-16d7-419f-bff6-6e10594aa582 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.200400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.201535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.201817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.202092 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.202787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.204793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.339371 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4187/8390] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:09:55.344042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.356837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9014-7718-4865-ae30-775b00c852d0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.438301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.438967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.439253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.439485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.440153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.442057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.606683 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4204/8391] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:55.610211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.628933 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d035a6-a182-484d-bc3f-a37d4f6544ba admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.632254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.632984 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.633267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.633704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.634265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.635940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.647768 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4188/8392] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:55.652401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.664485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99414e5e-9fd1-40b1-9199-531ab0bdd043 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.669381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.670979 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.671278 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.671550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] PATH_INFO: `/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5/users/29723dfbf51940f294643a7abefb3998/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.689335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61f6804bb9c4a90b378ba1bcf49cbb5, user_id=29723dfbf51940f294643a7abefb3998, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.692332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.771647 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4205/8393] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:55 2022] PUT /identity/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5/users/29723dfbf51940f294643a7abefb3998/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:55.775732 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.786586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905af82c-99d7-47a2-ae49-9da802fb15ad admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.795818 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.847682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.848300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.848584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.848860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.849564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.851242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c933b-1599-4c17-ac99-6bdb68a42ddd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.866546 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4189/8394] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:55.869062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.875270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.881186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf126b-00fe-4b74-bb50-0e5f55d0cf78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.898944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.899773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.900057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.900352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] PATH_INFO: `/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5/users/29723dfbf51940f294643a7abefb3998/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.902453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61f6804bb9c4a90b378ba1bcf49cbb5, user_id=29723dfbf51940f294643a7abefb3998, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.905487 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193f036-994a-430d-8dea-55fc6caa3cba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.928752 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4206/8395] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:55 2022] PUT /identity/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5/users/29723dfbf51940f294643a7abefb3998/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:55.938100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.938451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.938846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.979381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] MFA Rules not processed for user `29723dfbf51940f294643a7abefb3998`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:55.981912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.068832 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4190/8396] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:56.080403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.080691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.080973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.124509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] MFA Rules not processed for user `e4f863d5b33d4f10a053481933f03555`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:56.125752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.181909 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4207/8397] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 31 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:56.188138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.200222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a31dab-48f2-4e73-bf98-7ca9e9a8fe7c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.215560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.217082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.217478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.217955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.234714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.235905 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.258365 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4191/8398] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:59.830147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:59.924378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c0ef8-8252-41d7-aa0d-76bcb1085ff5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:59.928630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:59.929407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:59.929690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:59.929963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] PATH_INFO: `/v3/users/0bfc49f6899749b59ddd0751ef8374fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:59.931161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfc49f6899749b59ddd0751ef8374fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:59.933105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:00.006510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:00.008329 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:00.090004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e648ce-8bd8-48d5-b02c-8b20124ba80e service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:00.094377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:00.095017 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:00.095296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:00.095566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:00.097342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:00.114475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:00.116457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa027e-53d3-4ce4-b779-10ce1b7e4191 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:00.136513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4192/8399] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:00.280302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfc49f6899749b59ddd0751ef8374fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:00.281707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfc49f6899749b59ddd0751ef8374fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:00.370797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfc49f6899749b59ddd0751ef8374fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:00.390154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfc49f6899749b59ddd0751ef8374fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:00.392578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfc49f6899749b59ddd0751ef8374fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:00.406444 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4208/8400] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:59 2022] DELETE /identity/v3/users/0bfc49f6899749b59ddd0751ef8374fe => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:00.411280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:00.411561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:00.411836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:00.432985 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:00.436949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:00.473333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:00.542094 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4193/8401] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:00.552897 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:00.556513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:00.568295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:00.652726 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8e871-f18a-4782-a686-0c60d2277432 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:00.658482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:00.660338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:00.660338 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:00.660748 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:00.673254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:00.675135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:00.695068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4209/8402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:01.568692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:01.570159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:01.589193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f30d-13c1-41c8-8bde-38216805dc04 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:01.599966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:01.601966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:01.602402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:01.602894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] PATH_INFO: `/v3/projects/6d958e1a08314f9cb8612c2c92ac131b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:01.608458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d958e1a08314f9cb8612c2c92ac131b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:01.612384 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:01.870038 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d958e1a08314f9cb8612c2c92ac131b', 'request_id': 'req-03f91a82-8db1-4eae-879f-ed61ff978fce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.006752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d958e1a08314f9cb8612c2c92ac131b', 'request_id': 'req-03f91a82-8db1-4eae-879f-ed61ff978fce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.014021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d958e1a08314f9cb8612c2c92ac131b', 'request_id': 'req-03f91a82-8db1-4eae-879f-ed61ff978fce'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.026579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] The token cache is being invalidate because project 6d958e1a08314f9cb8612c2c92ac131b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:02.026911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.027612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.032581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4194/8403] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:01 2022] DELETE /identity/v3/projects/6d958e1a08314f9cb8612c2c92ac131b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:02.034867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:02.046418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e572-efdf-4a59-bac8-d5fbfd1f1441 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:02.116725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:02.117946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:02.118425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:02.118871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] PATH_INFO: `/v3/users/29723dfbf51940f294643a7abefb3998` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:02.121306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=29723dfbf51940f294643a7abefb3998)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:02.124898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:02.356527 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29723dfbf51940f294643a7abefb3998'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.358728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29723dfbf51940f294643a7abefb3998'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.474462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29723dfbf51940f294643a7abefb3998'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.504713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29723dfbf51940f294643a7abefb3998'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.505516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-992c4148-9be5-47c5-8052-4bfc16d0f4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29723dfbf51940f294643a7abefb3998'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.535606 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4210/8404] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:02 2022] DELETE /identity/v3/users/29723dfbf51940f294643a7abefb3998 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:03.081379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:03.083655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:03.109403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91a82-8db1-4eae-879f-ed61ff978fce admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:03.190427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:03.191152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.191430 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.191700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] PATH_INFO: `/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.192877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61f6804bb9c4a90b378ba1bcf49cbb5)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:03.195171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:03.359380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:03.361467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61f6804bb9c4a90b378ba1bcf49cbb5', 'request_id': 'req-75830651-f0ac-45ba-9c25-dc7146c25168'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.427907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61f6804bb9c4a90b378ba1bcf49cbb5', 'request_id': 'req-75830651-f0ac-45ba-9c25-dc7146c25168'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.435013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61f6804bb9c4a90b378ba1bcf49cbb5', 'request_id': 'req-75830651-f0ac-45ba-9c25-dc7146c25168'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.448407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] The token cache is being invalidate because project a61f6804bb9c4a90b378ba1bcf49cbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:03.448891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.449526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-75830651-f0ac-45ba-9c25-dc7146c25168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.451913 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4195/8405] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:03 2022] DELETE /identity/v3/projects/a61f6804bb9c4a90b378ba1bcf49cbb5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:03.460773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.461455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.461455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.483526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:03.484852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:03.517854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:03.569343 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4211/8406] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:03.571757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.572229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.573221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.600479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:03.601847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:03.616491 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4196/8407] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:03.616848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:03.628469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962bd6-0f8a-4a42-8022-2bfaaa1bac3a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:03.637565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:03.639003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.639387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.640273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.641017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:03.641462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:03.643351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:03.664920 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4212/8408] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:10:03.669221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:03.683479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0cdd-523f-47c6-aac6-b6acd43b1dc0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:03.689620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:03.690173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.690786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.690878 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.691671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:03.693852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.010204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4197/8409] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:03 2022] POST /identity/v3/projects => generated 399 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:04.011507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.024266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1d49-879b-4344-9366-f302bf8289ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.122844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.123831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.124374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.124830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.125917 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.129655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.280289 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4213/8410] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:04 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:04.282212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.296141 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51717372-2338-403e-9dd7-461fe7cc935b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.304945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.306006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.306398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.306755 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.307745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.309503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.330601 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4198/8411] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:04.334794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.357606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7cf38-110f-4304-9f7c-c70c16df2cf4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.362872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.363563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.363851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.364126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.364786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.366584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe6ee-d474-4f9a-8e41-881c61a2bffd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.393494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4214/8412] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:04.394150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.404603 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251159b-f767-41c5-8138-cdde740123e1 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.414066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.416096 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.416382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.417890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] PATH_INFO: `/v3/projects/0b46c9b5d5f94a859e35f0fe58a90245/users/d096f4b342b74ec9b9765e9e840a316d/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.436796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b46c9b5d5f94a859e35f0fe58a90245, user_id=d096f4b342b74ec9b9765e9e840a316d, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.439682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.597718 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4199/8413] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:04 2022] PUT /identity/v3/projects/0b46c9b5d5f94a859e35f0fe58a90245/users/d096f4b342b74ec9b9765e9e840a316d/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:04.603390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.604007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.604007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.635063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] MFA Rules not processed for user `d096f4b342b74ec9b9765e9e840a316d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:04.636424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:04.726745 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4215/8414] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:04.731566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.804825 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e02556-a0b8-4297-878d-0bae25732218 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.809945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.811114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.811394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.811666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.812306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.814421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.910367 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4200/8415] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:04 2022] POST /identity/v3/projects => generated 401 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:04.914908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.927591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439472ba-0c61-4d4f-8eb6-4b6f1fea48ff None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.948279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:05.000125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.000743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.001017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.001283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.001909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.003873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.176814 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4216/8416] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:04 2022] POST /identity/v3/users => generated 307 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:05.179223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.201303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2af7-7d98-4a54-88e6-894015e959aa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.210901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.212398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.213235 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.214084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.215427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.219300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.242553 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4201/8417] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:05.247789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.265410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef75d1-ade7-4266-976b-4ed77e8e88af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.273252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.273974 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.274258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.274535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] PATH_INFO: `/v3/projects/36cf5507b9b24a58a647efc46ac17ec4/users/b93593f38a4342059b4a0e9bf6827487/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.301214 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cf5507b9b24a58a647efc46ac17ec4, user_id=b93593f38a4342059b4a0e9bf6827487, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.303913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.412783 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4217/8418] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:05 2022] PUT /identity/v3/projects/36cf5507b9b24a58a647efc46ac17ec4/users/b93593f38a4342059b4a0e9bf6827487/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:05.416840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.430039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be368b-e5e6-4d73-8b52-0b11fad7d26b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.482528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:05.500466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.501089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.501367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.501634 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.502286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.503953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba24f0-b376-42cf-8c61-c8985adb1c82 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.515427 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4202/8419] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:05.520641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.532292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d356-7ce8-400a-bd7c-03de772cc32b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.537577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.538257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.538537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.538849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] PATH_INFO: `/v3/projects/36cf5507b9b24a58a647efc46ac17ec4/users/b93593f38a4342059b4a0e9bf6827487/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.542373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cf5507b9b24a58a647efc46ac17ec4, user_id=b93593f38a4342059b4a0e9bf6827487, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.545161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.557964 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4218/8420] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:05 2022] PUT /identity/v3/projects/36cf5507b9b24a58a647efc46ac17ec4/users/b93593f38a4342059b4a0e9bf6827487/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:05.570011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.570350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.570571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.606292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] MFA Rules not processed for user `b93593f38a4342059b4a0e9bf6827487`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:05.607557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:05.710557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4203/8421] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:05.725749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.728153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:05.802967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093536b-36e8-40c6-8923-5ad0fcde85e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.807686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.808305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.808583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.809031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.819818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.821367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.834480 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4219/8422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:06.055077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.065415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770841-9a17-4fc1-a0ba-6d02b485b22b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.068932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.069538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.069813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.070081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.135401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.137160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.148122 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4204/8423] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:09.836102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:09.837555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:09.914688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82895ee-2026-4858-912f-085cffa41133 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:09.922526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:09.923839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:09.924398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:09.924961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] PATH_INFO: `/v3/users/48118e993f724d93a15ec0636bf27517` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:09.927907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48118e993f724d93a15ec0636bf27517)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:09.932458 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:09.956381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:10.243835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48118e993f724d93a15ec0636bf27517'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:10.244547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48118e993f724d93a15ec0636bf27517'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:10.318688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48118e993f724d93a15ec0636bf27517'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:10.333456 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48118e993f724d93a15ec0636bf27517'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:10.334361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48118e993f724d93a15ec0636bf27517'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:10.352080 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4220/8424] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:09 2022] DELETE /identity/v3/users/48118e993f724d93a15ec0636bf27517 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:10.698323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:10.721349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72217-2aea-4dbb-97dc-b4ab7995d37a service cinder] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:10.795729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:10.796733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:10.796733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:10.797034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] PATH_INFO: `/v3/projects/39fe4d501c4347d1a15c95926035e4cc` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:10.798065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fe4d501c4347d1a15c95926035e4cc)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:10.800072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:10.810295 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:10.940533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fe4d501c4347d1a15c95926035e4cc', 'request_id': 'req-aa33c637-d2ab-4082-80c6-eb97ac954b3a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.044060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fe4d501c4347d1a15c95926035e4cc', 'request_id': 'req-aa33c637-d2ab-4082-80c6-eb97ac954b3a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.050605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fe4d501c4347d1a15c95926035e4cc', 'request_id': 'req-aa33c637-d2ab-4082-80c6-eb97ac954b3a'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.079916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] The token cache is being invalidate because project 39fe4d501c4347d1a15c95926035e4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:11.080293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.081043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.082958 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4205/8425] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:10 2022] DELETE /identity/v3/projects/39fe4d501c4347d1a15c95926035e4cc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:11.086849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:11.088330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:11.107821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffe56-0e87-4ea3-a065-9f14cb72da8f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:11.181997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:11.182950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:11.183385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:11.184136 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] PATH_INFO: `/v3/users/265a5c993e724e1cbaf81fd8f92b5db9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:11.186686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265a5c993e724e1cbaf81fd8f92b5db9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:11.188886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:11.442314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265a5c993e724e1cbaf81fd8f92b5db9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.445178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265a5c993e724e1cbaf81fd8f92b5db9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.547188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265a5c993e724e1cbaf81fd8f92b5db9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.581701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265a5c993e724e1cbaf81fd8f92b5db9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.582448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265a5c993e724e1cbaf81fd8f92b5db9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:11.600107 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4221/8426] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:11 2022] DELETE /identity/v3/users/265a5c993e724e1cbaf81fd8f92b5db9 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:11.934063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:11.936733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:11.952316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33c637-d2ab-4082-80c6-eb97ac954b3a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:12.017847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:12.018486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:12.019136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:12.019420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] PATH_INFO: `/v3/projects/d75e7617beff49d0b16c7a3ead0986ff` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:12.020550 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75e7617beff49d0b16c7a3ead0986ff)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:12.023154 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:12.165361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75e7617beff49d0b16c7a3ead0986ff', 'request_id': 'req-687fee53-5098-49b6-9508-3144c584fbcf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:12.244395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75e7617beff49d0b16c7a3ead0986ff', 'request_id': 'req-687fee53-5098-49b6-9508-3144c584fbcf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:12.256268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75e7617beff49d0b16c7a3ead0986ff', 'request_id': 'req-687fee53-5098-49b6-9508-3144c584fbcf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:12.269588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] The token cache is being invalidate because project d75e7617beff49d0b16c7a3ead0986ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:12.269883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:12.270564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-687fee53-5098-49b6-9508-3144c584fbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:12.272249 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4206/8427] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:11 2022] DELETE /identity/v3/projects/d75e7617beff49d0b16c7a3ead0986ff => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:15.237856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:15.239983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:15.261921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95368f1-9581-44af-846c-8197a1e39250 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:15.279927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:15.341544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:15.342281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:15.342681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:15.342913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] PATH_INFO: `/v3/users/d096f4b342b74ec9b9765e9e840a316d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:15.344174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d096f4b342b74ec9b9765e9e840a316d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:15.346219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:15.629205 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd096f4b342b74ec9b9765e9e840a316d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:15.630304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd096f4b342b74ec9b9765e9e840a316d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:15.714352 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd096f4b342b74ec9b9765e9e840a316d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:15.729343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd096f4b342b74ec9b9765e9e840a316d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:15.730096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd096f4b342b74ec9b9765e9e840a316d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:15.744060 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4222/8428] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:15 2022] DELETE /identity/v3/users/d096f4b342b74ec9b9765e9e840a316d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:15.748804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:15.749604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:15.750045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:15.771155 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:15.772286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:15.800456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:15.848222 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4207/8429] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:15.859566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:15.861198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:15.927826 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7941-cb0b-4500-8ddf-5b9a7f6a46dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:15.933157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:15.933790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:15.934070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:15.934388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:15.946282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:15.946282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:15.956474 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4223/8430] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:16.352268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:16.353747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:16.437975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69333a9-54fe-4952-81e1-2c0baaae414d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:16.443955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:16.444590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:16.444847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:16.445137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:16.453753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:16.462924 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:16.464525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:16.477967 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4208/8431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:16.532806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:16.534786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:16.548986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7edeb-79c8-4957-ba5a-41d4ef17872b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:16.558235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:16.561885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:16.561885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:16.561885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] PATH_INFO: `/v3/projects/0b46c9b5d5f94a859e35f0fe58a90245` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:16.561885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b46c9b5d5f94a859e35f0fe58a90245)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:16.563499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:16.686973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:16.700394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b46c9b5d5f94a859e35f0fe58a90245', 'request_id': 'req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:16.797505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b46c9b5d5f94a859e35f0fe58a90245', 'request_id': 'req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:16.804510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b46c9b5d5f94a859e35f0fe58a90245', 'request_id': 'req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:16.818349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] The token cache is being invalidate because project 0b46c9b5d5f94a859e35f0fe58a90245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:16.818562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:16.819921 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:16.821031 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4224/8432] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:16 2022] DELETE /identity/v3/projects/0b46c9b5d5f94a859e35f0fe58a90245 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:16.825317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:16.837654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2773d9-73be-4ca7-a469-19c90b98c9b4 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:16.901270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:16.904608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:16.904608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:16.904608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] PATH_INFO: `/v3/users/b93593f38a4342059b4a0e9bf6827487` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:16.904608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93593f38a4342059b4a0e9bf6827487)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:16.905652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:17.153859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93593f38a4342059b4a0e9bf6827487'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:17.154567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93593f38a4342059b4a0e9bf6827487'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:17.221470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93593f38a4342059b4a0e9bf6827487'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:17.223113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:17.238012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93593f38a4342059b4a0e9bf6827487'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:17.238949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5c365d92-7ecc-4a31-8da0-786017b7d042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93593f38a4342059b4a0e9bf6827487'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:17.252315 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4209/8433] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:16 2022] DELETE /identity/v3/users/b93593f38a4342059b4a0e9bf6827487 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:17.811421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:17.814961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:17.835364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e6b9d-4b3a-4850-bcaa-b1e15cd8b64e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:17.904343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:17.904888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:17.905168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:17.905438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] PATH_INFO: `/v3/projects/36cf5507b9b24a58a647efc46ac17ec4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:17.906558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cf5507b9b24a58a647efc46ac17ec4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:17.908502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.182661 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cf5507b9b24a58a647efc46ac17ec4', 'request_id': 'req-c91e7d85-16a8-4c67-8aa1-572745041b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:18.323837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cf5507b9b24a58a647efc46ac17ec4', 'request_id': 'req-c91e7d85-16a8-4c67-8aa1-572745041b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:18.330142 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cf5507b9b24a58a647efc46ac17ec4', 'request_id': 'req-c91e7d85-16a8-4c67-8aa1-572745041b14'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:18.350927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] The token cache is being invalidate because project 36cf5507b9b24a58a647efc46ac17ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:18.351411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:18.352227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c91e7d85-16a8-4c67-8aa1-572745041b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:18.357978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4225/8434] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:17 2022] DELETE /identity/v3/projects/36cf5507b9b24a58a647efc46ac17ec4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:18.359971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.360459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.360727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.392702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:18.394043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:18.467654 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4210/8435] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:18.475233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.475596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.476056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.497096 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:18.498800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:18.506688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4226/8436] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:18.511434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.522094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95938c68-3c09-4fd2-9eb1-63cb38b42ae4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:18.528406 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:18.529026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.529309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.529600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.530343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:18.530724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:18.532379 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.550299 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4211/8437] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:18.555675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.570447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d098-8efe-420f-a21e-ea83a97d8a65 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:18.578918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:18.579641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.579931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.580212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.580848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:18.583004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.682184 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4227/8438] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:18 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:18.687156 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.701282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f67cd-5698-4bb7-900b-062d1234fb90 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:18.779347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:18.779971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.780247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.780591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.781341 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:18.783324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.891185 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4212/8439] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:18 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:18.895318 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.917290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8844c-b0cc-413c-bcb7-dbfb39a6692e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:18.923001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:18.928805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.928805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.928805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.928805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:18.928805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.938983 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4228/8440] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:18.942898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.954594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f084c-153a-4e9d-aa9f-1bfba7b7161d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:18.964579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:18.965620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:18.965620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:18.965837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:18.966593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:18.968584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ea392-d6c8-444d-b455-fd54ff4ed7b9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:18.981713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4213/8441] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:18.985829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:18.998204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be78ed-85e3-4ad5-a271-fe12d57a5faa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.004235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.005124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.005403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.005674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] PATH_INFO: `/v3/projects/4734cbbe53d34b6cba1cbd65c8de1461/users/c6c0452dd20f429ab12585da2d8c15ec/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.016301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:19.029025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4734cbbe53d34b6cba1cbd65c8de1461, user_id=c6c0452dd20f429ab12585da2d8c15ec, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.029025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.148945 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4229/8442] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:18 2022] PUT /identity/v3/projects/4734cbbe53d34b6cba1cbd65c8de1461/users/c6c0452dd20f429ab12585da2d8c15ec/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:19.159964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.160460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.160759 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.190015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] MFA Rules not processed for user `c6c0452dd20f429ab12585da2d8c15ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:19.191369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:19.220151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:19.261498 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4214/8443] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:19.267514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.334978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994b70-6690-4d73-b8b0-da9ba44ffe72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.339750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.340366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.340647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.340924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.341571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.343522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.440805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4230/8444] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:19 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:19.444939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.457151 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061e94-c8dc-4fe1-a50a-e331e5ae737e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.517906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.518427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.518739 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.519018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.519663 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.521601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.616447 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4215/8445] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:19 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:19.620651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.632553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7af2-f89e-4482-b174-6fbbbee1664d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.637867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.638509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.638863 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.639262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.639785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.641802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.653799 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4231/8446] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:19.658542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.670520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497603-88a3-43ae-ae7e-6e2344a9b8f6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.675478 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.676221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.676536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.676808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] PATH_INFO: `/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1/users/9862b5f502844362bea3f332252eaf93/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.693731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a641fcf81a704f02a74f4c9606b2e3e1, user_id=9862b5f502844362bea3f332252eaf93, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.696915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.770402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4216/8447] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:19 2022] PUT /identity/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1/users/9862b5f502844362bea3f332252eaf93/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:19.774454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.784889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681179-0a20-4b5d-a336-aec1d28b5425 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.843986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.844602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.844883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.845157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.845800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.847452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1316-5af0-4bd7-9b26-bcf90cdee2dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.862156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4232/8448] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:19.866553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:19.877943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04bfe9-5d8a-4bfe-9d52-d026fce1bf31 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:19.882778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:19.883425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.883701 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.883968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] PATH_INFO: `/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1/users/9862b5f502844362bea3f332252eaf93/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.885913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a641fcf81a704f02a74f4c9606b2e3e1, user_id=9862b5f502844362bea3f332252eaf93, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:19.888636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a80fa-9a65-4057-8437-6b701b725291 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:19.900086 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4217/8449] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:19 2022] PUT /identity/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1/users/9862b5f502844362bea3f332252eaf93/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:19.911430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:19.912001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:19.912001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:19.944975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] MFA Rules not processed for user `9862b5f502844362bea3f332252eaf93`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:19.946222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:19.994065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:20.019507 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4233/8450] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:20.030698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:20.031031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:20.031311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:20.052612 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] MFA Rules not processed for user `e4f863d5b33d4f10a053481933f03555`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:20.053862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:20.114521 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4218/8451] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Oct 31 15:10:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:20.120915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:20.130821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaedfec-17e9-49df-96e4-94c8842b52d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:20.134949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:20.135576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:20.135859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:20.136220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:20.146233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:20.147734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ebbb-0e4e-49b2-980c-29c2406a9ba5 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:20.158897 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4234/8452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:20.697414 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:20.735234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:20.771635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6984e-fa6d-4b9e-ab7a-0182435e9cf5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:20.776267 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:20.776912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:20.777192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:20.777492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] PATH_INFO: `/v3/users/c6c0452dd20f429ab12585da2d8c15ec` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:20.778687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c0452dd20f429ab12585da2d8c15ec)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:20.780706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:21.036210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c0452dd20f429ab12585da2d8c15ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:21.037424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c0452dd20f429ab12585da2d8c15ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:21.135186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c0452dd20f429ab12585da2d8c15ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:21.150332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c0452dd20f429ab12585da2d8c15ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:21.151193 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c0452dd20f429ab12585da2d8c15ec'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:21.165138 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4219/8453] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:20 2022] DELETE /identity/v3/users/c6c0452dd20f429ab12585da2d8c15ec => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:21.170221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:21.171055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:21.171055 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:21.191442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:21.192774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:21.280346 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4235/8454] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:21.290687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:21.292148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:21.364500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1f97-e0a3-4cc3-9400-4d5ad88a4999 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:21.373012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:21.373731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:21.374014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:21.374287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:21.391695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:21.393773 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:21.407031 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4220/8455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:21.943184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:21.944958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:21.958515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38e8c-670f-4435-8d39-366a47b3f67c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:21.963244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:21.963881 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:21.964168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:21.964593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] PATH_INFO: `/v3/projects/4734cbbe53d34b6cba1cbd65c8de1461` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:21.966332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4734cbbe53d34b6cba1cbd65c8de1461)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:21.968294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:22.086579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4734cbbe53d34b6cba1cbd65c8de1461', 'request_id': 'req-6b942988-d2c2-498f-aaeb-dc0840aad987'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.169887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4734cbbe53d34b6cba1cbd65c8de1461', 'request_id': 'req-6b942988-d2c2-498f-aaeb-dc0840aad987'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.176441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4734cbbe53d34b6cba1cbd65c8de1461', 'request_id': 'req-6b942988-d2c2-498f-aaeb-dc0840aad987'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.188657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] The token cache is being invalidate because project 4734cbbe53d34b6cba1cbd65c8de1461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:22.188877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.189498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.191110 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4236/8456] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:21 2022] DELETE /identity/v3/projects/4734cbbe53d34b6cba1cbd65c8de1461 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:22.195560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:22.206068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3158e-28bf-41a1-b691-db68141e469d service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:22.253285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:22.267507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:22.268146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:22.268423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:22.268691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] PATH_INFO: `/v3/users/9862b5f502844362bea3f332252eaf93` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:22.270026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9862b5f502844362bea3f332252eaf93)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:22.272009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:22.464010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9862b5f502844362bea3f332252eaf93'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.465041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9862b5f502844362bea3f332252eaf93'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.541006 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9862b5f502844362bea3f332252eaf93'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.556167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9862b5f502844362bea3f332252eaf93'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.556917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-605841a3-d1c0-4345-836c-ee8364cdc4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9862b5f502844362bea3f332252eaf93'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:22.572565 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4221/8457] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:22 2022] DELETE /identity/v3/users/9862b5f502844362bea3f332252eaf93 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:23.001120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.002568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:23.016500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942988-d2c2-498f-aaeb-dc0840aad987 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.077191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:23.086480 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.091528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.091528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.091528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] PATH_INFO: `/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.091528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a641fcf81a704f02a74f4c9606b2e3e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.091528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:23.218337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a641fcf81a704f02a74f4c9606b2e3e1', 'request_id': 'req-0a1783b2-033f-496c-b07b-643c23bb806a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:23.340598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a641fcf81a704f02a74f4c9606b2e3e1', 'request_id': 'req-0a1783b2-033f-496c-b07b-643c23bb806a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:23.348183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a641fcf81a704f02a74f4c9606b2e3e1', 'request_id': 'req-0a1783b2-033f-496c-b07b-643c23bb806a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:23.364868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] The token cache is being invalidate because project a641fcf81a704f02a74f4c9606b2e3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:23.365426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:23.366259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0a1783b2-033f-496c-b07b-643c23bb806a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:23.369770 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4237/8458] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:23 2022] DELETE /identity/v3/projects/a641fcf81a704f02a74f4c9606b2e3e1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:23.375331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.376238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.376648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.399577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:23.401383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:23.485463 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4222/8459] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:23.493586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.493878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.494152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.515775 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:23.516998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:23.525354 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4238/8460] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:23.530528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.541265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a8092-ca18-4b41-ac18-cd3a20c51422 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.546865 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.547492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.547771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.548041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.548699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:23.549758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.550952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:23.568335 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4223/8461] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:23.569392 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.579721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac47d8-f4b1-4db8-90f2-a47a1647d454 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.586045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.586804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.587146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.587425 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.588068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.590895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:23.739294 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4239/8462] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:23 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:23.743695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.755968 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b76dc-b10f-482c-bd96-fdd328b772c8 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.822140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:23.829425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.830310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.830756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.831031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.831949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.834168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:23.920402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4224/8463] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:23 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:23.924300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.937858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d951b1-181c-4c7c-9c20-f70bcfaac9a5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.943750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.945025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.945025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.945025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.945776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.947523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:23.962494 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4240/8464] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:23.964390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:23.976782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f53220-7885-4515-bb3d-73fe91cf4f0c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:23.982180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:23.982938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:23.983293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:23.983780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:23.984518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:23.986362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fd6c8-fbb7-44ff-b9ab-f7812d377118 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:24.002659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4225/8465] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:24.006902 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:24.018558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64449b30-b463-4e40-897f-2a0551c32a2a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:24.024612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:24.025821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.025821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.026117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] PATH_INFO: `/v3/projects/ac9b6033c3c14b7cb24cbbe1666086ff/users/6fe702ed19534a66bbf41fcbdb2bdf6b/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.050331 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9b6033c3c14b7cb24cbbe1666086ff, user_id=6fe702ed19534a66bbf41fcbdb2bdf6b, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:24.050854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:24.158954 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4241/8466] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:24 2022] PUT /identity/v3/projects/ac9b6033c3c14b7cb24cbbe1666086ff/users/6fe702ed19534a66bbf41fcbdb2bdf6b/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:24.170539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.170901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.171179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.203978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] MFA Rules not processed for user `6fe702ed19534a66bbf41fcbdb2bdf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:24.205195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:24.273340 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4226/8467] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:24.285469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:24.287280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:24.348003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473415f-b726-4173-bf12-3c8ef4204794 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:24.351861 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:24.352462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.352736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.353005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.362999 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:24.364442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4384-6b66-4679-b599-c9b75ba5b4f2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:24.374828 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4242/8468] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:24.397241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:24.466986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f4ade-35e2-43df-8963-0acfe52509fb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:24.471801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:24.472610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.472875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.473125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] PATH_INFO: `/v3/users/6fe702ed19534a66bbf41fcbdb2bdf6b` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.474330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe702ed19534a66bbf41fcbdb2bdf6b)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:24.476334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:24.670411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe702ed19534a66bbf41fcbdb2bdf6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:24.671148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe702ed19534a66bbf41fcbdb2bdf6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:24.786647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe702ed19534a66bbf41fcbdb2bdf6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:24.800909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:24.803365 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe702ed19534a66bbf41fcbdb2bdf6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:24.804113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe702ed19534a66bbf41fcbdb2bdf6b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:24.821591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4227/8469] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:24 2022] DELETE /identity/v3/users/6fe702ed19534a66bbf41fcbdb2bdf6b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:24.826732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.826940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.827221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.847422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:24.848632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:24.868419 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:24.912376 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4243/8470] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:24.922143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:24.923581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:24.983275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d484a6-03eb-4fdf-a857-71b6a0bf619d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:24.987051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:24.987670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:24.987931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:24.988214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:24.998106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:24.999599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:25.010950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4228/8471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:25.669719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:25.671751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:25.693530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:25.696036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:25.726792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a3da-0a7c-41f7-9848-15b945b1fa1a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:25.734757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:25.736249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:25.736648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:25.736921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] PATH_INFO: `/v3/projects/ac9b6033c3c14b7cb24cbbe1666086ff` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:25.747093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9b6033c3c14b7cb24cbbe1666086ff)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:25.747093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:25.780235 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975e72-2dac-4a25-a46a-14831bdf6b4c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:25.786841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:25.788913 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:25.789333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:25.789884 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:25.791839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:25.809956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:25.811668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:25.826074 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4244/8472] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:25.826951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:25.828472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:25.844623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203a06d-2925-469b-b34b-8d6e2c0723d9 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:25.850208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:25.850890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:25.851165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:25.851438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:25.853354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:25.877630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:25.879462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec13f72-7222-4f6a-839f-75d20001f0c0 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:25.887527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9b6033c3c14b7cb24cbbe1666086ff', 'request_id': 'req-66fc2a31-84b8-4483-9933-0b5186f5a955'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:25.894813 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4245/8473] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:25.969239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9b6033c3c14b7cb24cbbe1666086ff', 'request_id': 'req-66fc2a31-84b8-4483-9933-0b5186f5a955'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:25.975930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9b6033c3c14b7cb24cbbe1666086ff', 'request_id': 'req-66fc2a31-84b8-4483-9933-0b5186f5a955'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:25.989296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] The token cache is being invalidate because project ac9b6033c3c14b7cb24cbbe1666086ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:25.989790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:25.990497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-66fc2a31-84b8-4483-9933-0b5186f5a955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:25.992046 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4229/8474] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:25 2022] DELETE /identity/v3/projects/ac9b6033c3c14b7cb24cbbe1666086ff => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:25.997780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:25.998067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:25.998337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.019878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:26.024277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:26.108916 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4246/8475] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:26.119217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.119505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.119783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.141266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:26.142472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:26.154584 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4230/8476] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:26.158590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.169482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1119f-2486-46c1-90ba-4458a0dee40f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.176182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.176808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.177083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.177353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.178009 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:26.178312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.179968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.196045 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4247/8477] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:26.197330 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.207499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9f2db-5367-4c5a-84a4-25946c96aaf2 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.212203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.212803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.213332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.213607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.214456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.217018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.308164 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4231/8478] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:26 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:26.312122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.322474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea9a64-3caa-43f8-8e6b-57f684c87ae3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.347927 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:26.381334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.381940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.382217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.382486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.383141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.385029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.553351 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4248/8479] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:26 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:26.557876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.569466 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaa9b8-22f9-4700-b9f6-cf9f00b4a137 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.574952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.575572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.575850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.576123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.576804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.578422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.589645 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4232/8480] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:26.599514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.609909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f6b5-047a-4bd1-bd07-b90855e4010a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.614572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.615211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.615491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.615761 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.616400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.618003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a1121-7151-46f3-af6f-2906aecfdf7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.628629 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4249/8481] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:26.633097 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.643809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f5932-10d2-4a0c-9055-9879c657fdd3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.648461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.649112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.649389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.649652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] PATH_INFO: `/v3/projects/91c3c27c555140dfbe47c21434c955b0/users/2314fe712f86410082d6d889cd2041e2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.665706 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c3c27c555140dfbe47c21434c955b0, user_id=2314fe712f86410082d6d889cd2041e2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:26.668418 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:26.787895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4233/8482] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:26 2022] PUT /identity/v3/projects/91c3c27c555140dfbe47c21434c955b0/users/2314fe712f86410082d6d889cd2041e2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:26.798427 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.799232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.799232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:26.830200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] MFA Rules not processed for user `2314fe712f86410082d6d889cd2041e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:26.831351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:26.901189 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4250/8483] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:26.920246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:26.922171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:26.932440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:26.991876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18c0c2-b3b2-48fa-9c16-3489b49940c9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:26.995752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:26.997034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:26.997311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:26.997578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:27.014521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:27.016624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db1bd2-aec8-49d2-ba06-135ecdf5c5bf service cinder] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:27.027300 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4234/8484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:27.057865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:27.144941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e452a9-575e-4351-9aa5-e1e6f3b2fcf2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:27.149724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:27.150522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:27.150841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:27.151120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] PATH_INFO: `/v3/users/2314fe712f86410082d6d889cd2041e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:27.152353 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2314fe712f86410082d6d889cd2041e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:27.154281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:27.474141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:27.488578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2314fe712f86410082d6d889cd2041e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:27.488578 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2314fe712f86410082d6d889cd2041e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:27.729315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2314fe712f86410082d6d889cd2041e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:27.747071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2314fe712f86410082d6d889cd2041e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:27.747986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2314fe712f86410082d6d889cd2041e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:27.761404 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4251/8485] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:27 2022] DELETE /identity/v3/users/2314fe712f86410082d6d889cd2041e2 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:27.765978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:27.766268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:27.766680 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:27.792860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:27.795552 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:27.883350 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4235/8486] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:27.894202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:27.895794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:27.957842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ba8f-e2a3-411c-9f8f-5dd0af60adf7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:27.961941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:27.962610 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:27.962975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:27.963253 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:27.975734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:27.977075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:27.987943 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4252/8487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:28.721441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:28.723794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:28.738119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ba81e-6b9d-4800-812d-31d54eb71132 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:28.744529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:28.765945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:28.766245 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:28.766521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] PATH_INFO: `/v3/projects/91c3c27c555140dfbe47c21434c955b0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:28.771495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c3c27c555140dfbe47c21434c955b0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:28.773499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:28.940258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c3c27c555140dfbe47c21434c955b0', 'request_id': 'req-8e6057f0-af03-4575-b67c-c0cb592d8ddf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:29.044776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c3c27c555140dfbe47c21434c955b0', 'request_id': 'req-8e6057f0-af03-4575-b67c-c0cb592d8ddf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:29.051685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c3c27c555140dfbe47c21434c955b0', 'request_id': 'req-8e6057f0-af03-4575-b67c-c0cb592d8ddf'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:29.063832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] The token cache is being invalidate because project 91c3c27c555140dfbe47c21434c955b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:29.064149 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:29.064787 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:29.066285 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4236/8488] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:28 2022] DELETE /identity/v3/projects/91c3c27c555140dfbe47c21434c955b0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:37.983424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:39.060669 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:12.068104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:12.070259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:12.147698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44610f-74f6-4dcb-bbd6-bc066e0287fb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:12.213114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:12.213742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:12.214222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:12.214375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:12.216250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:12.259641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:12.261058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25075833-4a02-4da1-a8e6-de88a1b74f4a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:12.278280 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4253/8489] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:12.727833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:12.729264 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:12.809474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6057f0-af03-4575-b67c-c0cb592d8ddf admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:12.815037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:12.815661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:12.815973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:12.816252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:12.818145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:12.879957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:12.881630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:12.892204 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4237/8490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:22.267394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=58 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:22.779060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:22.779369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:22.779673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:22.801161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] MFA Rules not processed for user `8ee06c8e55ff40c38321f01491099d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:22.802387 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:22.809978 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4254/8491] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:22.887475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=56 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:32.793838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:37.906643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:37.908115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:37.980292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67b32-603d-4aae-871b-5147a8f28353 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:37.984056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:37.984666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:37.984946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:37.985242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:37.987069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:38.076178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:38.077605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:38.088335 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4238/8492] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:48.086963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=65 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:15.831756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:15.833351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:15.900097 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac240-fe8c-43e9-a41f-5cc87392b81d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:15.906844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:15.917448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:15.917448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:15.917448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:15.917448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:15.924532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:15.927448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:15.941379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4255/8493] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:12:21.150058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:21.168538 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66749eb-9924-47e3-b4ed-8370ca267d0a service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:21.169966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:21.170572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:21.170886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:21.171180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:21.172923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:21.189775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:21.191293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b35b92-9474-4f3f-b8c1-2e3d6df198a1 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:21.205557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4239/8494] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:22.402562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:22.412788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29038e2a-dc99-44de-9651-02ac85c5f62c service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:22.417131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:22.417760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:22.418037 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:22.418334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:22.420230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:22.438854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:22.440283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:22.454165 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4256/8495] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:31.204403 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:32.446267 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:49.198772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda7f3-8733-47df-b89e-8f40fe142160 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:49.198772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda7f3-8733-47df-b89e-8f40fe142160 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:49.198772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda7f3-8733-47df-b89e-8f40fe142160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:49.224546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-80eda7f3-8733-47df-b89e-8f40fe142160 None None] MFA Rules not processed for user `8ee06c8e55ff40c38321f01491099d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:49.225774 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-80eda7f3-8733-47df-b89e-8f40fe142160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:49.233111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4240/8496] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:12:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:49.629319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:49.639560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba407-d26e-4e68-a70f-9a247c81f31e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:49.679498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:49.679498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:49.679498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:49.679498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:49.681669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:49.724882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:49.726358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:49.742870 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4257/8497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:50.298990 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315dccb-b401-4dd2-814f-c7dd32123296 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:50.299542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315dccb-b401-4dd2-814f-c7dd32123296 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:50.299883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315dccb-b401-4dd2-814f-c7dd32123296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:50.331174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4315dccb-b401-4dd2-814f-c7dd32123296 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:50.334370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4315dccb-b401-4dd2-814f-c7dd32123296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:50.343264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4241/8498] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:50.350824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:50.380396 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc28ce-7acf-4178-b108-fc82343b2a99 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:50.386689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:50.387767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:50.388245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:50.389215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:50.391209 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:50.431577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:50.433355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:50.445398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4258/8499] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:51.933874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:51.934450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:51.934450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:51.971162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:51.972460 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:51.985890 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4242/8500] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:52.005993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:52.006806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:52.028215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e954e9-ae69-46e9-a844-22fd5821fc49 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:52.039993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:52.039993 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:52.040614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:52.040995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:52.052438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:52.054065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4249c-9b45-46b6-9f96-66457a8f1b00 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:52.066086 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4259/8501] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:01.448889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:01.450463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:01.469512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb415-790f-41b6-9d0a-33958409306a None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:01.475174 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:01.475793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:01.476074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:01.476342 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:01.478735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:01.494051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:01.495682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:01.510700 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4243/8502] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:02.060952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=23 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:11.502190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=15 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:33.734490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572270-210d-49c4-a59f-55176b17c835 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:33.735103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572270-210d-49c4-a59f-55176b17c835 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:33.735103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62572270-210d-49c4-a59f-55176b17c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:33.755643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-62572270-210d-49c4-a59f-55176b17c835 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:33.756873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-62572270-210d-49c4-a59f-55176b17c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:33.765632 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4260/8503] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 31 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:33.782998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:33.798139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dd478-143d-43ca-9b8a-d241adc13ed6 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:33.803221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:33.803823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:33.804113 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:33.804362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:33.813982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:33.815629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:33.826585 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4244/8504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:43.749951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:43.821627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:32.644530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572270-210d-49c4-a59f-55176b17c835 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:32.646949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-62572270-210d-49c4-a59f-55176b17c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:32.659945 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62572270-210d-49c4-a59f-55176b17c835 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:32.664492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:32.665135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:32.665415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:32.665687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:32.667561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:32.680232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:32.682146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:32.693530 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4261/8505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:40.211766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:40.225441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54708ba-3de8-43ba-b4db-a20422d68ff3 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:40.230725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:40.231336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:40.231608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:40.231970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:40.233708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:40.249142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:40.250856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078ccee-d5ee-4076-bf08-e81c9fc9fd3b service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:40.269404 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4245/8506] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:40.722210 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:40.723704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:40.810940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f7e01-36ef-44ac-a026-42677c51bc6c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:40.815413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:40.816015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:40.816313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:40.816581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] PATH_INFO: `/v3/users/8ee06c8e55ff40c38321f01491099d47` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:40.817694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee06c8e55ff40c38321f01491099d47)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:40.819616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:41.009492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee06c8e55ff40c38321f01491099d47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.010135 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee06c8e55ff40c38321f01491099d47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.104114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee06c8e55ff40c38321f01491099d47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.117337 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee06c8e55ff40c38321f01491099d47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.118061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee06c8e55ff40c38321f01491099d47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.130289 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4262/8507] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:14:40 2022] DELETE /identity/v3/users/8ee06c8e55ff40c38321f01491099d47 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:41.135505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:41.135791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:41.136068 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:41.164104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:41.165301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:41.224017 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4246/8508] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:14:41.235033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:41.236475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:41.288103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:41.294187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199adb17-1618-4436-b262-1d2380df2d73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:41.299249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:41.299249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:41.299249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:41.299249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:41.309242 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:41.310729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:41.321879 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4263/8509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:14:41.604449 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:41.605943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:41.619750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c9c49-0c9f-4127-af50-a846c386d693 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:41.624240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:41.624899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:41.625184 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:41.625456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] PATH_INFO: `/v3/projects/976a0ef7e6fa42e0bcd24fcf3bc1a441` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:41.626709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] RBAC: Authorizing `identity:delete_project(project_id=976a0ef7e6fa42e0bcd24fcf3bc1a441)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:41.628619 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:41.749440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976a0ef7e6fa42e0bcd24fcf3bc1a441', 'request_id': 'req-b2b08a6b-4037-4617-81f1-22941ae9890e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.865146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976a0ef7e6fa42e0bcd24fcf3bc1a441', 'request_id': 'req-b2b08a6b-4037-4617-81f1-22941ae9890e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.871864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976a0ef7e6fa42e0bcd24fcf3bc1a441', 'request_id': 'req-b2b08a6b-4037-4617-81f1-22941ae9890e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.884014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] The token cache is being invalidate because project 976a0ef7e6fa42e0bcd24fcf3bc1a441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:14:41.884291 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.884953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:41.886444 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4247/8510] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:14:41 2022] DELETE /identity/v3/projects/976a0ef7e6fa42e0bcd24fcf3bc1a441 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:41.890513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:41.901032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aaaae-d635-4643-807b-d151789096ad service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:41.957698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:41.958324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:41.958604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:41.958936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] PATH_INFO: `/v3/users/4db70bce50e7405a99ad45ed4edc016d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:41.960054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db70bce50e7405a99ad45ed4edc016d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:41.962606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:42.216977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db70bce50e7405a99ad45ed4edc016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.217658 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db70bce50e7405a99ad45ed4edc016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.300226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db70bce50e7405a99ad45ed4edc016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.314432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db70bce50e7405a99ad45ed4edc016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.315151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e64f22c-66d0-4181-95f8-1fbb67f11d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db70bce50e7405a99ad45ed4edc016d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.328195 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4264/8511] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:14:41 2022] DELETE /identity/v3/users/4db70bce50e7405a99ad45ed4edc016d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:42.597946 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:42.599515 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:42.615962 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08a6b-4037-4617-81f1-22941ae9890e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:42.681103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:42.681761 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:42.682041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:42.682313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] PATH_INFO: `/v3/projects/47b2a3d4208c41f8a97269996638b4a0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:42.683608 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b2a3d4208c41f8a97269996638b4a0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:42.685571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:42.692659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:42.851670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b2a3d4208c41f8a97269996638b4a0', 'request_id': 'req-078fb687-0369-4600-91a0-082865dac06e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.955863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b2a3d4208c41f8a97269996638b4a0', 'request_id': 'req-078fb687-0369-4600-91a0-082865dac06e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.962071 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b2a3d4208c41f8a97269996638b4a0', 'request_id': 'req-078fb687-0369-4600-91a0-082865dac06e'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.973683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] The token cache is being invalidate because project 47b2a3d4208c41f8a97269996638b4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:14:42.973972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.974605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-078fb687-0369-4600-91a0-082865dac06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:14:42.976133 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4248/8512] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:14:42 2022] DELETE /identity/v3/projects/47b2a3d4208c41f8a97269996638b4a0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:52.324651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:52.970480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:53.427388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:53.428567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:53.428567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:53.451068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:53.452737 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:53.538206 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4265/8513] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:53.550402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:53.550725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:53.551007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:53.571585 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:53.572860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:53.582713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4249/8514] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:53.590426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:53.606907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22262e5-e465-4d8f-94f9-57d801159cd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:53.613494 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:53.614549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:53.615120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:53.615736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:53.616852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:14:53.617436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:53.620625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:53.635111 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4266/8515] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:14:53.647215 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:53.657400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcede777-a303-471a-bf9b-966687d8f5bb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:53.662348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:53.662979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:53.663261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:53.663537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:53.664722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:53.666640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:53.780869 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4250/8516] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:14:53 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:14:53.785995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:53.799932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4858c-adb2-4855-b820-28f91233ca5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:53.869584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:53.870237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:53.870521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:53.870845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:53.871500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:53.873479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:53.980638 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4267/8517] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:14:53 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:14:53.985066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:53.998661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911761a-780f-4f67-a228-029e28a7487d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.003801 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.004408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.004682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.004952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.005590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.007964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.018559 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4251/8518] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:14:54.022758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.033943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c3b-b1b5-4b40-8c1b-532b359d1b6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.038638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.039270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.039550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.039820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.040484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.042109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b363-bf0c-4dde-90fd-2731816ee76d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.055571 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4268/8519] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:14:54.059788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.070930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cb74f-ba97-4210-b5f9-225b61710f61 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.075656 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.076304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.076581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.076856 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] PATH_INFO: `/v3/projects/68fd01ce406546d980f91fc7cad740a0/users/d6f3e062598141a2b9891f5fefd20fa0/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.092564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fd01ce406546d980f91fc7cad740a0, user_id=d6f3e062598141a2b9891f5fefd20fa0, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.095270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.162330 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4252/8520] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:14:54 2022] PUT /identity/v3/projects/68fd01ce406546d980f91fc7cad740a0/users/d6f3e062598141a2b9891f5fefd20fa0/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:54.179713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.179995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.180266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.210309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] MFA Rules not processed for user `d6f3e062598141a2b9891f5fefd20fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:54.212239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:54.270303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:54.280636 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4269/8521] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:54.285567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.355802 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ffd3f-91f8-486e-ba73-3d1e2c23f15c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.360511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.361115 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.361390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.361659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.362284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.364234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.471952 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4253/8522] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:14:54 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:14:54.476158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.486932 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f727d0-ede8-4f5e-a5b6-02963a356ef7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.545797 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.546321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.546601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.546900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.547545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.549543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.693880 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4270/8523] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:14:54 2022] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:14:54.697992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.708480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5dbb0-d5a2-4d35-9c52-60691682104b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.713247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.713859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.714183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.714452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.715194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.716892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.731620 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4254/8524] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:14:54.736025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.747124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709bc9-5e60-45a1-bc85-df7574d91fef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.751763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.752370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.752651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.752931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] PATH_INFO: `/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.768330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5507bfe6bf4fde94c8f3978044e65a, user_id=b0ff7d6f2f32496ea1d70a00a5a1d4f6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.771103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.853674 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4271/8525] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:14:54 2022] PUT /identity/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:54.858671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.869722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0cf4c-49cf-4146-aa8b-d0d78ff845f6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.932757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.933693 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.934036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.934428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.935470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.937915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6d308-0ec1-4254-8242-df473e8a3617 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.953277 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4255/8526] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:14:54.957954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:54.968547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256b73-1cfa-4d29-bfbb-fe3264c82135 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:54.973360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:54.974020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:54.974297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:54.974576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] PATH_INFO: `/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:54.977108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5507bfe6bf4fde94c8f3978044e65a, user_id=b0ff7d6f2f32496ea1d70a00a5a1d4f6, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:54.979789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2cc29-b4dd-410a-af58-2dcff9e1d7ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:54.990268 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4272/8527] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:14:54 2022] PUT /identity/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:14:55.001417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409927-870f-46b7-9d7d-4559230d9b38 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:55.001938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409927-870f-46b7-9d7d-4559230d9b38 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:55.002043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409927-870f-46b7-9d7d-4559230d9b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:55.016129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:55.031658 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-69409927-870f-46b7-9d7d-4559230d9b38 None None] MFA Rules not processed for user `b0ff7d6f2f32496ea1d70a00a5a1d4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:55.032961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-69409927-870f-46b7-9d7d-4559230d9b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:55.108537 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4256/8528] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:55.121895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:55.122189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:55.122451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:55.142714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] MFA Rules not processed for user `d6f3e062598141a2b9891f5fefd20fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:55.143926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:55.202718 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4273/8529] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:14:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:55.220835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f69a-d035-4b8a-9461-73a012aca9c4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:55.220835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f69a-d035-4b8a-9461-73a012aca9c4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:55.220835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f69a-d035-4b8a-9461-73a012aca9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:55.266817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-7ea8f69a-d035-4b8a-9461-73a012aca9c4 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:55.268029 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7ea8f69a-d035-4b8a-9461-73a012aca9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:55.340223 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4257/8530] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 15:14:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:55.346765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:55.363688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e417c4-8e2b-4a89-a4fe-a1b9957fbf55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:55.368657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:55.369635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:55.370024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:55.370436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:55.381211 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:55.383765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb01ee-6922-4b3e-aab9-273224a13e08 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:55.394371 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4274/8531] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:56.016997 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:56.017655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:56.017655 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:56.039063 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:56.040722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:56.051368 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4258/8532] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 15:14:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:15:01.576947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c201-2211-4938-9c8f-da06a11a0ba2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:01.577533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c201-2211-4938-9c8f-da06a11a0ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:01.577533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460c201-2211-4938-9c8f-da06a11a0ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:01.597348 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9460c201-2211-4938-9c8f-da06a11a0ba2 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:01.598642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9460c201-2211-4938-9c8f-da06a11a0ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:01.609529 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4275/8533] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:01.635882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:01.637319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:01.703088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7999a-e997-4562-bdfb-4a367c2bcdd6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:01.716007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:01.716769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:01.718088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:01.718088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:01.733593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:01.733593 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:01.748789 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4259/8534] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:04.189672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935fbb-4a63-4105-912d-df8c0a4953d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:04.190283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935fbb-4a63-4105-912d-df8c0a4953d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:04.190283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d935fbb-4a63-4105-912d-df8c0a4953d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:04.210648 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d935fbb-4a63-4105-912d-df8c0a4953d7 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:04.211839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d935fbb-4a63-4105-912d-df8c0a4953d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:04.221138 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4276/8535] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:04.231886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:04.240726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330b33-4018-4f2c-8b2f-2638b1d4dede service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:04.244866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:04.245458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:04.245736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:04.246011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:04.253214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=100 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:04.257073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:04.259039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:04.270111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4260/8536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:09.982415 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:09.983593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:09.983593 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:10.004431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:10.005992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:10.013283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4277/8537] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 31 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:10.028251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:10.044089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077a8a-0653-4308-b469-b47414f64bcf service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:10.048457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:10.049056 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:10.049331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:10.049633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:10.058211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:10.059716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44778ef1-0d7b-4bdc-8c7c-3f43ac4f9775 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:10.067861 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4261/8538] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:12.685544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:12.698635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137a73d-33c3-4536-b7ca-b326ce1e61bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:12.704451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:12.704997 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:12.705274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:12.705545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:12.715808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:12.717471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:12.728342 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4278/8539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:12.745491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12468290-eb69-4074-a8e1-29236559f6cf None None] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:12.745995 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12468290-eb69-4074-a8e1-29236559f6cf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:12.746126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12468290-eb69-4074-a8e1-29236559f6cf None None] PATH_INFO: `/` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:12.747453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4262/8540] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:15:12.752303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 15:15:12.763752 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:12.767545 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:12.772594 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62da1-7674-4313-9eca-9240776380b3 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:12.777361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc5507bfe6bf4fde94c8f3978044e65a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:12.780722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:12.780722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:12.780722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] PATH_INFO: `/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:12.780722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: Authorizing `identity:get_project(project_id=dc5507bfe6bf4fde94c8f3978044e65a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:12.781548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059213d0-00da-43f9-aa93-4e6b84d6cec7 tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:12.783304 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4279/8541] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 15:15:12 2022] GET /identity/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a => generated 393 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:15:13.003682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12468290-eb69-4074-a8e1-29236559f6cf None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:13.014611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12468290-eb69-4074-a8e1-29236559f6cf None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:13.018196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:13.018893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:13.021454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:13.021454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:13.021454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:13.034807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:13.036397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:13.048368 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4263/8542] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:13.258572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b34-fd00-4b63-87af-64880e076acb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:13.259085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b34-fd00-4b63-87af-64880e076acb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:13.259671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6b34-fd00-4b63-87af-64880e076acb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:13.262049 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4280/8543] 10.222.0.13 () {54 vars in 912 bytes} [Mon Oct 31 15:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:15:13.267051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] Authenticating service token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 31 15:15:13.282072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:13.293627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791972d-b909-4f57-bd07-c48ea8deadfc service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:13.298471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc5507bfe6bf4fde94c8f3978044e65a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:13.299145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:13.299429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:13.299707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] PATH_INFO: `/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:13.300861 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: Authorizing `identity:get_project(project_id=dc5507bfe6bf4fde94c8f3978044e65a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:13.302710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:13.304394 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4264/8544] 10.222.0.13 () {58 vars in 1443 bytes} [Mon Oct 31 15:15:13 2022] GET /identity/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:15:16.018515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:16.019107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:16.019107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:16.040367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:16.041590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:16.051440 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4281/8545] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:16.065275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:16.078536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2e08-889a-47ce-bfe4-d9262b5e487c tempest-ServersAdminNegativeTestJSON-1484518843 tempest-ServersAdminNegativeTestJSON-1484518843-project-admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:16.084314 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:16.084923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:16.085200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:16.085470 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:16.095468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:16.097073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fcae3-0a3a-4c4f-9d22-85b6d7ff0e45 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:16.108791 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4265/8546] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:15:17.646414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:17.708563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205d311-3e6f-4f90-8ec2-ba2d633b78cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:17.713517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:17.714370 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:17.714846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:17.715277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] PATH_INFO: `/v3/users/d6f3e062598141a2b9891f5fefd20fa0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:17.716587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f3e062598141a2b9891f5fefd20fa0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:17.719106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:17.987363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f3e062598141a2b9891f5fefd20fa0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:17.987936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f3e062598141a2b9891f5fefd20fa0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.081001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f3e062598141a2b9891f5fefd20fa0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.095017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f3e062598141a2b9891f5fefd20fa0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.095704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f3e062598141a2b9891f5fefd20fa0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.108728 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4282/8547] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:17 2022] DELETE /identity/v3/users/d6f3e062598141a2b9891f5fefd20fa0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:18.113411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:18.113894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:18.114002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:18.133775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:18.135581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:18.195331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4266/8548] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:18.205333 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:18.206920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:18.265793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e5d6-fa88-4a1e-baaa-09683823c6e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:18.269343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:18.269949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:18.270233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:18.270497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:18.280356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:18.281860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:18.291878 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4283/8549] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:18.557524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:18.563681 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:18.572380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a6c6-24b8-46c3-a074-729f71b748f9 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:18.577124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:18.577760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:18.578043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:18.578318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] PATH_INFO: `/v3/projects/68fd01ce406546d980f91fc7cad740a0` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:18.579496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fd01ce406546d980f91fc7cad740a0)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:18.581419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:18.710745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fd01ce406546d980f91fc7cad740a0', 'request_id': 'req-255652c4-1a04-49f5-a909-7d4620511898'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.789657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fd01ce406546d980f91fc7cad740a0', 'request_id': 'req-255652c4-1a04-49f5-a909-7d4620511898'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.795820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fd01ce406546d980f91fc7cad740a0', 'request_id': 'req-255652c4-1a04-49f5-a909-7d4620511898'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.808213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] The token cache is being invalidate because project 68fd01ce406546d980f91fc7cad740a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:18.808441 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.809076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:18.810580 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4267/8550] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:18 2022] DELETE /identity/v3/projects/68fd01ce406546d980f91fc7cad740a0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:18.814590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:18.824393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c96d-0428-4943-9a2d-fc710a8fd4e1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:18.833228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:18.883477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:18.884188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:18.884511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:18.884866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] PATH_INFO: `/v3/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:18.886449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ff7d6f2f32496ea1d70a00a5a1d4f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:18.889664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:19.145611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:19.146391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:19.217740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:19.230850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:19.231488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e10fcb4c-429d-4866-aa62-0ec324b66085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ff7d6f2f32496ea1d70a00a5a1d4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:19.243556 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4284/8551] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:18 2022] DELETE /identity/v3/users/b0ff7d6f2f32496ea1d70a00a5a1d4f6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:15:19.714057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:19.716357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:19.734827 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255652c4-1a04-49f5-a909-7d4620511898 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:19.764498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:19.794476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:19.795150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:19.807218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:19.807218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] PATH_INFO: `/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:19.807218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5507bfe6bf4fde94c8f3978044e65a)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:19.807218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:19.921079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5507bfe6bf4fde94c8f3978044e65a', 'request_id': 'req-0c21ffc5-c46e-4757-888a-f3e50bb6a872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:20.097960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5507bfe6bf4fde94c8f3978044e65a', 'request_id': 'req-0c21ffc5-c46e-4757-888a-f3e50bb6a872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:20.104499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5507bfe6bf4fde94c8f3978044e65a', 'request_id': 'req-0c21ffc5-c46e-4757-888a-f3e50bb6a872'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:20.115769 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] The token cache is being invalidate because project dc5507bfe6bf4fde94c8f3978044e65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:20.116060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:20.116682 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0c21ffc5-c46e-4757-888a-f3e50bb6a872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:20.118344 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4268/8552] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:19 2022] DELETE /identity/v3/projects/dc5507bfe6bf4fde94c8f3978044e65a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:20.124956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.125441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.125568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.144924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:20.146121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:20.204055 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4285/8553] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:20.212524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.212808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.213081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.232949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:20.234133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:20.241863 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4269/8554] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:20.246864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.256457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e010f9-a4ab-4568-9a95-f5b0a8da60f7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.261158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.261762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.262035 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.262300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.262981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:15:20.263282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.264864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.276389 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4286/8555] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:15:20.280521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.290898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d977b-9c64-481b-a81b-050c196dc6f4 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.295558 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.296148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.296427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.296697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.297324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.299262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.390494 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4270/8556] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:15:20.394671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.405088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defca7ae-daf4-4a3a-bb74-4bd435fc9f33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.422533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:20.461189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.461791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.462070 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.462346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.463496 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.465402 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.589805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4287/8557] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:15:20 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:15:20.594036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.604578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb53e-dc2d-497c-a50a-e3b1b599aa6e admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.609300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.609892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.610173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.610447 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.611128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.612849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.623557 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4271/8558] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:15:20.627554 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.638929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a8508-5660-4154-874e-941ab6e98bd1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.652358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.652358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.652358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.652358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.652759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.652759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa34117-71d1-4497-8e87-a8380bd4c68c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.658803 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4288/8559] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:15:20.662978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.673030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4a1f-6a0a-446e-9545-ab47e299b452 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.677685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.678324 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.678605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.678907 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] PATH_INFO: `/v3/projects/52040b8fe4344c20bed7a15f7a400659/users/943ff16e5c434c70b019182dd2d0e945/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.694606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52040b8fe4344c20bed7a15f7a400659, user_id=943ff16e5c434c70b019182dd2d0e945, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.698229 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.777948 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4272/8560] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:15:20 2022] PUT /identity/v3/projects/52040b8fe4344c20bed7a15f7a400659/users/943ff16e5c434c70b019182dd2d0e945/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:20.783261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8145e1f-fc57-48bb-a880-ea2122cb663c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.783915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8145e1f-fc57-48bb-a880-ea2122cb663c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.784178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8145e1f-fc57-48bb-a880-ea2122cb663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.803785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8145e1f-fc57-48bb-a880-ea2122cb663c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:20.805003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8145e1f-fc57-48bb-a880-ea2122cb663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:20.864894 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4289/8561] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:15:20.875323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:20.877040 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:20.936285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c6bd5-7315-4aa0-8537-272567ddac2b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:20.939843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:20.940442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:20.940719 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:20.940987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:20.950387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:20.952503 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989577f1-de5d-421d-b159-dcc093e84282 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:20.956369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:20.962437 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4273/8562] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:26.486080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:26.486611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:26.486611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:26.519537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] MFA Rules not processed for user `943ff16e5c434c70b019182dd2d0e945`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:26.526394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:26.591626 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4290/8563] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:26.603591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767812a-b04d-45e8-bbce-13b153b9e3af None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:26.604375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767812a-b04d-45e8-bbce-13b153b9e3af None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:26.604375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767812a-b04d-45e8-bbce-13b153b9e3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:26.623521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8767812a-b04d-45e8-bbce-13b153b9e3af None None] MFA Rules not processed for user `943ff16e5c434c70b019182dd2d0e945`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:26.624749 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8767812a-b04d-45e8-bbce-13b153b9e3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:26.631634 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4274/8564] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:26.646963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:26.649074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:26.685713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:26.730841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154af73-a9e3-41cb-b698-2ec423b8c525 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:26.736666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:26.737219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:26.737501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:26.737800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:26.745711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:26.752020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:26.756035 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4291/8565] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:36.617718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:37.035020 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:40.025600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:40.026123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:40.026123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:40.066345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:40.067832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:40.077513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4275/8566] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:15:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:40.092654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:40.094078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:40.109224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41373d-6812-4420-b284-d0310faee0c2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:40.114890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:40.115492 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:40.115787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:40.116047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:40.125441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:40.127057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6443691-b0b4-47ff-9f54-6fb074f4cdbf service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:40.139321 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4292/8567] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:43.444399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:43.445847 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:43.467747 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bd535-2df9-4c93-a123-e5e7858c4179 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:43.471333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:43.471918 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:43.472266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:43.472456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:43.474135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:43.486815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:43.488252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:43.499184 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4276/8568] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:43.684746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:43.685334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:43.685334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:43.717451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:43.719122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:43.792077 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4293/8569] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:43.803487 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:43.804899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:43.819873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5447-547c-4574-81c0-17a9c1ba9a13 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:43.825472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:43.826093 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:43.826371 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:43.826670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:43.834890 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:43.836465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448f924-c53a-4585-b4b5-4fa8580779af service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:43.845950 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4277/8570] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:44.123357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:44.132696 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150c4f1-1633-4ad7-b6b5-0e7c65195896 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:44.136241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:44.136838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:44.137119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:44.137395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:44.139129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:44.155372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:44.156784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:44.170733 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4294/8571] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:53.841960 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=27 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:54.162967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=50 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:04.387000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:04.387000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:04.387571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:04.426704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:04.427971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:04.434577 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4278/8572] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 31 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:04.460968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:04.469925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73288f7e-69bf-4135-a24c-9e7e99c9c4f7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:04.473669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:04.474266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:04.474546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:04.474845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:04.483854 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:04.485268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:04.493244 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4295/8573] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:16:14.424220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:14.489939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:19.331684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.354743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc7bf8-310a-43bb-9f53-dbb864f3b096 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.359240 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.359868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.360144 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.360419 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] PATH_INFO: `/v3/users/943ff16e5c434c70b019182dd2d0e945` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.361528 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=943ff16e5c434c70b019182dd2d0e945)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.363494 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.520620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943ff16e5c434c70b019182dd2d0e945'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:19.521273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943ff16e5c434c70b019182dd2d0e945'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:19.576226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943ff16e5c434c70b019182dd2d0e945'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:19.588549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943ff16e5c434c70b019182dd2d0e945'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:19.589186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-61005bca-e7ee-41d2-99f1-b7c1d2c1f19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943ff16e5c434c70b019182dd2d0e945'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:19.601626 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4279/8574] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:19 2022] DELETE /identity/v3/users/943ff16e5c434c70b019182dd2d0e945 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:19.835449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.849043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc516-091c-4a33-8889-59c096f70048 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.908635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.909282 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.909561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.909831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] PATH_INFO: `/v3/projects/52040b8fe4344c20bed7a15f7a400659` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.911257 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52040b8fe4344c20bed7a15f7a400659)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.913154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.034447 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52040b8fe4344c20bed7a15f7a400659', 'request_id': 'req-40ab9b49-9782-46b4-9a47-7e1638015e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:20.102131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52040b8fe4344c20bed7a15f7a400659', 'request_id': 'req-40ab9b49-9782-46b4-9a47-7e1638015e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:20.107849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52040b8fe4344c20bed7a15f7a400659', 'request_id': 'req-40ab9b49-9782-46b4-9a47-7e1638015e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:20.124732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] The token cache is being invalidate because project 52040b8fe4344c20bed7a15f7a400659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:20.124732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:20.124732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-40ab9b49-9782-46b4-9a47-7e1638015e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:20.124732 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4296/8575] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:19 2022] DELETE /identity/v3/projects/52040b8fe4344c20bed7a15f7a400659 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:20.126716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.127003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.127283 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.166296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:20.167522 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.225051 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4280/8576] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:20.234222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.234510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.234817 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.257812 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:20.259073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.267519 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4297/8577] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:20.271776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.282100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab1d0-f40b-4118-a48a-f9c77ce4aa11 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.286931 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.287524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.287803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.288074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.288711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:16:20.289013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.291142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.302513 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4281/8578] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:16:20.307436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.316750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec23cb-60bc-4844-a0e0-4e40150cd1d8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.321410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.322027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.322310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.322586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.323254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.325178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.412064 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4298/8579] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:20.417091 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.427366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f99222-701b-4d5e-a39b-8bd11d2118ba admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.459145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.484202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.484803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.485084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.485354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.485974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.487915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.600270 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4282/8580] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:20.604346 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.615777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a84570-6f98-415e-a496-24c3a7dae623 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.620603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.621230 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.621507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.621779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.622418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.624050 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.633995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4299/8581] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:20.637957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.647893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d655-b1a7-4da9-8382-47163a2a0e4b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.653060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.653650 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.653928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.654203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.654895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.656483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e0c8d-a7b4-402b-a550-1a2ee50ac8e8 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.666561 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4283/8582] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:20.671093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.680864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc604-2694-44db-820c-2795fe9a404a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.685429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.686064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.686342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.686638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] PATH_INFO: `/v3/projects/f22ef0e9f9e243adbe7f0f7129c9c639/users/58549357f2fc4d318d2772d69ab80b18/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.701639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22ef0e9f9e243adbe7f0f7129c9c639, user_id=58549357f2fc4d318d2772d69ab80b18, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.706645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.799584 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4300/8583] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:20 2022] PUT /identity/v3/projects/f22ef0e9f9e243adbe7f0f7129c9c639/users/58549357f2fc4d318d2772d69ab80b18/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:16:20.804625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f80-7d9a-4a75-8698-d81a64002968 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.805023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f80-7d9a-4a75-8698-d81a64002968 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.805300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f80-7d9a-4a75-8698-d81a64002968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.825178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e4189f80-7d9a-4a75-8698-d81a64002968 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:20.826373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e4189f80-7d9a-4a75-8698-d81a64002968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.886461 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4284/8584] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:20.896198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.897956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.919603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.957928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470ecb-e7c8-404d-9ee0-6c7ec5c0750c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.962372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.963010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.963286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.964194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.973286 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.974732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28f950-5b4a-43cb-b484-3e56fcc7cbb7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.984527 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4301/8585] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:26.260481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:26.261021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:26.261136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:26.290660 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] MFA Rules not processed for user `58549357f2fc4d318d2772d69ab80b18`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:26.292908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:26.377889 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4285/8586] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:26.388468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eb96-e293-47eb-b1b3-6529cd471c10 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:26.389056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eb96-e293-47eb-b1b3-6529cd471c10 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:26.389056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eb96-e293-47eb-b1b3-6529cd471c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:26.410111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ef2eb96-e293-47eb-b1b3-6529cd471c10 None None] MFA Rules not processed for user `58549357f2fc4d318d2772d69ab80b18`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:26.411364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ef2eb96-e293-47eb-b1b3-6529cd471c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:26.419430 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4302/8587] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:26.433004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:26.434468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:26.486592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:26.515081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3835-0e89-4a0b-8ea6-2ed3cf064d3c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:26.520948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:26.521578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:26.521854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:26.522181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:26.532254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:26.534136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:26.544537 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4286/8588] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:26.794788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023355-1fd6-4cb6-b9a4-1009fd210374 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:26.795073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023355-1fd6-4cb6-b9a4-1009fd210374 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:26.795343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023355-1fd6-4cb6-b9a4-1009fd210374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:26.814602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-34023355-1fd6-4cb6-b9a4-1009fd210374 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:26.815806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34023355-1fd6-4cb6-b9a4-1009fd210374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:26.822188 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4303/8589] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:26.834411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:26.844981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef59dc-84d0-48ec-9083-7db150072e75 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:26.848675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:26.849290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:26.849579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:26.849843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:26.857493 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:26.858989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:26.867060 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4287/8590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:36.809363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=24 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:36.863382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=20 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:43.144343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda219-ab79-455f-bd54-a810e6e31232 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.144880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda219-ab79-455f-bd54-a810e6e31232 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.144998 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda219-ab79-455f-bd54-a810e6e31232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.165642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-defda219-ab79-455f-bd54-a810e6e31232 None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:43.166931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-defda219-ab79-455f-bd54-a810e6e31232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:43.173931 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4304/8591] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:43.184810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.186286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:43.197471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c8fe-4bbd-4cde-a0b4-0bff2a0f1348 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.201053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.201631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.201903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.202171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.209003 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.210357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d0aa-27b6-4932-9db3-576b8bef4b83 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.218396 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4288/8592] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:16:53.160184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:53.215072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:24.564441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.565015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.565015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.585304 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] MFA Rules not processed for user `58549357f2fc4d318d2772d69ab80b18`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:24.586502 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:24.593812 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4305/8593] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:24.848337 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131c55-ec26-475e-abc5-d941335effbe None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.853112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131c55-ec26-475e-abc5-d941335effbe None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.853112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131c55-ec26-475e-abc5-d941335effbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.869204 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-37131c55-ec26-475e-abc5-d941335effbe None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:24.870412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37131c55-ec26-475e-abc5-d941335effbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:24.877171 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4289/8594] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:24.888679 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.898785 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91be19-d07c-42ac-9a2e-6dc182883fd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.903228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.903228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.903228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.903526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.911418 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.912829 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.920429 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4306/8595] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:34.870838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:34.917114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:39.486356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:39.486836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:39.486963 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:39.523784 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:39.525005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:39.590793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4290/8596] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Oct 31 15:17:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:39.596888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:39.608783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a19-1296-4d3f-ab1b-809f5540dbb0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:39.614245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:39.615197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:39.615197 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:39.615435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:39.617121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:39.629633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:39.631225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27204f-1518-42a8-bc8e-d00e0a3508ee service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:39.640904 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4307/8597] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:49.581912 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=35 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:49.636607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:16.930884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:16.940986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4da92-ffd6-495e-a731-26aacef5280c None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:16.949125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:16.949125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:16.949125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:16.949125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:16.949514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:16.961127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:16.962731 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:16.972428 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4291/8598] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:26.968343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:27.390256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:27.390823 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:27.391115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:27.411309 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:27.412627 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:27.421126 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4308/8599] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:18:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:27.436938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:27.438386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:27.451629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7092d-6b48-4c32-a8c3-0a4988470c68 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:27.456940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:27.457662 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:27.457943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:27.458258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:27.466908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:27.468489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:27.478690 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4292/8600] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:27.552798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:27.564079 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3cfc-c86d-4710-b803-3fb971a418ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:27.568738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:27.569369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:27.569653 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:27.569956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] PATH_INFO: `/v3/users/58549357f2fc4d318d2772d69ab80b18` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:27.571126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58549357f2fc4d318d2772d69ab80b18)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:27.576612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:27.748895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58549357f2fc4d318d2772d69ab80b18'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:27.749568 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58549357f2fc4d318d2772d69ab80b18'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:27.830587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58549357f2fc4d318d2772d69ab80b18'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:27.845977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58549357f2fc4d318d2772d69ab80b18'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:27.846729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac199203-d238-4936-ad38-09d41634385f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58549357f2fc4d318d2772d69ab80b18'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:27.860722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4309/8601] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:27 2022] DELETE /identity/v3/users/58549357f2fc4d318d2772d69ab80b18 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:28.095194 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.106319 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38060-cde8-43fa-b68f-499a3b1d81a7 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.167278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.167908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.168185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.168457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] PATH_INFO: `/v3/projects/f22ef0e9f9e243adbe7f0f7129c9c639` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.169568 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22ef0e9f9e243adbe7f0f7129c9c639)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.171532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.311186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22ef0e9f9e243adbe7f0f7129c9c639', 'request_id': 'req-0dcf6752-bc0b-451e-bf13-cc968b96f14b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:28.385541 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22ef0e9f9e243adbe7f0f7129c9c639', 'request_id': 'req-0dcf6752-bc0b-451e-bf13-cc968b96f14b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:28.391796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22ef0e9f9e243adbe7f0f7129c9c639', 'request_id': 'req-0dcf6752-bc0b-451e-bf13-cc968b96f14b'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:28.404308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] The token cache is being invalidate because project f22ef0e9f9e243adbe7f0f7129c9c639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:28.404591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:28.405217 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0dcf6752-bc0b-451e-bf13-cc968b96f14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:28.406734 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4293/8602] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:28 2022] DELETE /identity/v3/projects/f22ef0e9f9e243adbe7f0f7129c9c639 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:28.412645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.413146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.413673 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.435294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:28.436740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:28.497792 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4310/8603] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:28.505684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.507243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.507243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.526581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:28.527826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:28.535974 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4294/8604] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:28.540369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.549919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fff88-172d-4f45-afce-5a9f565f5062 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.554491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.555607 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.555908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.556154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.556778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:28.557075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.558711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.569946 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4311/8605] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:28.574823 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.584114 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362659a5-dfc0-4152-94dd-ed535f620e56 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.588799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.589388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.589670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.589935 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.590571 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.592521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.676667 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4295/8606] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:28 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:28.681294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.691181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5966e-0c25-439a-b8a7-945a6e3e971a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.739954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:28.749212 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.759125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.759125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.759125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.759125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.759125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.846670 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4312/8607] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:28 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:28.850863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.861228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e727f9-a915-4bdd-a91c-879d25618f3f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.866025 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.866666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.866951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.867219 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.868545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.870139 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.880209 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4296/8608] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:28.884794 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.895059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07dc1-e665-46a9-b77f-4c1d543d1798 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.899986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.900580 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.900860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.901132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.901766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.903398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821ff2-811c-44d6-9ed7-34cb21f8ee61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:28.914156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4313/8609] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:28.918822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:28.928705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8e72-0878-4f88-bab9-0590715808a6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:28.933756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:28.934390 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:28.934718 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:28.934992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] PATH_INFO: `/v3/projects/136273b1c5464a07875a27774cd8d76c/users/be718f0701b546eebc21b12d491ed241/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:28.949472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136273b1c5464a07875a27774cd8d76c, user_id=be718f0701b546eebc21b12d491ed241, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:28.952222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:29.019615 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4297/8610] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:28 2022] PUT /identity/v3/projects/136273b1c5464a07875a27774cd8d76c/users/be718f0701b546eebc21b12d491ed241/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:29.024733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5167f-2fe3-486a-858d-09575aacaf20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:29.029725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5167f-2fe3-486a-858d-09575aacaf20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:29.029725 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5167f-2fe3-486a-858d-09575aacaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:29.045108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78b5167f-2fe3-486a-858d-09575aacaf20 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:29.046315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78b5167f-2fe3-486a-858d-09575aacaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:29.103955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4314/8611] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:29.113481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:29.115298 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:29.130422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:29.172308 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789566-e3b6-4c05-a60b-215211c58e28 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:29.175943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:29.176537 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:29.176813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:29.184459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:29.186782 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:29.188210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:29.197508 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4298/8612] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:34.854695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a84ec-657d-4f14-9461-a3b67366a8d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.855236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a84ec-657d-4f14-9461-a3b67366a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.855236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a84ec-657d-4f14-9461-a3b67366a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.885089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e6a84ec-657d-4f14-9461-a3b67366a8d8 None None] MFA Rules not processed for user `be718f0701b546eebc21b12d491ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:34.886507 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e6a84ec-657d-4f14-9461-a3b67366a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.960611 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4315/8613] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:34.981280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.983540 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:35.102779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201767d1-75bb-409f-83d9-d3e36001d191 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:35.108333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:35.109153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:35.109355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:35.109629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:35.125584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:35.126489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:35.143258 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4299/8614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:37.678740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:37.683758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:37.683758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:37.699203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] MFA Rules not processed for user `be718f0701b546eebc21b12d491ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:37.700442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:37.709542 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4316/8615] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:38.500254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:38.501649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.573547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8f3c-a334-406a-9c3f-318ae6bed73d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:38.578458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:38.579087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.579364 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.579633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.581326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.592546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:38.594202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d961-eb02-4692-86cd-298c664437ba service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:38.603862 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4300/8616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:39.711098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.712657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.729983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3287d39-7a04-4fd9-adc1-5e48ab106968 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.735239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.736036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.736344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.736678 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.738404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.752693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.756288 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.768540 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4317/8617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:48.599698 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=98 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:49.763657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:29.021397 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801864e-d3b2-4010-92f0-51410140abaf None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.021853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801864e-d3b2-4010-92f0-51410140abaf None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.021955 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801864e-d3b2-4010-92f0-51410140abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.042475 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3801864e-d3b2-4010-92f0-51410140abaf None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:29.043726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3801864e-d3b2-4010-92f0-51410140abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:29.053578 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4301/8618] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:29.063433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:29.064866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:29.076218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389688-095f-4c45-b58a-481e3e6fc5a4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:29.079784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:29.080381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.080663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.080937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.090868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:29.092291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.103358 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4318/8619] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:39.037293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:39.098779 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:01.835135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:01.843645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:01.843645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:01.855857 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] MFA Rules not processed for user `be718f0701b546eebc21b12d491ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:01.857073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:01.864362 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4302/8620] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:20:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:03.616919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:03.625708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34be06-b385-4d8b-a772-1ac4eee629f1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:03.629366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:03.629966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:03.630247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:03.630518 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:03.632312 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:03.646839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:03.648293 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:03.660218 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4319/8621] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:04.772312 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:04.782383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af37fce-ce88-4306-baf4-bdace3574733 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:04.786714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:04.786858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:04.787143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:04.787425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:04.789140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:04.803152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:04.804590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:04.815473 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4303/8622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:13.655068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:14.810573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:17.877641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:17.890468 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c34fe-dc6a-4019-9e03-3b592dbf946d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:17.896948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:17.897808 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:17.898085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:17.898366 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:17.900818 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:17.914082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:17.915722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:17.926906 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4320/8623] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:27.921848 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:41.630811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:21:41.648806 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ee4f-0fcc-41e5-b32b-f287adea1506 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:21:41.654284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:21:41.654910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:21:41.655186 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:21:41.655452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:21:41.657138 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:21:41.669036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:21:41.670636 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:21:41.680127 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4304/8624] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:43.723470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:21:43.732865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e57a4-8be1-44f4-b3ab-86a081ea481c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:21:43.736625 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:21:43.737226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:21:43.740519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:21:43.740519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:21:43.740519 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:21:43.750002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:21:43.751478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:21:43.760336 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4321/8625] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:47.080268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:21:47.089848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1f7b-701b-478f-91a4-6c28bd0a0f27 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:21:47.093573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:21:47.094168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:21:47.094444 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:21:47.094754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:21:47.096482 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:21:47.106928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:21:47.108349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05397-469b-4b61-93b3-fcb93ec128bb service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:21:47.116395 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4305/8626] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:53.756574 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:54.001640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:21:54.016615 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75d30-0436-457c-9235-b7824f3fd9f5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:21:54.022296 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:21:54.022936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:21:54.023305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:21:54.023729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:21:54.025603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:21:54.039287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:21:54.040871 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:21:54.052222 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4322/8627] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:57.112967 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=15 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:01.225758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:22:01.226320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:22:01.226320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:22:01.245468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] MFA Rules not processed for user `be718f0701b546eebc21b12d491ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:22:01.246697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:22:01.253455 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4306/8628] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:22:04.047511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:11.240574 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:48.407125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:22:48.428252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdba4-8c21-4088-a932-74ad15e4f3f2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:22:48.432497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:22:48.433115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:22:48.433421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:22:48.433692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:22:48.435431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:22:48.467251 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:22:48.468690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:22:48.477112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4323/8629] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:22:49.006903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:22:49.035546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912afd-28f1-4a35-bf6c-17170af74c8d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:22:49.040727 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:22:49.041271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:22:49.041555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:22:49.041830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:22:49.043599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:22:49.054951 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:22:49.056530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6b391-1903-44ac-b892-e97941414192 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:22:49.066998 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4307/8630] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:22:58.473077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=19 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:59.062700 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=14 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:21.873521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:21.885702 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbf3c-3e76-44c7-b14f-444186d23363 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:21.891238 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:21.891844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:21.892122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:21.892400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:21.894109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:21.906105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:21.907728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:21.917822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4324/8631] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:23.632258 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:23.632715 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:23.632815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:23.652043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] MFA Rules not processed for user `be718f0701b546eebc21b12d491ed241`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:23:23.653218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:23.661228 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4308/8632] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:23:23.967510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:23.977057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf629dd-bc95-4496-9480-1ac67f4d3a92 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:23.980704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:23.981299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:23.981603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:23.982403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:23.983693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:24.005919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:24.007381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:24.015851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4325/8633] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:33.647216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:34.011675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=17 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:34.850203 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:34.851616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:34.867255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fc5f-85aa-4c03-988c-4f01a7defcbc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:34.872974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:34.874220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:34.874499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:34.874794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:34.883127 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:34.885920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:34.896229 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4309/8634] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:44.891106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:46.696202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:46.708686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cddd8a-ff27-4bbd-bfbf-8b0b144209aa service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:46.713552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:46.714168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:46.714443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:46.714747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:46.723734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:46.725259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:46.735156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4326/8635] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:56.730883 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:03.543815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:03.553579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23a707-053c-4683-b3b1-89faf3183fef service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:03.557159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:03.557748 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:03.558023 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:03.558293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:03.568309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:03.569730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:03.581205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4310/8636] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:04.761497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:04.770909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881248-2837-4d83-8112-828ff05b09e2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:04.774538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:04.775164 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:04.775441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:04.775713 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:04.786422 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:04.787888 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:04.799493 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4327/8637] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:13.575930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:14.793815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:30.979575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:30.991919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60d0a-02ed-4e51-91e5-4327c2255a72 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:30.997645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:30.998271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:30.998546 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:30.998855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:31.008820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:31.010468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27384a53-766e-483d-a5b7-d854c5239ef4 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:31.022147 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4311/8638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:41.017108 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:42.045582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:42.055623 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92883c0-fa79-40ff-a368-cbd38211eec3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:42.061229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:42.062241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:42.062241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:42.062452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:42.074601 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:42.076075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:42.086385 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4328/8639] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:45.462123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:45.462649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:45.462740 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:45.515644 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] MFA Rules not processed for user `93e90dc19f58488387296c15062dcb20`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:45.516855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:45.540240 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4312/8640] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:25:45.547441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:45.558549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c455b4-0548-4b78-b4c8-516dcd908378 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:45.563520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:45.564109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:45.564421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:45.564690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:45.573015 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:45.574565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:45.584760 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4329/8641] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:45.655648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:45.667778 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d7ad1-9141-4c7e-8a48-a943f42f44ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:45.672479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:45.673132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:45.673387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:45.673703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] PATH_INFO: `/v3/users/be718f0701b546eebc21b12d491ed241` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:45.674882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be718f0701b546eebc21b12d491ed241)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:45.676829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:45.879611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be718f0701b546eebc21b12d491ed241'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:45.880275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be718f0701b546eebc21b12d491ed241'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:45.957018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be718f0701b546eebc21b12d491ed241'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:45.969377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be718f0701b546eebc21b12d491ed241'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:45.970021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fdd76775-95ff-401a-835e-9fbd3ac4cdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be718f0701b546eebc21b12d491ed241'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:45.982265 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4313/8642] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:25:45 2022] DELETE /identity/v3/users/be718f0701b546eebc21b12d491ed241 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:46.225183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:46.235949 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10627cf-00f6-4a4a-8fd9-fb6c3c9195e1 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:46.302454 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:46.303115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.303397 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.303672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] PATH_INFO: `/v3/projects/136273b1c5464a07875a27774cd8d76c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.304791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136273b1c5464a07875a27774cd8d76c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:46.306765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:46.429780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136273b1c5464a07875a27774cd8d76c', 'request_id': 'req-0900f315-67f9-493a-b76c-08a68510dca0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:46.514423 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136273b1c5464a07875a27774cd8d76c', 'request_id': 'req-0900f315-67f9-493a-b76c-08a68510dca0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:46.521022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136273b1c5464a07875a27774cd8d76c', 'request_id': 'req-0900f315-67f9-493a-b76c-08a68510dca0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:46.545369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] The token cache is being invalidate because project 136273b1c5464a07875a27774cd8d76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:25:46.545776 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:46.546413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0900f315-67f9-493a-b76c-08a68510dca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:46.547967 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4330/8643] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:25:46 2022] DELETE /identity/v3/projects/136273b1c5464a07875a27774cd8d76c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:46.552974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.553366 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.553518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.581876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:46.583105 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:46.639898 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4314/8644] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:25:46.648510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.648795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.649071 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.669040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:46.670228 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:46.678149 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4331/8645] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:25:46.682563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:46.692791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90c2f-7d09-483b-9d65-f37e82ac7e4e None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:46.697332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:46.697927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.698232 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.698479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.699153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:25:46.699456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:46.701064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:46.713390 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4315/8646] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:25:46.718490 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:46.728120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4edfc-ad7a-4ce3-a8d5-7cf397add9d3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:46.732830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:46.733433 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.733714 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.733985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.734636 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:46.736641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:46.838476 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4332/8647] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:25:46 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:25:46.842524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:46.852738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa9084-0ced-4a22-b24f-ea5aee341835 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:46.857495 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:46.907754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:46.908361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:46.908642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:46.908915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:46.909549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:46.911772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:47.011500 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4316/8648] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:25:46 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:25:47.015630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:47.026236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef70a-97dd-45e9-ad1c-15ae1e014a09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:47.030961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:47.031575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:47.031845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:47.032138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:47.032756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:47.034364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:47.044955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4333/8649] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:25:47.049457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:47.059620 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a8e9-73ae-4736-a39d-47ac1dd472e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:47.064345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:47.065474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:47.065758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:47.066145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:47.066888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:47.068508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811bd2-cc18-4a4e-bbdf-9354e3ba1475 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:47.079198 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4317/8650] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:25:47.083373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:47.089815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:47.093611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594e379-a6a0-4bce-a1a8-a4df5c38273f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:47.098283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:47.099031 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:47.099314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:47.099588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] PATH_INFO: `/v3/projects/4873a9e9724a441091595b4f4bda2952/users/c533442f981b4aecb9336400de4ee811/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:47.115734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4873a9e9724a441091595b4f4bda2952, user_id=c533442f981b4aecb9336400de4ee811, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:47.118386 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:47.211754 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4334/8651] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:25:47 2022] PUT /identity/v3/projects/4873a9e9724a441091595b4f4bda2952/users/c533442f981b4aecb9336400de4ee811/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:47.216768 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09e2-bbda-48a9-84fe-7ec5bdcbda35 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:47.217059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09e2-bbda-48a9-84fe-7ec5bdcbda35 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:47.217336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09e2-bbda-48a9-84fe-7ec5bdcbda35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:47.238333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6c6c09e2-bbda-48a9-84fe-7ec5bdcbda35 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:47.239595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c6c09e2-bbda-48a9-84fe-7ec5bdcbda35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:47.298242 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4318/8652] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:25:47.308569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:47.310270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:47.376182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a699-ecd3-479f-a246-4fea49004cab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:47.379867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:47.380462 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:47.380742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:47.381017 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:47.389931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:47.391391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0fbd1-029f-49ea-a049-f2497d8a338a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:47.400591 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4335/8653] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:52.943488 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:52.944388 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:52.944839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:53.011804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] MFA Rules not processed for user `c533442f981b4aecb9336400de4ee811`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:53.013116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:53.097539 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4319/8654] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:25:53.107371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:53.107916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:53.107916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:53.137341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] MFA Rules not processed for user `c533442f981b4aecb9336400de4ee811`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:25:53.138789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:53.149789 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4336/8655] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:25:53.163157 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:53.164611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:53.187019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:53.254355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea0a5-6741-4651-8d19-dad5f53caa17 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:53.262210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:53.262884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:53.263163 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:53.263434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:53.273683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:53.275359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:53.287121 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4320/8656] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:53.556575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:53.557961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:53.570880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857abc-4857-49eb-b7f2-d4b3b48061cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:53.574403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:53.575048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:53.575324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:53.575590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:53.577302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:53.587068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:53.588476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3cb2-3a70-40fa-8bb9-1b98448bceaf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:53.596732 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4337/8657] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:54.013261 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:54.014840 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:54.106278 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce3cbd-5b34-4228-8954-a2f5474073b4 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:54.111639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08137988-3489-479e-8172-95134e0da48a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:54.112405 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08137988-3489-479e-8172-95134e0da48a service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:54.113078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08137988-3489-479e-8172-95134e0da48a service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:54.113473 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08137988-3489-479e-8172-95134e0da48a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:54.115468 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-08137988-3489-479e-8172-95134e0da48a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:54.128333 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08137988-3489-479e-8172-95134e0da48a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:54.129928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08137988-3489-479e-8172-95134e0da48a service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:54.141053 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4321/8658] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:26:03.593563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:04.135805 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=58 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:05.868168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:05.868689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:05.868689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:05.888226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] MFA Rules not processed for user `c533442f981b4aecb9336400de4ee811`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:05.893115 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:05.896601 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4338/8659] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:15.883207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:32.105627 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08137988-3489-479e-8172-95134e0da48a service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:32.130657 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08137988-3489-479e-8172-95134e0da48a service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:32.136505 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:32.137136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:32.137421 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:32.137696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] PATH_INFO: `/v3/users/c533442f981b4aecb9336400de4ee811` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:32.138846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c533442f981b4aecb9336400de4ee811)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:32.141581 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:32.352879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c533442f981b4aecb9336400de4ee811'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.353451 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c533442f981b4aecb9336400de4ee811'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.411032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c533442f981b4aecb9336400de4ee811'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.423262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c533442f981b4aecb9336400de4ee811'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.425517 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-4648e028-0442-40ed-8ff0-03ddc3cac96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c533442f981b4aecb9336400de4ee811'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.436898 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4322/8660] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:26:32 2022] DELETE /identity/v3/users/c533442f981b4aecb9336400de4ee811 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:32.693741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:32.709575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35463d20-f5b6-4b8d-a9d1-f9617e216f48 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:32.768148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:32.768777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:32.769054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:32.769326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] PATH_INFO: `/v3/projects/4873a9e9724a441091595b4f4bda2952` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:32.770455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4873a9e9724a441091595b4f4bda2952)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:32.772483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:32.898413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4873a9e9724a441091595b4f4bda2952', 'request_id': 'req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.990124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4873a9e9724a441091595b4f4bda2952', 'request_id': 'req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:32.996640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4873a9e9724a441091595b4f4bda2952', 'request_id': 'req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:33.007952 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] The token cache is being invalidate because project 4873a9e9724a441091595b4f4bda2952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:26:33.008237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:33.008860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-90dcf609-c9f1-4b80-8aa6-e4cb6ab3dae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:33.010334 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4339/8661] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:32 2022] DELETE /identity/v3/projects/4873a9e9724a441091595b4f4bda2952 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:33.015368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.015690 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.015970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.055053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:33.056408 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:33.118730 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4323/8662] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:33.126890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.127177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.127452 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.147131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:33.148326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:33.156791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4340/8663] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:33.161313 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.172069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f7b3b-0ed5-4539-9446-f838dd11aa7b None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.176676 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.177277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.177562 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.177833 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.178523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:26:33.178871 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.183018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.192128 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4324/8664] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:26:33.196476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.205724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef59a-f43d-47e7-a8d7-fcf0c8516257 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.210395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.211029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.211320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.211577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.212201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.214654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.334068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4341/8665] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:26:33 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:33.338160 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.349120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2fc3-d03c-44ad-b9f2-616c15100104 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.382428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:33.407530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.408218 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.408496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.408765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.409392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.411635 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.498524 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4325/8666] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:26:33 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:33.502813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.513564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72610-23ca-46a3-b48c-82a7bae36185 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.518321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.518954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.519231 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.519500 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.520124 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.521704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.532381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4342/8667] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:33.536572 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.546533 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85007cd7-e209-4395-83cc-beb5ef77c47f admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.551262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.551853 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.552130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.552400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.553031 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.554704 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae2af7-37ff-4ec8-b471-93366a950c22 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.565047 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4326/8668] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:33.569069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.579665 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e495a7-21a7-4959-9990-88c0314fd9db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.584553 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.585109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.585393 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.585701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] PATH_INFO: `/v3/projects/f71bdc10ec394d6da2ca315f537cdea2/users/eef4d2433ff549db83230d0c31e900d7/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.601354 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71bdc10ec394d6da2ca315f537cdea2, user_id=eef4d2433ff549db83230d0c31e900d7, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.604098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.704914 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4343/8669] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:26:33 2022] PUT /identity/v3/projects/f71bdc10ec394d6da2ca315f537cdea2/users/eef4d2433ff549db83230d0c31e900d7/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:33.715673 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.715964 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.716242 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.744187 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] MFA Rules not processed for user `eef4d2433ff549db83230d0c31e900d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:33.745524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:33.809918 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4327/8670] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:26:33.820134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:33.821852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:33.842375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:33.878510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b606-744b-43bb-95c5-7625187cdde0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:33.882159 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:33.882790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:33.883078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:33.883410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:33.892204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:33.893624 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:33.902363 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4344/8671] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:26:43.807489 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:43.941981 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=18 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:48.239231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:48.240863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:48.322236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea91aad-2d3b-4c57-ad59-0396a85c2388 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:48.327832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:48.328450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:48.328729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:48.328998 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:48.330794 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:48.343668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:48.345391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b831-036c-4a4d-b037-c8956bba240f service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:48.358659 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4328/8672] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:26:50.728126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:50.792825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975337-849f-4239-ad97-7db75d9c4ca2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:50.797371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:50.797991 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:50.798268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:50.798540 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] PATH_INFO: `/v3/users/eef4d2433ff549db83230d0c31e900d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:50.799717 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef4d2433ff549db83230d0c31e900d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:50.801616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:50.997181 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef4d2433ff549db83230d0c31e900d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:50.997853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef4d2433ff549db83230d0c31e900d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.092216 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef4d2433ff549db83230d0c31e900d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.105061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef4d2433ff549db83230d0c31e900d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.105727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef4d2433ff549db83230d0c31e900d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.118117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4345/8673] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:26:50 2022] DELETE /identity/v3/users/eef4d2433ff549db83230d0c31e900d7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:51.123207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203d42-8495-498e-8074-4333af999c59 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.123725 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203d42-8495-498e-8074-4333af999c59 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.123920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203d42-8495-498e-8074-4333af999c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.143919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4e203d42-8495-498e-8074-4333af999c59 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:51.145172 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4e203d42-8495-498e-8074-4333af999c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:51.204004 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4329/8674] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:51.214369 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:51.215805 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:51.273265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd61bc-1644-469c-9662-cc906b541a58 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:51.277390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:51.277985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.278262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.278536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.287662 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:51.289077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc5c20-9313-4654-b1a4-6141b88de4f1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:51.299340 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4346/8675] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:26:51.539908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203d42-8495-498e-8074-4333af999c59 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:51.541477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4e203d42-8495-498e-8074-4333af999c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:51.554809 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203d42-8495-498e-8074-4333af999c59 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:51.559334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:51.560005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.564616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.564616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] PATH_INFO: `/v3/projects/f71bdc10ec394d6da2ca315f537cdea2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.564616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71bdc10ec394d6da2ca315f537cdea2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:51.564616 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:51.698100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71bdc10ec394d6da2ca315f537cdea2', 'request_id': 'req-b187f2ad-88c3-400e-b9ee-3f0f82563783'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.760899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71bdc10ec394d6da2ca315f537cdea2', 'request_id': 'req-b187f2ad-88c3-400e-b9ee-3f0f82563783'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.767625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71bdc10ec394d6da2ca315f537cdea2', 'request_id': 'req-b187f2ad-88c3-400e-b9ee-3f0f82563783'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.779170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] The token cache is being invalidate because project f71bdc10ec394d6da2ca315f537cdea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:26:51.779455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.780088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-b187f2ad-88c3-400e-b9ee-3f0f82563783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:51.781638 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4330/8676] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:51 2022] DELETE /identity/v3/projects/f71bdc10ec394d6da2ca315f537cdea2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:51.787226 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.787694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.787694 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.807111 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:51.808820 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:51.826357 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:51.867139 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4347/8677] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:51.875575 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.875868 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.876145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.896521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:51.897726 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:51.905731 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4331/8678] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:26:51.910000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:51.919900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3876e3-77d4-4f81-abff-5c64c26ec047 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:51.925195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:51.925789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.926069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.926343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.927029 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:26:51.927335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:51.928930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:51.941005 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4348/8679] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:26:51.945428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:51.955798 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01fc0-1dec-48dd-a4b1-083ed410c221 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:51.960536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:51.961124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:51.961399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:51.961667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:51.962293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:51.964282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:51.968730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:52.069057 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4332/8680] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:52.073185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:52.083825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fa7c-0a22-42cc-9ea3-7dacb768d896 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:52.145622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:52.146321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.147153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.147153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.147516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:52.149463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:52.234734 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4349/8681] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:26:52 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:52.238940 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:52.250118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3d21-dc5a-4d22-bab7-065faa6fd77b admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:52.254859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:52.255395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.255696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.256014 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.256652 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:52.258231 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:52.268146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4333/8682] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:52.272139 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:52.281995 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3f78-b246-4540-bdfb-a01c5f649bee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:52.286955 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:52.287565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.287841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.288109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.288733 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:52.290363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bdd57-08eb-4591-be7e-10b11b6a6e2d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:52.301261 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4350/8683] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:52.305293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:52.315855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84631f4d-8d93-4513-a1bc-7d7db1f0efea admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:52.320492 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:52.321073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.321355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.321625 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] PATH_INFO: `/v3/projects/8aa00bd12e154174aced037930bbd46c/users/28ae22a558f641a8bde91c5d76d05bca/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.335841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa00bd12e154174aced037930bbd46c, user_id=28ae22a558f641a8bde91c5d76d05bca, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:52.338484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:52.398973 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4334/8684] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:26:52 2022] PUT /identity/v3/projects/8aa00bd12e154174aced037930bbd46c/users/28ae22a558f641a8bde91c5d76d05bca/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:52.409657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.409942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.410244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.440856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] MFA Rules not processed for user `28ae22a558f641a8bde91c5d76d05bca`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:52.442061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:52.505350 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4351/8685] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:52.515223 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:52.516889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:52.573281 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc25d8-8581-494b-844f-d4933e72b75c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:52.576836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:52.577427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:52.577703 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:52.577971 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:52.586132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:52.587584 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e15d6-3c0a-4691-8769-036da424c72d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:52.596752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4335/8686] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:26:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:26:58.488054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:58.509255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:58.552852 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c63f-930a-4151-9d82-eee10448c5b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:58.557429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:58.558080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:58.558356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:58.558645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] PATH_INFO: `/v3/users/28ae22a558f641a8bde91c5d76d05bca` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:58.559783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ae22a558f641a8bde91c5d76d05bca)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:58.561719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:58.709394 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ae22a558f641a8bde91c5d76d05bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:58.710180 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ae22a558f641a8bde91c5d76d05bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:58.770140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ae22a558f641a8bde91c5d76d05bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:58.783400 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ae22a558f641a8bde91c5d76d05bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:58.784141 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ae22a558f641a8bde91c5d76d05bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:58.797395 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4352/8687] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:26:58 2022] DELETE /identity/v3/users/28ae22a558f641a8bde91c5d76d05bca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:58.802041 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:58.802530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:58.802697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:58.821607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:58.822843 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:58.882922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4336/8688] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:58.893217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:58.894918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:58.965517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741074-736d-4d80-b3c8-93d814b51831 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:58.969258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:58.969864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:58.970138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:58.970408 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:58.980067 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:58.981569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e504b4-d3fa-4f5f-9fdd-9f04f0bbaae8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:58.990797 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4353/8689] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:26:59.231340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.232898 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:59.245526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13637616-9d70-4bc0-a03a-bb38156d5965 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.250196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.250876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.251192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.251429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] PATH_INFO: `/v3/projects/8aa00bd12e154174aced037930bbd46c` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.255265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa00bd12e154174aced037930bbd46c)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.255265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.366450 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:59.367875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa00bd12e154174aced037930bbd46c', 'request_id': 'req-05664a00-8b4b-4aec-9169-84febb66c820'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:59.429504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa00bd12e154174aced037930bbd46c', 'request_id': 'req-05664a00-8b4b-4aec-9169-84febb66c820'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:59.436033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa00bd12e154174aced037930bbd46c', 'request_id': 'req-05664a00-8b4b-4aec-9169-84febb66c820'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:59.447983 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] The token cache is being invalidate because project 8aa00bd12e154174aced037930bbd46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:26:59.448914 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:59.449554 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-05664a00-8b4b-4aec-9169-84febb66c820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:26:59.451117 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4337/8690] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:59 2022] DELETE /identity/v3/projects/8aa00bd12e154174aced037930bbd46c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:59.456125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.456409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.456683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.478644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:59.478644 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:59.511671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:59.536787 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4354/8691] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:59.544709 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.544994 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.545270 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.566654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:26:59.567864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:26:59.576591 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4338/8692] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:26:59.580743 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.591086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d763-f057-4c20-abc3-2e0fd2caba72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.596137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.596265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.596532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.596809 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.597449 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:26:59.597753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.599390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.611580 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4355/8693] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:26:59.615434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.625294 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb66a1-ff1d-433d-b102-1549babc9401 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.629966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.630609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.630913 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.631183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.631810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.633837 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.710606 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4339/8694] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:26:59 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:59.714915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.725344 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752c3f-88b9-49c8-b44d-5ad08bc79cbd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.782102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.782642 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.782930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.783199 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.783827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.786126 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.878634 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4356/8695] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:26:59 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:26:59.882982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.893318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963839-a94c-44c0-a541-82b7812a4930 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.898241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.898882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.899165 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.899438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.900126 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.901799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.912607 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4340/8696] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:59.916582 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.927032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06684e8-3183-44fd-a4c5-178217bae1ff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.931682 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.932260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.933186 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.933465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.934104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.935729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f12a-5ba9-4925-a27c-925bdea13bea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:26:59.946317 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4357/8697] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:26:59.950339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:26:59.960178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad317-a118-47be-9d5a-331e9c9ae7b0 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:26:59.964894 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:26:59.965532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:26:59.965807 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:26:59.966075 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] PATH_INFO: `/v3/projects/2041747b6d7d4e2cbfe3b4a583b1df11/users/2b4bcf1402bb43249125a7d440bc02e2/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:26:59.980880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2041747b6d7d4e2cbfe3b4a583b1df11, user_id=2b4bcf1402bb43249125a7d440bc02e2, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:26:59.983590 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:00.084619 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4341/8698] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:26:59 2022] PUT /identity/v3/projects/2041747b6d7d4e2cbfe3b4a583b1df11/users/2b4bcf1402bb43249125a7d440bc02e2/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:27:00.090221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cc9b8-a810-4df7-b544-33655fad7d18 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:00.090534 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cc9b8-a810-4df7-b544-33655fad7d18 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:00.090835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cc9b8-a810-4df7-b544-33655fad7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:00.110690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ac1cc9b8-a810-4df7-b544-33655fad7d18 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:27:00.112024 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac1cc9b8-a810-4df7-b544-33655fad7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:00.171040 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4358/8699] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:27:00.180647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:00.182320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:00.239020 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c91eb-df2b-4e1e-95f1-45e628d2dc71 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:00.242553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:00.243173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:00.243448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:00.243713 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:00.252776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:00.254198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:00.263523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4342/8700] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:05.788923 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:05.789511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:05.789511 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:05.821796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] MFA Rules not processed for user `2b4bcf1402bb43249125a7d440bc02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:27:05.823239 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:05.869372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:05.906464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4359/8701] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:27:05.911256 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:05.921947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a67c4-a01e-4c0f-a729-35c074abe94f service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:05.926765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:05.927373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:05.927654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:05.927930 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:05.928565 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:05.930497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.019592 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4343/8702] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:27:05 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:27:06.023835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:06.036225 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3e916-536c-40f5-9dae-9ab9f15cbc57 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:06.097967 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:06.098605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:06.098928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:06.099224 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:06.099906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:06.101985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.210242 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4360/8703] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:27:06 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:27:06.211560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:06.222824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c8e0e-5d8f-4c7a-b717-019818aa0110 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:06.227772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:06.228457 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:06.228734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:06.229021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:06.229711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:06.231352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.243523 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4344/8704] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:27:06.247957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:06.258171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd162e5-03c9-4ff7-acf6-2ebea0208596 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:06.263100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:06.263774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:06.264053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:06.264325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] PATH_INFO: `/v3/projects/dff2095147994f0f94c2000ae5fda30e/users/37e84a5caacd47baa63d8c8a910c5e76/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:06.281100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff2095147994f0f94c2000ae5fda30e, user_id=37e84a5caacd47baa63d8c8a910c5e76, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:06.284198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.353688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4361/8705] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:27:06 2022] PUT /identity/v3/projects/dff2095147994f0f94c2000ae5fda30e/users/37e84a5caacd47baa63d8c8a910c5e76/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:27:06.357766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:06.368268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7aaf7-2d60-4081-a88e-82c8f6d30518 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:06.408799 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:06.424986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:06.425820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:06.426293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:06.430100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:06.430100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:06.430100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca95c93-9728-4faf-a0d6-03f86651d468 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.439282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4345/8706] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:27:06.443557 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:06.455384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edb77-18be-4749-8854-61e25174ee88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:06.460911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:06.461595 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:06.462044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:06.462327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] PATH_INFO: `/v3/projects/dff2095147994f0f94c2000ae5fda30e/users/37e84a5caacd47baa63d8c8a910c5e76/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:06.464437 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff2095147994f0f94c2000ae5fda30e, user_id=37e84a5caacd47baa63d8c8a910c5e76, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:06.467796 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:06.479276 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4362/8707] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:27:06 2022] PUT /identity/v3/projects/dff2095147994f0f94c2000ae5fda30e/users/37e84a5caacd47baa63d8c8a910c5e76/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:27:12.026826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093cca0-9d85-48d5-af53-c9b54a7d31ab None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:12.027339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093cca0-9d85-48d5-af53-c9b54a7d31ab None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:12.027448 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093cca0-9d85-48d5-af53-c9b54a7d31ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:12.057249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-8093cca0-9d85-48d5-af53-c9b54a7d31ab None None] MFA Rules not processed for user `37e84a5caacd47baa63d8c8a910c5e76`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:27:12.058642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8093cca0-9d85-48d5-af53-c9b54a7d31ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:12.133661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4346/8708] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:27:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:27:12.160167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:12.160167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:12.246655 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47631bf-690d-47d6-8c7f-1234e14de2d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:12.255140 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:12.255774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:12.256054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:12.256326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:12.286987 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:12.325749 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:12.326827 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:12.338465 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4363/8709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:12.531692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:12.532191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:12.532653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:12.554966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] MFA Rules not processed for user `2b4bcf1402bb43249125a7d440bc02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:27:12.556125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:12.566661 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4347/8710] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:27:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:27:16.796378 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:16.798033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:16.859023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01928-4d9a-4c84-9e36-aa470d183ee2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:16.863373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:16.863989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:16.864289 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:16.864566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:16.866360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:16.877172 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:16.878670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:16.888293 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4364/8711] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:22.548684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=47 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:25.369005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:25.383103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950a8ad-c4ca-48bd-99e4-4dc57c74b581 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:25.391551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:25.392177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:25.392454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:25.392723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:25.394591 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:25.407884 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:25.409521 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706c16c-df9d-4511-8696-7d3021482fa3 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:25.421104 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4348/8712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:26.883101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=42 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:28.036098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:28.037491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:28.113815 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63bca-4e04-4916-9f59-9ad5ea47c0df service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:28.117523 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:28.118127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:28.118409 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:28.118718 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:28.128404 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:28.129957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:28.139348 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4365/8713] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:35.416035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:38.135058 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=35 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:58.175265 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:58.175775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:58.175877 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:58.195348 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] MFA Rules not processed for user `2b4bcf1402bb43249125a7d440bc02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:27:58.196561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:58.203453 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4349/8714] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:27:58.836707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:58.838154 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:58.908706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16c847-d0e1-432b-aea2-3cfd8d967432 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:58.914001 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:58.914604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:58.914912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:58.915185 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:58.916892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:58.928052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:58.929612 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901f1e4-2672-4f82-affe-6f7bf74d5f6e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:58.940512 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4366/8715] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:28:08.190285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:08.935176 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:39.932889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:28:39.945938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8f61-2e5a-4f98-99e1-8138bcb04337 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:28:39.951192 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:28:39.951816 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:28:39.952094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:28:39.952378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:28:39.954325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:28:39.966409 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:28:39.968100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:28:39.977895 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4350/8716] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:28:41.379325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:28:41.379846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:28:41.379846 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:28:41.399579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] MFA Rules not processed for user `2b4bcf1402bb43249125a7d440bc02e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:28:41.400687 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:28:41.407841 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4367/8717] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:28:41.660378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:28:41.670121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e303-b81e-4ccc-9a58-dfe68b4fa097 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:28:41.673711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:28:41.674302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:28:41.674577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:28:41.674880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:28:41.676688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:28:41.686057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:28:41.687501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:28:41.695840 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4351/8718] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:28:51.394605 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:51.691851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:52.727175 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:28:52.738975 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676675e4-0f7e-4d4c-be03-adf8e641af47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:28:52.744414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:28:52.745002 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:28:52.745277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:28:52.745596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:28:52.747236 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:28:52.758786 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:28:52.760376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:28:52.769950 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4368/8719] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:02.765842 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:30.627941 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:30.695567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfa85-a64d-4c53-96b2-ea26086c13dc service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:30.700208 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:30.700830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:30.701112 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:30.701392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] PATH_INFO: `/v3/users/2b4bcf1402bb43249125a7d440bc02e2` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:30.702549 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4bcf1402bb43249125a7d440bc02e2)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:30.704504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:30.878378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4bcf1402bb43249125a7d440bc02e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:30.879197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4bcf1402bb43249125a7d440bc02e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:30.950692 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4bcf1402bb43249125a7d440bc02e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:30.963642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4bcf1402bb43249125a7d440bc02e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:30.964272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4bcf1402bb43249125a7d440bc02e2'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:30.977255 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4352/8720] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:29:30 2022] DELETE /identity/v3/users/2b4bcf1402bb43249125a7d440bc02e2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:31.274670 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:31.285406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cce8-d374-4f10-802f-8f1482dda2e0 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:31.343006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:31.343631 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:31.343908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:31.344182 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] PATH_INFO: `/v3/projects/2041747b6d7d4e2cbfe3b4a583b1df11` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:31.345290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2041747b6d7d4e2cbfe3b4a583b1df11)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:31.347252 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:31.488302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2041747b6d7d4e2cbfe3b4a583b1df11', 'request_id': 'req-48eba764-03ad-48da-8630-311f607de9e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.563102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2041747b6d7d4e2cbfe3b4a583b1df11', 'request_id': 'req-48eba764-03ad-48da-8630-311f607de9e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.568745 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2041747b6d7d4e2cbfe3b4a583b1df11', 'request_id': 'req-48eba764-03ad-48da-8630-311f607de9e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.580645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] The token cache is being invalidate because project 2041747b6d7d4e2cbfe3b4a583b1df11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:29:31.580931 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.581564 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.586299 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4369/8721] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:29:31 2022] DELETE /identity/v3/projects/2041747b6d7d4e2cbfe3b4a583b1df11 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:31.587351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:31.588864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:31.602088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aca99-7105-40db-8975-4cdc965dec9c admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:31.658420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:31.659148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:31.659331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:31.659597 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] PATH_INFO: `/v3/users/37e84a5caacd47baa63d8c8a910c5e76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:31.660712 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e84a5caacd47baa63d8c8a910c5e76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:31.662910 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:31.684320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:31.890873 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e84a5caacd47baa63d8c8a910c5e76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.891525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e84a5caacd47baa63d8c8a910c5e76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.968928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e84a5caacd47baa63d8c8a910c5e76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.981883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e84a5caacd47baa63d8c8a910c5e76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.982544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-0a6229df-65de-4b74-b4b1-a89f7d93f895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e84a5caacd47baa63d8c8a910c5e76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:31.996024 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4353/8722] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:29:31 2022] DELETE /identity/v3/users/37e84a5caacd47baa63d8c8a910c5e76 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:32.239475 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:32.240959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:32.253926 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba764-03ad-48da-8630-311f607de9e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:32.313704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:32.314432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.314590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.314889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] PATH_INFO: `/v3/projects/dff2095147994f0f94c2000ae5fda30e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.315988 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff2095147994f0f94c2000ae5fda30e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:32.317866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:32.420173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:32.431905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff2095147994f0f94c2000ae5fda30e', 'request_id': 'req-c7397048-256b-41f5-aa28-d9bd7945726f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:32.550859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff2095147994f0f94c2000ae5fda30e', 'request_id': 'req-c7397048-256b-41f5-aa28-d9bd7945726f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:32.556488 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff2095147994f0f94c2000ae5fda30e', 'request_id': 'req-c7397048-256b-41f5-aa28-d9bd7945726f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:32.567878 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] The token cache is being invalidate because project dff2095147994f0f94c2000ae5fda30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:29:32.568165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:32.568810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c7397048-256b-41f5-aa28-d9bd7945726f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:29:32.570994 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4370/8723] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:29:32 2022] DELETE /identity/v3/projects/dff2095147994f0f94c2000ae5fda30e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:32.576050 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.576338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.576610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.596583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:32.597786 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:32.656545 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4354/8724] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:32.664680 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.664948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.665215 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.685193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:32.686327 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:32.694227 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4371/8725] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:32.698896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:32.708621 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab2c3-7a1a-48d4-a617-974ea23158f1 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:32.713814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:32.714413 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.714729 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.715005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.715737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:29:32.716045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:32.717666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:32.729463 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4355/8726] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:29:32.733939 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:32.743221 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435dbf5-4a46-4ece-80e2-d9494e57374c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:32.747813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:32.748399 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.748676 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.748948 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.749577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:32.751506 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:32.839722 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4372/8727] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:29:32 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:29:32.844109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:32.854136 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbbcf4-a9fa-46b8-8349-7c822cd9d33d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:32.910007 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:32.910604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:32.910908 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:32.911177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:32.912072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:32.913989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:32.991064 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4356/8728] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:29:32 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:29:32.995741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:33.006260 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20d33-477b-4d32-aca7-a6d4c4c6f61b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:33.011469 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:33.012083 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:33.012367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:33.012635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:33.013266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:33.014907 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:33.025180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4373/8729] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:29:33.029081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:33.039239 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233e6b-d37e-48b6-98b3-0a18d0e66d65 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:33.043766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:33.044350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:33.044626 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:33.044896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:33.045525 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:33.047147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4bcb2-9b4b-4a44-bc1a-13102a87ea2f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:33.057993 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4357/8730] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:29:33.062039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:33.072789 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6ded4-7d83-4931-adb4-a98fd80d2b12 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:33.077542 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:33.078241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:33.078522 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:33.078833 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] PATH_INFO: `/v3/projects/187a6e386c7749e9a25935e9613b3426/users/a2d3bdc6732a41068ef1950a9e4d7d76/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:33.093294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=187a6e386c7749e9a25935e9613b3426, user_id=a2d3bdc6732a41068ef1950a9e4d7d76, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:33.095972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:33.162464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4374/8731] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:29:33 2022] PUT /identity/v3/projects/187a6e386c7749e9a25935e9613b3426/users/a2d3bdc6732a41068ef1950a9e4d7d76/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:33.167566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06845-fb2e-415d-9290-e727100ddfd3 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:33.167854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06845-fb2e-415d-9290-e727100ddfd3 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:33.168123 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06845-fb2e-415d-9290-e727100ddfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:33.176159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:33.187375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-47f06845-fb2e-415d-9290-e727100ddfd3 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:33.188557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-47f06845-fb2e-415d-9290-e727100ddfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:33.246252 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4358/8732] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:33.255906 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:33.258147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:33.318849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496275d-af5a-4bb9-bab0-0472322a3b4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:33.322910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:33.323515 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:33.323802 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:33.324073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:33.333261 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:33.337395 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:33.344440 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4375/8733] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:38.612200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:38.612779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:38.612779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:38.647034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] MFA Rules not processed for user `a2d3bdc6732a41068ef1950a9e4d7d76`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:38.648486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:38.727007 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4359/8734] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:38.733158 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:38.744068 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc528f15-3e02-4723-bf00-b9952d3bbeab service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:38.748920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:38.749532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:38.749810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:38.750082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:38.750764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:38.752873 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:38.844755 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4376/8735] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:29:38 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:29:38.848996 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:38.860180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526830d-f8c6-4300-be0b-97aa5a4eca0d None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:38.920345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:38.920970 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:38.921253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:38.921526 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:38.922178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:38.924130 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:39.005834 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4360/8736] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:29:38 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:29:39.007283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:39.019107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f8f2-5ec9-4186-bd66-b3ced9387b51 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:39.023904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:39.024571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:39.024849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:39.025301 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:39.025946 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:39.027650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:39.040180 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4377/8737] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:29:39.044599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:39.056012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b2a5-f2fb-4d53-b409-fb9a78902ba7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:39.060915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:39.061666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:39.061976 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:39.062363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] PATH_INFO: `/v3/projects/d933693eba02417cb9c0844a3c16b4ed/users/8319f90bfed2475aa23dd569b210c862/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:39.079018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d933693eba02417cb9c0844a3c16b4ed, user_id=8319f90bfed2475aa23dd569b210c862, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:39.081863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:39.170689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:39.175613 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4361/8738] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:29:39 2022] PUT /identity/v3/projects/d933693eba02417cb9c0844a3c16b4ed/users/8319f90bfed2475aa23dd569b210c862/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:39.179961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:39.190914 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e085-7536-486a-9161-e3859fdbc3b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:39.215633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:39.250698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:39.251299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:39.251576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:39.251845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:39.252476 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:39.254094 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45690e-97b1-47bb-9f42-d5dfa6a04c5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:39.264688 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4378/8739] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:29:39.269013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:39.279570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a113-c4a4-453c-abca-9479f12bccaa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:39.285647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:39.286297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:39.286901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:39.287175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] PATH_INFO: `/v3/projects/d933693eba02417cb9c0844a3c16b4ed/users/8319f90bfed2475aa23dd569b210c862/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:39.289111 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d933693eba02417cb9c0844a3c16b4ed, user_id=8319f90bfed2475aa23dd569b210c862, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:39.292355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48811192-0a15-4c46-9b2b-544c46143a8e admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:39.303273 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4362/8740] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:29:39 2022] PUT /identity/v3/projects/d933693eba02417cb9c0844a3c16b4ed/users/8319f90bfed2475aa23dd569b210c862/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:29:44.978466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:44.979064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:44.979064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:45.008573 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] MFA Rules not processed for user `8319f90bfed2475aa23dd569b210c862`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:45.009798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:45.089956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4379/8741] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:45.113374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b23fc-d5b4-4523-9a43-cc2eae838315 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:45.113870 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b23fc-d5b4-4523-9a43-cc2eae838315 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:45.113986 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b23fc-d5b4-4523-9a43-cc2eae838315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:45.169551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e73b23fc-d5b4-4523-9a43-cc2eae838315 None None] MFA Rules not processed for user `22e15ff208c1453ab8318e64575dc2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:45.170810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e73b23fc-d5b4-4523-9a43-cc2eae838315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:45.239124 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4363/8742] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Oct 31 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:29:45.245895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:45.256277 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b2cce-897c-4775-9987-2c4851430c57 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:45.261528 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:45.262147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:45.262430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:45.262738 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:45.332512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:45.334076 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1531bb8-068d-425a-bfa5-d27d10186f07 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:45.344822 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4380/8743] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:29:45.656249 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:45.656536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:45.656811 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:45.706927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:45.708159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:45.790873 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4364/8744] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:45.932851 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff70ae-5f95-4297-935b-974ae6d67f73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:45.933137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff70ae-5f95-4297-935b-974ae6d67f73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:45.933414 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff70ae-5f95-4297-935b-974ae6d67f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:45.984891 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03ff70ae-5f95-4297-935b-974ae6d67f73 None None] MFA Rules not processed for user `dd208aa4e6dc479a8a24bdfce4dff5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:45.986090 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03ff70ae-5f95-4297-935b-974ae6d67f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:46.007005 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:46.063130 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4381/8745] 10.222.0.13 () {58 vars in 1040 bytes} [Mon Oct 31 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:46.071246 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:29:46.086290 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061a1e-ce28-45cb-800f-636f83e6436f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:29:46.096711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:29:46.097402 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:46.097689 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:46.098033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:46.114666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:29:46.114666 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4503c9-b4e6-4e16-ab13-2bc59fd0d48a service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:29:46.121062 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4365/8746] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 15:29:56.059571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=23 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:56.117497 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:56.526903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:56.527191 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:56.527466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:29:56.546626 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] MFA Rules not processed for user `a2d3bdc6732a41068ef1950a9e4d7d76`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:29:56.547841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:29:56.554893 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4382/8747] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:29:59.977670 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:29:59.978142 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:29:59.978273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:00.000140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:30:00.001412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:00.009264 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4366/8748] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:30:00.023724 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:30:00.035486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66436508-22b7-40ed-ad16-eeb90251b733 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:30:00.041244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:30:00.041892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:30:00.042170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:30:00.042442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:00.051441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:30:00.053038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:30:00.062418 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4383/8749] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:04.220705 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:30:04.222220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:04.296236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bbae-5a6c-46cb-8f7b-de4d281b021f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:30:04.300765 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:30:04.301455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:30:04.301733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:30:04.302072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:04.304243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:04.408606 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:30:04.410057 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:30:04.431364 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4367/8750] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:30:05.566349 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:30:05.580976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ba9d-5657-450b-bb51-5b6b2cbe0283 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:30:05.584722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:30:05.585336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:30:05.586275 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:30:05.586565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:05.588709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:05.603444 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:30:05.604875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:30:05.616955 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4384/8751] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:30:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:30:14.428021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=66 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:15.611681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:35.584480 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:30:35.593723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff661af-ceac-424b-8bac-3339f98088cd service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:30:35.597398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:30:35.597993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:30:35.598272 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:30:35.598545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:35.607536 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:30:35.608981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:30:35.619092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4368/8752] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:30:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:30:38.017133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:30:38.018711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:38.041237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ed03-7c1a-4c6f-ad0f-15beb9f712bd service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:30:38.049973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:30:38.050587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:30:38.050892 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:30:38.051168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:30:38.052941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:30:38.065885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:30:38.067525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:30:38.078255 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4385/8753] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:30:45.614510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:48.073787 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:17.290992 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:32:17.300813 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ff24-ddc5-449e-8b38-79e7c82406f8 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:32:17.304548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:32:17.305181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:32:17.305459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:32:17.305736 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:32:17.307508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:32:17.317925 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:32:17.319401 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2307d-bf04-4e63-9918-1e2a39d375f5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:32:17.327752 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4369/8754] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:32:27.324667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:47.066287 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:33:47.068403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:47.188784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75fa5-3b20-4dc0-a517-4633890de1bf service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:33:47.194434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:33:47.195064 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:47.195342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:47.195614 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:47.197335 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:47.208203 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:33:47.209795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:33:47.219398 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4386/8755] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:33:48.067310 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3422-2dc4-4100-9c49-1fa519aa65e5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:48.067776 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3422-2dc4-4100-9c49-1fa519aa65e5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:48.067887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3422-2dc4-4100-9c49-1fa519aa65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:48.088735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ec9f3422-2dc4-4100-9c49-1fa519aa65e5 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:33:48.089938 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ec9f3422-2dc4-4100-9c49-1fa519aa65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:48.097156 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4370/8756] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:33:48.137709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:33:48.149019 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb8ea-8148-410b-af73-90e5ad4943db service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:33:48.154010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:33:48.154603 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:48.154976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:48.155256 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:48.163771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:33:48.165345 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:33:48.173495 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4387/8757] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:49.254882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:49.255350 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:49.255583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:49.275889 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:33:49.277077 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:49.284314 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4371/8758] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:33:49.296695 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:33:49.307183 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba5e1-533c-432c-97b2-c4d5e596d53f service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:33:49.312184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:33:49.312773 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:49.313049 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:49.313315 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:49.322219 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:33:49.323976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8684a38-81bd-4a2a-aa9d-5bf799c87383 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:33:49.332255 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4388/8759] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:58.733106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:33:58.734543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:58.749474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82563c1-6802-4b46-923b-0b7a68083e49 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:33:58.754639 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:33:58.755300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:58.755583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:58.755849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:58.758927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:58.770318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:33:58.771921 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:33:58.782498 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4372/8760] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:33:59.144517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:59.144989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:59.145092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:59.165442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] MFA Rules not processed for user `a2d3bdc6732a41068ef1950a9e4d7d76`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:33:59.166659 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:59.173653 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4389/8761] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:33:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:33:59.437338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:33:59.446474 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1372-7c91-4dac-9784-7113041544af service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:33:59.450714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:33:59.451304 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:33:59.451579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:33:59.451846 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:33:59.453530 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:33:59.476595 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:33:59.478027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49893b-d710-44e8-95fb-a30fd162b326 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:33:59.485969 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4373/8762] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:34:00.883663 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:34:00.895674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e71a7-3894-46a0-8f86-d75cbedd9bf6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:34:00.901129 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:34:00.901841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:34:00.902122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:34:00.902401 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:34:00.904163 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:34:00.915898 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:34:00.918078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:34:00.928080 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4390/8763] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:34:03.205282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:34:03.205808 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:34:03.206088 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:34:03.226369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:34:03.227710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:34:03.238799 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4374/8764] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:34:03.253986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:34:03.265712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eec935-1ede-4897-8e33-6b2bcec43a7a service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:34:03.270880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:34:03.271548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:34:03.271915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:34:03.272268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:34:03.280654 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:34:03.282213 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:34:03.290843 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4391/8765] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:13.220083 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=26 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:13.287033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:17.271287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:34:17.272697 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:34:17.287974 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aead7-494c-463c-bfa4-d068651bcecc None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:34:17.293573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:34:17.294168 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:34:17.294440 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:34:17.294745 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:34:17.296389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:34:17.308675 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:34:17.310236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:34:17.320518 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4375/8766] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:34:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:34:27.316467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:55.039709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:34:55.052023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1edd47-c58c-4d4e-b240-afa2b443cf6a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:34:55.057555 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:34:55.058171 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:34:55.058448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:34:55.058771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:34:55.066513 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:34:55.068168 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:34:55.076848 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4392/8767] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:34:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:35:05.072895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:06.021393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:06.031510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dcbae-74b4-47da-9f23-844ab9bc8f32 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:06.035175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:06.035766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:06.036039 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:06.036307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:06.047210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:06.048633 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:06.059831 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4376/8768] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:35:07.264088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:07.273241 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c90670-c4c6-414c-8117-b35b8b404fd5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:07.276889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:07.277472 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:07.277744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:07.278016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:07.288429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:07.290089 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6daeef-65f0-4624-888a-ec2101e10e82 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:07.301399 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4393/8769] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:35:16.054771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:17.295976 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:40.391047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:40.405556 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53742017-02fe-4c5b-afa1-e4b257e5cf5b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:40.413735 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:40.415046 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:40.415395 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:40.415734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:40.427297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:40.429456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:40.450943 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4377/8770] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:35:42.355604 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6775-785c-43fb-9732-a45b1950301b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:42.356133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6775-785c-43fb-9732-a45b1950301b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:42.356133 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6775-785c-43fb-9732-a45b1950301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:42.396814 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd0d6775-785c-43fb-9732-a45b1950301b None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:35:42.398063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd0d6775-785c-43fb-9732-a45b1950301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:35:42.408382 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4394/8771] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:35:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:35:42.422588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:42.434978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc7d4-3be3-4ea2-8ac6-a01730a22bdf service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:42.441417 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:42.442026 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:42.442306 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:42.442578 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:42.452866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:42.455288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:42.466920 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4378/8772] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:35:52.393986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:52.461648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=12 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:55.510630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:55.511114 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:55.511227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:55.541537 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:35:55.542751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:35:55.550128 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4395/8773] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:35:55.590018 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:55.600934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ad58-9e64-415c-8973-f29998f0367a service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:55.606191 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:55.606822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:55.607094 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:55.607363 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:55.615280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:55.616848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:55.625111 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4379/8774] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:56.499616 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:56.518547 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e3bff-027e-42b1-9b46-e9f5d9c28cf6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:56.522173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:56.522795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:56.523073 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:56.523342 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:56.591514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:56.592944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:56.602806 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4396/8775] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:35:59.872275 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:35:59.894915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91af76-0b87-4c81-bb9f-9bdaed1ec855 service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:35:59.900147 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:35:59.900753 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:35:59.901027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:35:59.901316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:35:59.903288 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:35:59.929346 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:35:59.931021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:35:59.940942 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4380/8776] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:35:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:03.554052 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:03.565960 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80793cfd-f0ea-4984-9621-2518ef94ef57 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:03.571385 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:03.572040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:03.572319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:03.572590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:03.574367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:03.586885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:03.590551 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:03.598451 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4397/8777] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:03.689702 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:03.702374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7fbc-18c0-4e62-aee0-d4f90c27000e service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:03.707351 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:03.708001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:03.708280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:03.708553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] PATH_INFO: `/v3/users/a2d3bdc6732a41068ef1950a9e4d7d76` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:03.709852 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d3bdc6732a41068ef1950a9e4d7d76)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:03.711888 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:03.873299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d3bdc6732a41068ef1950a9e4d7d76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:03.873896 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d3bdc6732a41068ef1950a9e4d7d76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:03.927344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d3bdc6732a41068ef1950a9e4d7d76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:03.941132 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d3bdc6732a41068ef1950a9e4d7d76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:03.941796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d3bdc6732a41068ef1950a9e4d7d76'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:03.954326 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4381/8778] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:36:03 2022] DELETE /identity/v3/users/a2d3bdc6732a41068ef1950a9e4d7d76 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:04.197688 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:04.210290 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e6c8-9708-4ebb-8fc9-9ee43963d2fe service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:04.269529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:04.270155 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:04.270434 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:04.270742 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] PATH_INFO: `/v3/projects/187a6e386c7749e9a25935e9613b3426` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:04.271853 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=187a6e386c7749e9a25935e9613b3426)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:04.273744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:04.403413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187a6e386c7749e9a25935e9613b3426', 'request_id': 'req-738b3206-8fe9-4750-b271-2908eb109b1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.405078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:04.481971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187a6e386c7749e9a25935e9613b3426', 'request_id': 'req-738b3206-8fe9-4750-b271-2908eb109b1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.488098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187a6e386c7749e9a25935e9613b3426', 'request_id': 'req-738b3206-8fe9-4750-b271-2908eb109b1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.513088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] The token cache is being invalidate because project 187a6e386c7749e9a25935e9613b3426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:36:04.513379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.514006 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.515509 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4398/8779] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:36:04 2022] DELETE /identity/v3/projects/187a6e386c7749e9a25935e9613b3426 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:04.520005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:04.521479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:04.534832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e1fb-a747-4336-9414-bc4dbfc252f7 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:04.590253 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:04.590901 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:04.591176 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:04.591445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] PATH_INFO: `/v3/users/8319f90bfed2475aa23dd569b210c862` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:04.592567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8319f90bfed2475aa23dd569b210c862)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:04.594501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:04.683380 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:04.776241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8319f90bfed2475aa23dd569b210c862'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.776916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8319f90bfed2475aa23dd569b210c862'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.830481 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8319f90bfed2475aa23dd569b210c862'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.843854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8319f90bfed2475aa23dd569b210c862'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.844491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-7b9beeee-f80d-49ec-94e2-99703db5b82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8319f90bfed2475aa23dd569b210c862'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:04.856793 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4382/8780] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:36:04 2022] DELETE /identity/v3/users/8319f90bfed2475aa23dd569b210c862 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:05.083273 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.084707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:05.098153 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b3206-8fe9-4750-b271-2908eb109b1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.156516 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.157148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.157428 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.157701 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] PATH_INFO: `/v3/projects/d933693eba02417cb9c0844a3c16b4ed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.158841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d933693eba02417cb9c0844a3c16b4ed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.160795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.280634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd933693eba02417cb9c0844a3c16b4ed', 'request_id': 'req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:05.344586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd933693eba02417cb9c0844a3c16b4ed', 'request_id': 'req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:05.351310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd933693eba02417cb9c0844a3c16b4ed', 'request_id': 'req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:05.363128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] The token cache is being invalidate because project d933693eba02417cb9c0844a3c16b4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:36:05.363411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:05.364062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5c0eb2-ddf6-4a5d-80fe-caa1be225660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:36:05.365546 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4399/8781] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:36:05 2022] DELETE /identity/v3/projects/d933693eba02417cb9c0844a3c16b4ed => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:05.370793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.371082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.371358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.410387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:36:05.411647 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:05.469458 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4383/8782] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:36:05.477757 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.478044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.478317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.498195 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:36:05.499424 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:05.507318 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4400/8783] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:36:05.511438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.520975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee873f-6d3e-4492-ac35-2a755d88efdd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.525477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.526061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.526336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.526601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.527262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:36:05.527557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.529133 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.541193 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4384/8784] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:36:05.545208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.555466 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25791d-3bed-435a-b210-b7c7c8911de1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.560023 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.560674 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.560877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.561145 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.561767 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.563790 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.637166 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4401/8785] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:36:05 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:36:05.641555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.651518 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3245c5-f3ee-444e-bc16-5e1529c9c0d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.708178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.708783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.709058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.709323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.709943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.712320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.791402 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4385/8786] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:36:05 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:36:05.795569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.806336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd15-846b-4e1d-9e89-925490bad892 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.811363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.811961 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.812240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.812510 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.813173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.814838 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.825423 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4402/8787] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:36:05.829531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.840179 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd9f53-5b31-4554-afbb-997237c867ee admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.844760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.845349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.845629 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.845899 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.846560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.848824 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a623c3-7253-429b-b2a6-0f6f34976817 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.850065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:05.860205 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4386/8788] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:36:05.864330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:05.874323 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1c199-f029-4006-baed-84941dc4071d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:05.879247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:05.879886 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.880161 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.880562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] PATH_INFO: `/v3/projects/53d0ac88511a4b7d9567143f9b667833/users/5eccd1a5997e4266a03a6f50ddb44d5c/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:05.896217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d0ac88511a4b7d9567143f9b667833, user_id=5eccd1a5997e4266a03a6f50ddb44d5c, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:05.898950 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:05.901138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:05.974192 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4403/8789] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:36:05 2022] PUT /identity/v3/projects/53d0ac88511a4b7d9567143f9b667833/users/5eccd1a5997e4266a03a6f50ddb44d5c/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:05.994510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:05.994841 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:05.995117 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.025009 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:36:06.026262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:06.090671 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4387/8790] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:36:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:36:06.095109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.156563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae877f-667a-44ee-aec7-45f32cf9f0b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.161324 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.161922 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.164562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.164562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.164562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.165294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.247815 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4404/8791] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:36:06 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:36:06.251885 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.263226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c135442-03c1-41dd-82d8-ad2ac9d4c353 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.321958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.322560 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.322872 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.323140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.323771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.325695 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.422719 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4388/8792] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:36:06 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:36:06.427294 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.440198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484f332-c183-4b28-9b7b-c1adbf183fe6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.445485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.446082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.446355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.446691 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.447326 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.448895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.459753 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4405/8793] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:36:06.463957 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.474214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3088a-2eee-4683-a2cc-cb292d344cd2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.478945 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.479601 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.479866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.480134 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] PATH_INFO: `/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333/users/b8b5374d0d2545058e9a4878541deafa/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.495453 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc7ba3b067846f3b7d4e9b45d733333, user_id=b8b5374d0d2545058e9a4878541deafa, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.498103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.602996 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4389/8794] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:36:06 2022] PUT /identity/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333/users/b8b5374d0d2545058e9a4878541deafa/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:06.607022 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.618295 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f41fb-6fc7-4a13-9b8a-3f984abc6bab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.676138 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.676765 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.677040 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.677308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.677933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.679645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9b8b-7b27-48d0-a337-39244d08c2a5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.691144 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4406/8795] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:36:06.695936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.706500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa9505-e82e-4d3a-b404-d621a96eab24 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.711334 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.714972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.714972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.714972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] PATH_INFO: `/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333/users/b8b5374d0d2545058e9a4878541deafa/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.714972 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc7ba3b067846f3b7d4e9b45d733333, user_id=b8b5374d0d2545058e9a4878541deafa, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:06.717667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:06.729302 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4390/8796] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:36:06 2022] PUT /identity/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333/users/b8b5374d0d2545058e9a4878541deafa/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:36:06.740165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.740448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.740719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:06.770204 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] MFA Rules not processed for user `b8b5374d0d2545058e9a4878541deafa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:36:06.771474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:06.824340 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:06.845366 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4407/8797] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:36:06.864296 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:06.866569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:06.912227 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:06.950257 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb4287-f0a8-4391-a636-af609b369355 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:06.955741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:06.956367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:06.956645 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:06.956916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:07.014966 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:07.016649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3224f-8fa0-44b3-9a00-85d255b2d706 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:07.026724 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4391/8798] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:12.039043 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:12.040986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:12.100274 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b4250-bedb-4aa9-b646-eec7d0797cef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:12.103894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:12.104499 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:12.104778 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:12.105173 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:12.114956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:12.116586 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:12.126467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4408/8799] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:15.631074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:15.631600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:15.631600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:15.653167 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:36:15.654803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:15.664821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4392/8800] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:36:16.005944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:16.007314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:16.018831 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41d78-12f4-43e1-85c5-17babb3767ed service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:16.023165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:16.023764 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:16.024047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:16.024321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:16.026026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:16.035465 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:16.036872 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:16.044935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4409/8801] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:16.483988 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:16.485479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:16.587879 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd466b-446f-4b72-af6e-4a0dbe68a0d0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:16.593331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:16.594030 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:16.594228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:16.594750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:16.596464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:16.609975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:16.611642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d138ec7-6274-4359-8bb1-366fabed7062 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:16.623720 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4393/8802] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:36:19.789054 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:36:19.800332 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda8c6-9814-4b99-bffb-08599442b7d3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:36:19.804325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:36:19.805062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:36:19.805442 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:36:19.805870 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:36:19.808263 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:36:19.819303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:36:19.820739 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:36:19.829365 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4410/8803] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:36:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:36:26.618557 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=74 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:29.825536 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=43 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:56.974491 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:37:56.975078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:37:56.975078 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:37:56.995927 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:37:56.997124 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:37:57.004239 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4394/8804] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:38:00.864520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:38:00.875272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b17d3-1a15-43f2-b1ac-1477a1cc642b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:38:00.879317 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:38:00.880102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:38:00.880384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:38:00.880651 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:38:00.882413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:38:00.892801 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:38:00.894284 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:38:00.902851 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4411/8805] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:38:06.989400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:10.898992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:54.628476 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:38:54.640793 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b46757-e6bb-4857-901e-3419c5db5ea5 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:38:54.645915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:38:54.646511 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:38:54.646822 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:38:54.647118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:38:54.649513 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:38:54.660772 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:38:54.662362 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879803-4572-40ec-9de0-f91cfc2ee3e4 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:38:54.672978 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4395/8806] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:39:02.714558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:39:02.716032 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:02.731900 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd68e6-82a5-456a-80da-51a3d038aae7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:39:02.736864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:39:02.737457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:39:02.737736 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:39:02.738003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:39:02.739703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:02.751575 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:39:02.753137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:39:02.762842 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4412/8807] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:39:04.668882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:12.758723 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:48.525779 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:39:48.526338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:39:48.526338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:39:48.580643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:39:48.582383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:48.591101 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4396/8808] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:39:48.981311 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:39:48.990920 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30d01-c7df-4f2f-a64c-abe113473f44 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:39:48.994707 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:39:48.995384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:39:48.995732 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:39:48.996069 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:39:48.997937 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:49.007744 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:39:49.009782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:39:49.018091 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4413/8809] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:39:58.563047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:59.014364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:59.367817 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:39:59.369250 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:59.391937 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b36169-091f-44cc-952d-18b382a11ce6 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:39:59.397455 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:39:59.398060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:39:59.398339 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:39:59.398611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:39:59.400934 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:39:59.412654 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:39:59.414326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:39:59.425487 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4397/8810] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:40:09.420609 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:18.447893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:18.472218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b52-6fad-498a-954a-ba31bb96b4ea service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:18.478520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:18.479330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:18.479677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:18.479953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:18.489657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:18.493061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:18.501322 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4414/8811] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:18.559159 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:18.569407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58239-37f2-4d5f-9b6d-d2071e6d3e1d service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:18.573047 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:18.573638 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:18.573911 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:18.574199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:18.581429 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:18.582897 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7df6d1-9add-4ef9-8922-e78b8a58cd51 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:18.591107 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4398/8812] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:18.904463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:18.914339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1cde9-cf8c-417f-a2ad-02ea582fcfc1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:18.918319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:18.918944 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:18.919218 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:18.920062 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:18.921222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:18.950038 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:18.951430 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:18.962995 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4415/8813] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:41:19.017268 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.017599 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.017880 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.060438 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] MFA Rules not processed for user `d72035cfc0a24494a557a50792e6382d`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:41:19.061659 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:19.068866 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4399/8814] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:41:19.080903 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:19.089877 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6814c-455a-4f57-94a4-60e4616a4987 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:19.093606 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:19.094255 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.094538 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.094850 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.102047 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:19.103486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332ff5-63d7-4858-83d6-8f4c5123dc39 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:19.111255 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4416/8815] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:19.266600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:19.278724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc97b4-e364-47db-9f75-4562ea5e8fdd None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:19.283785 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:19.287391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.287391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.287391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.287391 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:19.300073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:19.301649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:19.311839 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4400/8816] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:19.620066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.625198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.625198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.640026 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:41:19.641223 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:19.650604 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4417/8817] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:41:19.661512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:19.671411 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f192-064c-4ad2-ab75-22ebdfce55f6 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:19.675617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:19.676225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.676696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.676961 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.687074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:19.688545 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:19.700290 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4401/8818] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:19.763532 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:19.774780 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50283d-fd91-4bab-9d65-b428e5a7221c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:19.779692 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:19.780285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:19.780562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:19.780835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:19.782558 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:19.794368 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:19.795963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:19.806337 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4418/8819] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:20.154573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:20.163611 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ada0c5-771d-4269-b525-858fc159969c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:20.167543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:20.168131 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:20.168407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:20.168674 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:20.170377 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:20.183610 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:20.185058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:20.196762 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4402/8820] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:21.475343 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:21.485579 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3498e7-0390-46c9-b7dd-c9db7f38fa3d service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:21.490930 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:21.493719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:21.493719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:21.493719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:21.500308 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:21.501865 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:21.511887 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4419/8821] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:41:30.191864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=33 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:31.507637 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=42 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:35.206750 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:41:35.219387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebff4e-40ea-43ae-b359-238cb901196e service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:41:35.225687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:41:35.226293 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:41:35.226569 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:41:35.226862 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:41:35.228583 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:41:35.242074 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:41:35.244551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:41:35.261704 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4403/8822] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:41:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:41:45.254393 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:14.674291 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:42:14.687560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74bb7-a9e1-43f8-8256-e9ad2e6d0cb5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:42:14.693608 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:42:14.694336 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:42:14.694621 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:42:14.694925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:42:14.696693 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:42:14.710443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:42:14.712521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:42:14.728969 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4420/8823] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:19.935180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:42:19.947425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235df31c-f805-4917-acdd-0f2ac03eb88f service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:42:19.953381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:42:19.953973 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:42:19.954752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:42:19.955109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:42:19.956874 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:42:19.970178 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:42:19.972079 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b1d64-6664-4b42-95fc-7c5052d1a3f9 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:42:19.982807 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4404/8824] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:24.723116 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:27.215390 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:42:27.225514 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4868-b347-48fa-8cda-bd2ed280a3d6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:42:27.229227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:42:27.229832 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:42:27.230106 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:42:27.230380 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:42:27.240132 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:42:27.241735 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:42:27.252467 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4421/8825] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:29.978303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:30.724605 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:42:30.724836 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:42:30.725146 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:42:30.745814 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:42:30.747640 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:42:30.755989 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4405/8826] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:42:31.598045 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:42:31.614572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d18579-6a35-4dfa-a3c5-cbbb49160a33 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:42:31.620134 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:42:31.620746 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:42:31.621027 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:42:31.621300 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:42:31.630983 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:42:31.632652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:42:31.645595 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4422/8827] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:40.740553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:41.639237 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:06.303830 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:43:06.314477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d200d8-4f47-4624-bc8e-5b94fed63ef0 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:43:06.318320 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:43:06.318943 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:43:06.319225 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:43:06.319496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:43:06.326999 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:43:06.328486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:43:06.336494 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4406/8828] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:43:16.332969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:54.592546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:43:54.632956 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93911-f074-46eb-b0d6-af04fdabc1fd service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:43:54.638093 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:43:54.638715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:43:54.638992 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:43:54.639262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:43:54.647760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:43:54.649330 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df243ff4-eb29-4a05-bf26-e1878412fcde service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:43:54.659379 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4423/8829] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:44:04.654859 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=20 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:08.679944 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:44:08.701271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578ed73-5422-48f7-a82f-9c775894b60e service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:44:08.706416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:44:08.707043 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:44:08.707321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:44:08.707592 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:44:08.716838 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:44:08.718512 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:44:08.729166 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4407/8830] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:44:18.724882 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=11 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:23.379362 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:44:23.385310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:44:23.385310 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:44:23.417098 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] MFA Rules not processed for user `5eccd1a5997e4266a03a6f50ddb44d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:44:23.418521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:44:23.427600 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4424/8831] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:44:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:44:33.410828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:00.100607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:00.138087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08700-f89c-4d6b-8ba2-3e96cc94f8d2 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:00.144382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:00.145224 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:00.145507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:00.145781 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:00.147653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:00.176555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:00.178100 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d8ff8-0be7-4b61-a3ce-6e86e842482b service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:00.188235 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4408/8832] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:00.606137 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:00.692044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd977de6-0974-48b8-90d8-74ca5d75fab2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:00.696645 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:00.697280 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:00.697563 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:00.697971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] PATH_INFO: `/v3/users/5eccd1a5997e4266a03a6f50ddb44d5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:00.699279 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eccd1a5997e4266a03a6f50ddb44d5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:00.701189 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:00.883549 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eccd1a5997e4266a03a6f50ddb44d5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:00.884202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eccd1a5997e4266a03a6f50ddb44d5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:00.955482 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eccd1a5997e4266a03a6f50ddb44d5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:00.969712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eccd1a5997e4266a03a6f50ddb44d5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:00.970824 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eccd1a5997e4266a03a6f50ddb44d5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:00.985679 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4425/8833] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:46:00 2022] DELETE /identity/v3/users/5eccd1a5997e4266a03a6f50ddb44d5c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:00.991119 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:00.991425 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:00.991714 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:01.012161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:01.016262 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:01.073821 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4409/8834] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:01.084478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:01.085910 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:01.155894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:01.165166 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12d92-c084-4e44-b8c7-7a9a91a7e928 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:01.180845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:01.180845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:01.180845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:01.180845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:01.181341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:01.181762 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:01.195479 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4426/8835] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:46:01.454579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:01.457523 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:01.469266 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3bfc-0486-486d-a6dd-84be00d38417 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:01.475407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:01.476502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:01.476953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:01.477336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] PATH_INFO: `/v3/projects/53d0ac88511a4b7d9567143f9b667833` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:01.479496 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d0ac88511a4b7d9567143f9b667833)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:01.482069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:01.593297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d0ac88511a4b7d9567143f9b667833', 'request_id': 'req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:01.681463 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d0ac88511a4b7d9567143f9b667833', 'request_id': 'req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:01.688716 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d0ac88511a4b7d9567143f9b667833', 'request_id': 'req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:01.704318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] The token cache is being invalidate because project 53d0ac88511a4b7d9567143f9b667833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:46:01.704566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:01.705315 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:01.707709 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4410/8836] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:46:01 2022] DELETE /identity/v3/projects/53d0ac88511a4b7d9567143f9b667833 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:46:01.711905 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:01.722036 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4435b-1d74-4ea1-b352-897a6d3fdce0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:01.787709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:01.788351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:01.788641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:01.788924 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] PATH_INFO: `/v3/users/b8b5374d0d2545058e9a4878541deafa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:01.790074 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b5374d0d2545058e9a4878541deafa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:01.792066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:02.016569 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b5374d0d2545058e9a4878541deafa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.017254 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b5374d0d2545058e9a4878541deafa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.126836 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b5374d0d2545058e9a4878541deafa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.140234 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b5374d0d2545058e9a4878541deafa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.140928 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34f6ceea-932a-4f3d-a1dd-010531aae2c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b5374d0d2545058e9a4878541deafa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.154343 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4427/8837] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:46:01 2022] DELETE /identity/v3/users/b8b5374d0d2545058e9a4878541deafa => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:02.657317 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:02.658271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:02.672555 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85efc5-6e39-4bfc-a9b7-563c569b3cc3 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:02.725355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:02.741181 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:02.741883 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:02.742255 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:02.742502 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] PATH_INFO: `/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:02.743717 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc7ba3b067846f3b7d4e9b45d733333)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:02.745733 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:02.846989 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc7ba3b067846f3b7d4e9b45d733333', 'request_id': 'req-778ae046-e9fc-4022-bb34-a8bb2b141a8f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.932301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc7ba3b067846f3b7d4e9b45d733333', 'request_id': 'req-778ae046-e9fc-4022-bb34-a8bb2b141a8f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.939400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc7ba3b067846f3b7d4e9b45d733333', 'request_id': 'req-778ae046-e9fc-4022-bb34-a8bb2b141a8f'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.951214 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] The token cache is being invalidate because project 4fc7ba3b067846f3b7d4e9b45d733333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:46:02.951507 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.952162 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-778ae046-e9fc-4022-bb34-a8bb2b141a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:46:02.953848 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4411/8838] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:46:02 2022] DELETE /identity/v3/projects/4fc7ba3b067846f3b7d4e9b45d733333 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:02.959966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:02.967056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:02.967056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:02.999201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:03.000411 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:03.045546 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:03.060477 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4428/8839] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:03.069356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.069684 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.070019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.091070 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:03.092292 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:03.100997 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4412/8840] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:03.105375 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.115622 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db78608-8963-4cb8-b8ed-c2e8fd84d950 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.121039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.121791 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.122529 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.123008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.123657 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:46:03.123959 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.125561 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.137623 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4429/8841] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:46:03.142484 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.153459 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d26b9-adf6-466a-ab0b-d471a209b7fb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.158199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.158832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.159107 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.159383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.160710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.162724 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.276474 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4413/8842] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:46:03 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:46:03.280855 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.291919 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8555e-c879-4c3e-bb7a-8fdcaf324d44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.353188 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.353795 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.354077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.354350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.355025 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.356941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.439921 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4430/8843] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:46:03 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:46:03.452723 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.463858 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03755-6667-44fb-aaea-aa394e88016d admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.468641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.469237 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.469516 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.469788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.470426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.472060 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.482197 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4414/8844] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:46:03.486471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.497270 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425bf98-c364-4b7e-ab7c-4ba6c65c8e66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.501968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.502566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.502885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.503162 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.504351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.505941 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9df75-c71d-4029-be86-8a423b055795 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.518283 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4431/8845] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:46:03.523090 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.533116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b960-ad9f-412f-9921-89f90e4ce0a9 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.537820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.538467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.538789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.539066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] PATH_INFO: `/v3/projects/95ff7a2e9e58471b8bc700f5db25c4c6/users/5a0d0840b1a44e4eadce9c77f0ad4621/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.555815 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ff7a2e9e58471b8bc700f5db25c4c6, user_id=5a0d0840b1a44e4eadce9c77f0ad4621, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.558548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.652082 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4415/8846] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:46:03 2022] PUT /identity/v3/projects/95ff7a2e9e58471b8bc700f5db25c4c6/users/5a0d0840b1a44e4eadce9c77f0ad4621/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:03.657432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f99-6444-488e-b4f6-55856648b1db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.657763 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f99-6444-488e-b4f6-55856648b1db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.658087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f99-6444-488e-b4f6-55856648b1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.678954 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-615f1f99-6444-488e-b4f6-55856648b1db None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:03.683271 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-615f1f99-6444-488e-b4f6-55856648b1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:03.742816 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4432/8847] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:03.755358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:03.757416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:03.814867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3d37-c6d4-4013-8ea7-6392525c40e2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:03.819135 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:03.819737 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:03.820011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:03.820277 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:03.829336 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:03.830789 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:03.840221 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4416/8848] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:09.318190 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:09.318856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:09.318856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:09.364533 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] MFA Rules not processed for user `5a0d0840b1a44e4eadce9c77f0ad4621`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:09.366187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:09.429526 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:09.459690 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4433/8849] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:09.474195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:09.474195 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:09.477064 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f54-8add-4c11-b07b-ae92d0e95dea service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:09.481953 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:09.482564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:09.482904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:09.483180 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] PATH_INFO: `/v3/projects` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:09.483956 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:09.485949 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:09.630010 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4417/8850] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:46:09 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:46:09.635647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:09.648837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7a31f-1318-4415-94cf-45fbd3d2b8a2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:09.729388 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:09.730033 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:09.730292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:09.730562 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:09.731244 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:09.733413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:09.826156 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4434/8851] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:46:09 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:46:09.830415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:09.856607 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bad47-a405-4b03-9b81-52b4d7f99390 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:09.861969 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:09.862510 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:09.863587 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:09.863917 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:09.864796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:09.867305 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:09.881217 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4418/8852] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:46:09.887777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:09.906276 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251ef89-a8fb-482d-a0d7-cae8a62a962f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:09.914727 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:09.915936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:09.916448 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:09.917319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] PATH_INFO: `/v3/projects/79946c3e89cd4784932f163ccc910ace/users/3ab19e79d3324aa39adbca9b75e2e293/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:09.945102 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79946c3e89cd4784932f163ccc910ace, user_id=3ab19e79d3324aa39adbca9b75e2e293, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:09.950187 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:10.030982 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4435/8853] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:46:09 2022] PUT /identity/v3/projects/79946c3e89cd4784932f163ccc910ace/users/3ab19e79d3324aa39adbca9b75e2e293/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:10.035318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:10.048544 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d10c3-df0a-44e1-b04c-35ca7af9450a admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:10.124381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:10.124906 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:10.125185 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:10.125461 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:10.126125 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:10.127855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0bcd5-7037-44ec-b5f6-0e54d8a6f288 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:10.144567 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4419/8854] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:46:10.148882 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:10.162777 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095708b-5989-484d-b107-3b3496a64425 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:10.170904 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:10.171596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:10.171887 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:10.172160 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] PATH_INFO: `/v3/projects/79946c3e89cd4784932f163ccc910ace/users/3ab19e79d3324aa39adbca9b75e2e293/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:10.174247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79946c3e89cd4784932f163ccc910ace, user_id=3ab19e79d3324aa39adbca9b75e2e293, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:10.177572 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:10.193339 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4436/8855] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:46:10 2022] PUT /identity/v3/projects/79946c3e89cd4784932f163ccc910ace/users/3ab19e79d3324aa39adbca9b75e2e293/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:46:16.889653 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3142-9976-4639-8f4f-d1940a0ca91f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:16.890247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3142-9976-4639-8f4f-d1940a0ca91f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:16.890247 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d3142-9976-4639-8f4f-d1940a0ca91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:16.929756 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-a24d3142-9976-4639-8f4f-d1940a0ca91f None None] MFA Rules not processed for user `3ab19e79d3324aa39adbca9b75e2e293`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:16.931465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a24d3142-9976-4639-8f4f-d1940a0ca91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:17.024067 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4420/8856] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:17.042639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:17.045810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:17.131552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaee0e-f502-42ce-ad59-4192b5d2721f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:17.137856 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:17.138471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:17.138800 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:17.139080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:17.178146 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:17.204372 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:17.206868 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:17.217220 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4437/8857] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:20.174467 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:20.175066 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:20.175190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:20.196164 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] MFA Rules not processed for user `5a0d0840b1a44e4eadce9c77f0ad4621`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:46:20.197394 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:20.204403 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4421/8858] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:46:20.247845 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:20.249677 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:20.333072 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965981-5ffc-4b10-83f2-b06daec91bb2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:20.336711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:20.337319 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:20.337591 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:20.337864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:20.339587 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:20.357048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:20.358440 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:20.370872 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4438/8859] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:20.670948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:20.724378 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:20.740952 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fff7dc-f409-4a08-874b-d8e8717260ae None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:20.746051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:20.746859 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:20.747248 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:20.747615 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:20.749763 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:20.761464 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:20.763173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:20.772040 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4422/8860] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:21.266232 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:21.277110 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd74328-f730-4687-9165-36d9bbf31f2a service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:21.281077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:21.281864 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:21.282143 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:21.282413 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:21.284782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:21.298822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:21.300365 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:21.313407 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4439/8861] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:30.788175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:30.808389 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54275e35-0aae-47cb-8e1b-2c9b4350e8eb service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:30.814145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:30.814770 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:30.815045 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:30.815356 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:30.817152 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:30.830254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:30.831855 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:30.842922 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4423/8862] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:46:31.307830 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=53 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:33.277426 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:33.289306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090903-e26d-42f6-8029-6b89de0ff7d4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:33.293247 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:33.294125 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:33.294406 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:33.294719 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:33.305177 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:33.312156 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:33.317512 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4440/8863] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:46:35.708183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:46:35.720355 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eb6fa-ce29-4756-b669-18a689bad2bd service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:46:35.731922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:46:35.733361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:46:35.734019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:46:35.734677 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:46:35.736848 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:46:35.750002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:46:35.752875 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f9158-6d8d-46f8-ad77-a5f6af3cf5fc service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:46:35.763413 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4424/8864] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:43.312671 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:45.758539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=22 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:10.306457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:48:10.308379 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:48:10.322460 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea587-f651-4455-80c7-bc3ea7d8e8e7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:48:10.327521 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:48:10.328355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:48:10.328634 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:48:10.328908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:48:10.330783 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:48:10.341804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:48:10.343334 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:48:10.354323 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4441/8865] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:48:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:48:20.348374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:46.609002 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:48:46.610035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:48:46.610035 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:48:46.693751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:48:46.695104 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:48:46.783022 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4425/8866] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:48:46.948477 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:48:46.949962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:48:47.077505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1e62-9ffe-473f-b606-b6e422c72781 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:48:47.082925 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:48:47.083539 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:48:47.083821 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:48:47.084099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:48:47.094101 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:48:47.095325 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:48:47.104956 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4442/8867] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:48:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:56.779648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=44 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:57.101583 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:01.878567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:01.880386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:01.968001 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce85367-6401-4744-afdb-ab3510b0d827 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:01.974343 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:01.975061 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:01.975542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:01.976037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:01.979514 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:02.001891 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:02.005005 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7de5e6-387e-41ca-9f78-8fecf911720f service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:02.025779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4426/8868] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:49:03.736245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:03.747258 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70bec-911c-400b-9e9a-221ebc3101d0 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:03.751105 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:03.751734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:03.752008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:03.752281 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:03.754095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:03.764364 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:03.771550 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:03.775419 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4443/8869] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:49:04.422335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:04.422335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:04.422335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:04.507171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] MFA Rules not processed for user `7cf0897f734e424a9dbbda87f9c0d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:49:04.507171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:04.513220 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4427/8870] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Oct 31 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:49:04.530825 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:04.541193 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49636fb-b505-4b8e-8bb8-5317a024eaff service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:04.545283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:04.559391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:04.559391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:04.559391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:04.559391 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:04.559989 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:04.572685 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4444/8871] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:49:04.889241 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:04.899982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6fcda-269c-4627-a3aa-c459cebaa998 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:04.905600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:04.906454 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:04.906975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:04.907456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:04.910361 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:04.925577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:04.927073 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:04.936728 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4428/8872] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:49:05.035131 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:05.052207 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f090-9412-4e81-be7e-2e0352499f02 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:05.058463 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:05.059525 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:05.060008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:05.060493 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:05.063356 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:05.087667 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:05.090341 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0829b-6b55-4f72-b313-06ff590581d6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:05.112449 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4445/8873] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:49:05.199234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:05.201499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:05.220027 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be83f-f923-4605-a8b9-5dc74854fce5 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:05.225803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:05.226431 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:05.226744 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:05.227019 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:05.228928 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:05.242118 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:05.243767 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:05.258771 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4429/8874] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:49:07.808272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:07.808885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:07.808885 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:07.830731 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:49:07.831957 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:07.840217 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4446/8875] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:49:07.855212 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:07.867357 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b52d-06fc-46ee-902a-6c1024bc9c8b service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:07.872978 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:07.873643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:07.873923 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:07.874197 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:07.883600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:07.885206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c077a33-79cb-4916-8373-559578b4504f service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:07.894301 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4430/8876] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 15:49:13.739505 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:13.768059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94584b2-c6fb-408e-be65-776ac802528c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:13.768059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:13.768059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:13.768059 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:13.768602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:13.768602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:13.778611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:13.780245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:13.795499 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4447/8877] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:49:17.890359 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=63 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:23.020416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:23.021202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:23.021202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:23.041668 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:49:23.042915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:49:23.050692 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4431/8878] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:49:23.064703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:49:23.076431 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aa7f7-b552-4f55-9097-7c28cb0e3353 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:49:23.081358 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:49:23.081958 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:49:23.082233 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:49:23.082501 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:49:23.091455 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:49:23.093178 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaded4-5a34-4a24-87a3-ab11050f30d1 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:49:23.101988 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4448/8879] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 15:49:33.036170 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:33.098398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=33 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:41.509932 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:50:41.511826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:50:41.535109 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4820b-afc1-4ded-a671-d1f1fa789a7f None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:50:41.541777 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:50:41.542424 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:50:41.542760 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:50:41.543036 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:50:41.544829 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:50:41.558573 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:50:41.560446 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:50:41.571161 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4432/8880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:50:46.367398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:50:46.367984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:50:46.367984 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:50:46.388689 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] MFA Rules not processed for user `5a0d0840b1a44e4eadce9c77f0ad4621`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:50:46.389934 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:50:46.401319 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4449/8881] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:50:51.566600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=9 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:56.383042 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:09.707216 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:51:09.721577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bed898-49ed-4dca-a12c-52d0a8da008b service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:51:09.727368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:51:09.728145 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:51:09.728561 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:51:09.729052 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:51:09.732643 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:51:09.747687 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:51:09.749286 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:51:09.762331 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4433/8882] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:51:17.357712 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:51:17.359167 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:51:17.446908 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457939a-fd9a-4813-a6cb-a393ccb5f246 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:51:17.454417 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f863d5b33d4f10a053481933f03555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:51:17.455095 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:51:17.455374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:51:17.455647 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:51:17.465640 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:51:17.467117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:51:17.476704 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4450/8883] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:51:19.757309 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:20.331076 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:51:20.341234 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37b8fd-2348-4f5b-8e17-137d54417623 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:51:20.345331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:51:20.345922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:51:20.346199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:51:20.346477 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:51:20.357340 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:51:20.358788 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:51:20.381497 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4434/8884] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:51:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:51:21.581841 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:51:21.592127 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0848e-9e07-4af9-808c-e73cdea10966 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:51:21.595804 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:51:21.596784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:51:21.596784 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:51:21.597600 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:51:21.608813 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:51:21.610435 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:51:21.622961 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4451/8885] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:51:30.378072 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=10 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:31.617091 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:17.346832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:53:17.356021 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3fdbe-dd57-4f6e-8197-7058cf2ed8cb service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:53:17.360198 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:53:17.360796 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:53:17.361080 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:53:17.361367 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:53:17.369766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:53:17.371338 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:53:17.380211 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4435/8886] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:53:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:53:27.376527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:06.606559 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:06.640708 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c2fb1-b08e-4767-854d-3ad2142377cb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:06.646596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:06.647306 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:06.647672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:06.648007 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:06.657373 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:06.659698 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:06.670288 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4452/8887] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:15.462980 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:15.484299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fe78-da29-4565-b858-e1c8330152b4 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:15.490269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:15.490535 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:15.491084 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:15.491624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:15.504864 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:15.506916 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:15.515713 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4436/8888] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:16.643063 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:16.663844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cab93-38d4-48f4-b9d5-2604e73b00a2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:16.667750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:16.668360 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:16.668669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:16.668942 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:16.680643 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:16.682082 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:16.694307 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4453/8889] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:16.791303 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:16.809200 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856758be-cb42-4767-998e-653b17a3840b service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:16.816238 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:16.816850 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:16.817128 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:16.817577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:16.827594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:16.829171 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:16.840666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:16.845245 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4437/8890] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:16.855262 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d32c4-987d-46ac-bdfb-19450a85476a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:16.862201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:16.862889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:16.863112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:16.863384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:16.872630 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:16.874403 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:16.885791 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4454/8891] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:54:21.706604 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:21.726458 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dad5d-989f-4f79-880f-3426460c4776 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:21.732383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:21.733416 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:21.733758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:21.734089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:21.743708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:21.745347 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:21.756297 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4438/8892] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:23.850240 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:23.860374 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8f68-5e21-4611-9efc-76422ac7a6c9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:23.864860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:23.865509 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:23.865793 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:23.866066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:23.867966 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:54:23.889285 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:23.890760 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:23.900573 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4455/8893] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:24.989279 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:54:25.005284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579da77-45e1-493e-85f3-698c311259d0 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:54:25.011641 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:54:25.012251 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:54:25.012529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:54:25.012832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:54:25.023383 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:54:25.027936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:54:25.037450 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4439/8894] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:54:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:54:33.895788 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=42 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:35.031699 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=29 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:18.139103 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:18.254968 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a86efb-d5c1-410b-a3ca-91ca068afa6b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:18.260935 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:18.261683 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:18.262229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:18.262410 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:18.264672 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:18.352711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:18.354303 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:18.376215 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4456/8895] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:20.660876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:20.662300 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:20.708140 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57c323-60ca-4e4b-abb9-2c3aed31703b service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:20.711909 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:20.712570 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:20.712828 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:20.713284 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:20.715508 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:20.745205 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:20.746696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:20.758568 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4440/8896] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:21.914520 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:21.983217 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc20d6-f80b-498c-a27b-ec3d84f74823 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:21.988479 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:21.989056 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:21.989361 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:21.989628 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:21.991890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:22.007669 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:22.009087 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:22.031662 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4457/8897] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:23.497269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:23.551903 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cca2d-4690-47b4-a73a-f8a0e912f19c service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:23.555790 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:23.556442 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:23.556722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:23.556993 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:23.559008 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:23.665226 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:23.666707 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:23.688330 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4441/8898] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:27.744599 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:27.752703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:27.778429 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b99-9e7c-4e9f-a14d-869f355b38fa service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:27.784104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:27.784774 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:27.785053 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:27.785328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:27.787376 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:27.830016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:27.831598 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:27.847374 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4458/8899] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:32.832672 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:32.834563 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:32.847335 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe58af-8c11-4266-929e-22f147bb16bd service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:32.852028 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:32.852661 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:32.852939 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:32.853211 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] PATH_INFO: `/v3/users/5a0d0840b1a44e4eadce9c77f0ad4621` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:32.854331 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d0840b1a44e4eadce9c77f0ad4621)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:32.856321 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:33.083479 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:33.097975 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d0840b1a44e4eadce9c77f0ad4621'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.098947 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d0840b1a44e4eadce9c77f0ad4621'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.230671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d0840b1a44e4eadce9c77f0ad4621'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.244624 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d0840b1a44e4eadce9c77f0ad4621'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.245285 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d0840b1a44e4eadce9c77f0ad4621'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.259081 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4442/8900] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:56:32 2022] DELETE /identity/v3/users/5a0d0840b1a44e4eadce9c77f0ad4621 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:33.546890 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:33.561581 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00eb-62a7-4a30-99a0-38440e4177bb service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:33.622729 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:33.623359 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:33.623639 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:33.623912 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] PATH_INFO: `/v3/projects/95ff7a2e9e58471b8bc700f5db25c4c6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:33.625039 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ff7a2e9e58471b8bc700f5db25c4c6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:33.627544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:33.768078 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ff7a2e9e58471b8bc700f5db25c4c6', 'request_id': 'req-2c74ada7-7515-4a5f-a227-eabf991e4dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.892929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ff7a2e9e58471b8bc700f5db25c4c6', 'request_id': 'req-2c74ada7-7515-4a5f-a227-eabf991e4dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.899443 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ff7a2e9e58471b8bc700f5db25c4c6', 'request_id': 'req-2c74ada7-7515-4a5f-a227-eabf991e4dad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.911088 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] The token cache is being invalidate because project 95ff7a2e9e58471b8bc700f5db25c4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:56:33.911371 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.912092 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:33.913622 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4459/8901] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:56:33 2022] DELETE /identity/v3/projects/95ff7a2e9e58471b8bc700f5db25c4c6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:33.917849 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:33.919386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:33.933427 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5def8-9217-4e42-8e5c-3edda37c88dc admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:33.992189 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:33.992826 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:33.993098 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:33.993368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] PATH_INFO: `/v3/users/3ab19e79d3324aa39adbca9b75e2e293` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:34.007900 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab19e79d3324aa39adbca9b75e2e293)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:34.009835 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:34.215373 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab19e79d3324aa39adbca9b75e2e293'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.216106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab19e79d3324aa39adbca9b75e2e293'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.291792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab19e79d3324aa39adbca9b75e2e293'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.305153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab19e79d3324aa39adbca9b75e2e293'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.306780 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-fc8c39c6-3885-4902-b77e-c31112722d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab19e79d3324aa39adbca9b75e2e293'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.319292 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4443/8902] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 15:56:33 2022] DELETE /identity/v3/users/3ab19e79d3324aa39adbca9b75e2e293 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:34.604750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:34.606305 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:34.619441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74ada7-7515-4a5f-a227-eabf991e4dad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:34.684867 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:34.691750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:34.691750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:34.691750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] PATH_INFO: `/v3/projects/79946c3e89cd4784932f163ccc910ace` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:34.691750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:34.698123 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79946c3e89cd4784932f163ccc910ace)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:34.700194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:34.859439 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79946c3e89cd4784932f163ccc910ace', 'request_id': 'req-baba23f2-6595-4f2c-884d-01de1ba272a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.944474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79946c3e89cd4784932f163ccc910ace', 'request_id': 'req-baba23f2-6595-4f2c-884d-01de1ba272a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.950985 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79946c3e89cd4784932f163ccc910ace', 'request_id': 'req-baba23f2-6595-4f2c-884d-01de1ba272a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.963915 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] The token cache is being invalidate because project 79946c3e89cd4784932f163ccc910ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:56:34.964245 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.964874 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baba23f2-6595-4f2c-884d-01de1ba272a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:56:34.966539 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4460/8903] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 15:56:34 2022] DELETE /identity/v3/projects/79946c3e89cd4784932f163ccc910ace => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:34.972539 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:34.973103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:34.973103 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.001369 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:35.023452 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:35.024630 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:35.087049 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4444/8904] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:35.095894 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.096200 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.096530 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.116313 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:35.117438 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:35.126330 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4461/8905] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:35.130804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.140942 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60954f1-682e-4309-8edb-5584e3acc123 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.146243 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.146887 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.147201 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.147501 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.148220 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:56:35.148531 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.150150 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.162930 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4445/8906] 10.222.0.13 () {58 vars in 1153 bytes} [Mon Oct 31 15:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:56:35.167450 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.177453 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554328-85a2-46c3-b9ba-b294b1e2adb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.182109 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.182734 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.183012 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.183283 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.183909 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.185828 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.323241 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4462/8907] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:56:35 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:56:35.327445 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.337399 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f9a24-eae6-4cbe-a083-f50c1a967b04 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.396567 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.397221 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.397499 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.397771 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.398415 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.400432 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.501979 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4446/8908] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:56:35 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:56:35.506220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.517759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458ced1-6aa5-4d59-8a1d-c37261ebd59a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.522512 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.523248 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.523451 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.523722 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.524355 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.526016 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.537414 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4463/8909] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:56:35.541766 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.552370 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2601a7-eadb-40b4-8db0-65b6368fbdf5 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.557326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.557979 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.558259 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.558529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.559213 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.560881 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3f455-c48b-4ac0-8b1d-40b0bb071ab9 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.572772 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4447/8910] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:56:35.577266 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.588367 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3719bc-0252-43f9-9732-aba509629c7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.593227 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.593916 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.594220 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.594596 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] PATH_INFO: `/v3/projects/85d99cdfcfb34d7290d6f0feb7c63322/users/f8929155155240c5aa6f644e93005a56/roles/f1546c42bfde496495dd863a8eb29ff1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.610157 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d99cdfcfb34d7290d6f0feb7c63322, user_id=f8929155155240c5aa6f644e93005a56, role_id=f1546c42bfde496495dd863a8eb29ff1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.613021 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.711805 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4464/8911] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:56:35 2022] PUT /identity/v3/projects/85d99cdfcfb34d7290d6f0feb7c63322/users/f8929155155240c5aa6f644e93005a56/roles/f1546c42bfde496495dd863a8eb29ff1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:35.717182 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956f98-aecf-4395-a7d7-6df5d8b7f8a1 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.717524 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956f98-aecf-4395-a7d7-6df5d8b7f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.717752 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956f98-aecf-4395-a7d7-6df5d8b7f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.738783 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-6b956f98-aecf-4395-a7d7-6df5d8b7f8a1 None None] MFA Rules not processed for user `a7bb3a54d28948f4a1c81eb298884942`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:35.740013 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6b956f98-aecf-4395-a7d7-6df5d8b7f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:35.807845 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4448/8912] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:35.817875 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:35.819652 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:35.880782 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf1ec-8ab6-4d18-81bb-28b152d6e4b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:35.884584 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:35.885194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:35.885474 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:35.885750 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:35.896117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:35.897548 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:35.908068 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4465/8913] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:41.795301 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:41.795743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:41.795839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:41.804297 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:41.854548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] MFA Rules not processed for user `f8929155155240c5aa6f644e93005a56`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:41.855810 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:41.942159 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4449/8914] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:41.946766 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:41.957971 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9cccb-806b-4fc7-9915-773389d5735f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:41.964756 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:41.965381 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:41.965840 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:41.966265 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:41.967107 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:41.969250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:41.980272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:42.121459 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4466/8915] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Oct 31 15:56:41 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:56:42.122804 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:42.135332 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29b7f-68ec-46f7-a814-c09cacec9717 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:42.210199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:42.210851 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:42.211129 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:42.211398 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] PATH_INFO: `/v3/users` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:42.212034 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:42.213954 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:42.306474 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4450/8916] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Oct 31 15:56:42 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:56:42.310681 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:42.321978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433819e-5f7f-4fcd-8aec-e44b01f55b00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:42.327483 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:42.328119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:42.328398 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:42.328668 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:42.329407 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:42.331297 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:42.342255 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4467/8917] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:56:42.347757 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:42.359318 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3242-f5e6-4bf9-8507-6e3902264f30 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:42.365206 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:42.366087 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:42.366588 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:42.366919 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] PATH_INFO: `/v3/projects/04e60db52ea44f998ab0532de1c4ca5a/users/373c26ed93ee442083a438bfba3a3e54/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:42.383685 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e60db52ea44f998ab0532de1c4ca5a, user_id=373c26ed93ee442083a438bfba3a3e54, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:42.386375 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:42.545146 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4451/8918] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:56:42 2022] PUT /identity/v3/projects/04e60db52ea44f998ab0532de1c4ca5a/users/373c26ed93ee442083a438bfba3a3e54/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:42.550152 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:42.560964 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079bd45-2f20-4f2b-b107-5275776e768d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:42.621077 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:42.621686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:42.621963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:42.622268 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:42.622963 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:42.624619 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7396f72-0970-4156-bca8-1d12e9680be9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:42.636062 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4468/8919] 10.222.0.13 () {58 vars in 1122 bytes} [Mon Oct 31 15:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:56:42.640423 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:42.651600 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d2f9-7210-4e80-b2e1-8d215ec65248 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:42.656504 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:42.657196 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:42.657472 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:42.657791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] PATH_INFO: `/v3/projects/04e60db52ea44f998ab0532de1c4ca5a/users/373c26ed93ee442083a438bfba3a3e54/roles/cdd12ff38c8843ef896a12ed03c315ae` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:42.659958 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e60db52ea44f998ab0532de1c4ca5a, user_id=373c26ed93ee442083a438bfba3a3e54, role_id=cdd12ff38c8843ef896a12ed03c315ae)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:42.662683 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:42.674779 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4452/8920] 10.222.0.13 () {60 vars in 1483 bytes} [Mon Oct 31 15:56:42 2022] PUT /identity/v3/projects/04e60db52ea44f998ab0532de1c4ca5a/users/373c26ed93ee442083a438bfba3a3e54/roles/cdd12ff38c8843ef896a12ed03c315ae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:56:48.936962 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212c78-3502-47c5-8cee-bb28a6bfd9ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:48.938471 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212c78-3502-47c5-8cee-bb28a6bfd9ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:48.938803 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212c78-3502-47c5-8cee-bb28a6bfd9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:48.978650 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8212c78-3502-47c5-8cee-bb28a6bfd9ab None None] MFA Rules not processed for user `373c26ed93ee442083a438bfba3a3e54`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:48.980292 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8212c78-3502-47c5-8cee-bb28a6bfd9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:49.074738 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4469/8921] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:49.092483 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:49.096065 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:49.174089 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:49.216795 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1e0cb-9bf8-4440-972e-a3aa509b15fa admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:49.226382 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:49.227614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:49.227614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:49.227614 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:49.324547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:49.326500 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:49.344875 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4453/8922] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:52.318104 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:52.318704 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:52.318951 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:52.340860 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] MFA Rules not processed for user `f8929155155240c5aa6f644e93005a56`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:56:52.342075 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:52.350087 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4470/8923] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:56:52.724586 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:52.784143 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1006-0b79-4954-8239-dc207bddde04 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:52.787803 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:52.788428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:52.788708 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:52.788981 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:52.790886 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:52.803325 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:52.805069 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:52.815378 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4454/8924] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:56:54.255849 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:56:54.257299 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:54.317986 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:54.338835 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d6e1c-2a77-4ca0-8896-8eef75f49bd6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:56:54.344118 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:56:54.344728 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:56:54.345010 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:56:54.345498 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:56:54.348099 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:56:54.361004 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:56:54.363112 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:56:54.376411 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4471/8925] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:56:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:57:01.956498 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:57:01.975710 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2d34-5734-49f6-8dae-3eec2a86a1e3 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:57:01.981920 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:57:01.982791 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:57:01.983422 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:57:01.983696 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:57:01.987649 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:57:02.002738 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:57:02.004358 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:57:02.015764 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4455/8926] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:57:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:57:04.453030 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:09.804478 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:57:09.814690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b05e8-5506-44eb-8ecc-899bfbd2f2b7 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:57:09.818269 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:57:09.818977 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:57:09.819259 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:57:09.819535 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:57:09.828703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:57:09.830128 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eb040-1e3f-4a2c-9459-7631af015e6e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:57:09.840381 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4472/8927] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:57:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:57:12.011015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=68 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:19.835635 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:23.306299 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:58:23.308082 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:58:23.320426 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356475-7941-4ad4-933e-8f7c3f84a508 service nova] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:58:23.324190 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:58:23.324797 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:58:23.325081 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:58:23.325354 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:58:23.327207 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:58:23.338349 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:58:23.339863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:58:23.349819 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4456/8928] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:58:33.345642 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:13.332201 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:13.341686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:13.341686 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:13.396504 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:59:13.397895 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:13.471820 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4473/8929] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:59:13.629866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:13.643564 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d70c2-c9fa-4c6c-b993-ee4859dcccaa service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:13.649254 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:13.649893 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:13.650173 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:13.650520 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:13.652387 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:13.665236 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:13.666922 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:13.675100 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:13.676552 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:13.679092 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4457/8930] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:59:13.823085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d396515-8f30-4a4f-9819-843b44308fb7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:13.828544 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:13.829174 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:13.829457 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:13.829810 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:13.844566 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:13.846565 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2efa-ff44-4dc9-a2b4-ff358878256b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:13.856401 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4474/8931] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:59:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 15:59:23.673344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:23.852590 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:24.673839 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:24.675688 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:24.690691 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75921761-3e82-4ec2-90cd-0394567894a0 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:24.696222 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:24.701734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:24.701734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:24.701734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:24.701734 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:24.714175 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:24.715832 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:24.728540 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4458/8932] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:59:25.784638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:25.785198 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:25.785302 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:25.807858 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] MFA Rules not processed for user `f8929155155240c5aa6f644e93005a56`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:59:25.809086 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:25.816719 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4475/8933] 10.222.0.13 () {58 vars in 958 bytes} [Mon Oct 31 15:59:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:59:26.706368 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:26.718792 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f935f-d591-427b-a4b3-20f3b70389b6 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:26.724667 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:26.725271 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:26.725547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:26.725819 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:26.728148 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:26.740743 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:26.743326 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110652-520e-44b1-ad39-560e6a9f92bd service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:26.754537 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4459/8934] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:59:28.241709 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:28.256690 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1731a-a122-40f6-8be8-404fca422930 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:28.264771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:28.265384 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:28.265666 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:28.265940 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:28.267747 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:28.281008 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:28.282602 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:28.293748 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4476/8935] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:59:29.438307 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:29.438863 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:29.442434 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:29.458929 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:59:29.460183 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:29.468613 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4460/8936] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:59:29.482149 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:29.494108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e5a00-c687-44e8-beea-b558230fc183 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:29.507675 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:29.508445 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:29.508798 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:29.509147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:29.518051 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:29.519880 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:29.529112 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4477/8937] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 15:59:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:39.453617 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=15 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:39.526044 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:41.533345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:41.546527 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771cfa-031b-4201-88b1-be74ae237437 None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:41.551228 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:41.553161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:41.553161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:41.553161 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:41.554987 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:41.566542 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:41.568012 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:41.576632 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4461/8938] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:59:42.535697 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:59:42.537272 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:42.556703 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1817-e248-429a-b70a-1bf687a5e6a1 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:59:42.562933 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:59:42.563560 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:59:42.563839 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:59:42.564119 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:59:42.566250 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:59:42.581121 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:59:42.582741 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:59:42.594944 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4478/8939] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:59:51.572866 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=6 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:52.590363 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:56.951352 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:01:56.981033 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900d85-4be5-4178-bb92-0c656356ce1d service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:01:56.987120 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:01:56.987730 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:01:56.988011 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:01:56.988287 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:01:56.997860 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:01:56.999553 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dbbb6-ab24-44f1-9ec8-e093ee919325 service nova] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:01:57.009358 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4462/8940] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:01:57.087085 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:01:57.088524 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:01:57.169000 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f52b-4fda-4083-a3c8-1312d32bee4c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:01:57.172611 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22e15ff208c1453ab8318e64575dc2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:01:57.173208 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:01:57.173489 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:01:57.173759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:01:57.175508 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:01:57.189503 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:01:57.190953 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:01:57.201819 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4479/8941] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 16:02:06.817876 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0f2-1fe9-4c83-8c29-ec26af4af15d None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:06.818596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0f2-1fe9-4c83-8c29-ec26af4af15d None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:06.818596 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0f2-1fe9-4c83-8c29-ec26af4af15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:06.839059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-2901d0f2-1fe9-4c83-8c29-ec26af4af15d None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 16:02:06.840273 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-2901d0f2-1fe9-4c83-8c29-ec26af4af15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:06.847581 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4463/8942] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Oct 31 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 16:02:06.888184 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:06.899436 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3052887-3a84-4aff-9587-b2a2fcc3fd7a service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:06.905151 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:06.905771 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:06.906048 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:06.906321 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:06.914351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:06.915947 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:06.924464 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4480/8943] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 16:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:16.833751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=16 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:16.921249 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:18.237892 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] REQUEST_METHOD: `POST` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:18.238374 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:18.238548 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:18.258982 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.auth.core [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 16:02:18.260202 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:18.268282 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4464/8944] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 16:02:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 16:02:18.280822 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:18.291588 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894405f9-0e9a-4cec-af36-3bcb3bde260d service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:18.296751 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:18.297351 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:18.297633 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:18.297911 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:18.306567 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:18.308229 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d477e-8494-4ced-92a1-3770e4ae3bef service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:18.317291 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4481/8945] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 16:02:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:20.556323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:20.567116 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3545cb-dee1-4116-a357-49f7989d64eb None None] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:20.571037 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:20.571711 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:20.572058 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:20.572392 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:20.574252 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:20.588316 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:20.589895 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:20.602590 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4465/8946] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:02:24.132497 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:24.132978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:24.133080 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:24.158632 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] MFA Rules not processed for user `bdf1d58b4c5646629bfa0a0e09b2dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 16:02:24.159837 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:24.166935 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4482/8947] 10.222.0.13 () {58 vars in 967 bytes} [Mon Oct 31 16:02:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 16:02:24.179016 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:24.190904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009838ec-dc66-49e8-94e4-406f4678dd84 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:24.195867 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd208aa4e6dc479a8a24bdfce4dff5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:24.196471 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:24.196751 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:24.197053 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:24.206153 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:24.207775 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:24.216140 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4466/8948] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Oct 31 16:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:27.863122 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:27.878314 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b6a14-bd04-45eb-be93-ead7b0128a18 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:27.884108 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cf0897f734e424a9dbbda87f9c0d6f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:27.884918 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:27.885196 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:27.885638 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:27.895576 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:27.897441 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:27.912403 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4483/8949] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:02:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:02:30.313412 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:30.322904 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3846bfb-d1e5-4d4a-bac0-fc712c4f576b service swift] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:30.326671 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd72035cfc0a24494a557a50792e6382d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:30.327269 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:30.327547 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:30.327820 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:30.389854 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:30.391323 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:30.400727 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4467/8950] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 16:02:34.537758 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:34.550543 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b1649-1760-4983-b34e-429bafca6170 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:34.556034 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:34.556641 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:34.556929 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:34.557194 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:34.559120 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:34.571889 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:34.573491 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:34.585225 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4484/8951] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:02:38.314199 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:38.325532 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130477ff-3a90-4a32-8115-8c895d309a33 service neutron] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:38.330648 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:38.331407 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:38.331948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:38.331948 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] PATH_INFO: `/v3/users/f8929155155240c5aa6f644e93005a56` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:38.333106 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8929155155240c5aa6f644e93005a56)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:38.335102 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:38.526302 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8929155155240c5aa6f644e93005a56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:38.527032 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8929155155240c5aa6f644e93005a56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:38.586400 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8929155155240c5aa6f644e93005a56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:38.607051 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8929155155240c5aa6f644e93005a56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:38.608121 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8929155155240c5aa6f644e93005a56'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:38.627307 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4468/8952] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 16:02:38 2022] DELETE /identity/v3/users/f8929155155240c5aa6f644e93005a56 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 16:02:38.916844 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:38.929972 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b038e-5911-4ca2-8513-2a274b9131c8 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:38.997066 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:38.997866 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:38.998147 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:38.998421 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] PATH_INFO: `/v3/projects/85d99cdfcfb34d7290d6f0feb7c63322` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:38.999721 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d99cdfcfb34d7290d6f0feb7c63322)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:39.001664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:39.130461 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d99cdfcfb34d7290d6f0feb7c63322', 'request_id': 'req-672cafee-df73-4f8c-98be-85921a7363f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.206339 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d99cdfcfb34d7290d6f0feb7c63322', 'request_id': 'req-672cafee-df73-4f8c-98be-85921a7363f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.213969 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d99cdfcfb34d7290d6f0feb7c63322', 'request_id': 'req-672cafee-df73-4f8c-98be-85921a7363f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.232571 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] The token cache is being invalidate because project 85d99cdfcfb34d7290d6f0feb7c63322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 16:02:39.233117 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.233973 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.235868 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4485/8953] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 16:02:38 2022] DELETE /identity/v3/projects/85d99cdfcfb34d7290d6f0feb7c63322 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 16:02:39.240059 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:39.241579 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:39.257137 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11353c-1e24-49d7-bbb4-ed42b07151d2 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:39.301345 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:39.333566 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:39.334282 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:39.334722 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:39.335010 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] PATH_INFO: `/v3/users/373c26ed93ee442083a438bfba3a3e54` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:39.336276 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373c26ed93ee442083a438bfba3a3e54)` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:39.338456 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:39.544845 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373c26ed93ee442083a438bfba3a3e54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.545420 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373c26ed93ee442083a438bfba3a3e54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.625631 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373c26ed93ee442083a438bfba3a3e54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.640004 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373c26ed93ee442083a438bfba3a3e54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.640754 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.notifications [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373c26ed93ee442083a438bfba3a3e54'} {{(pid=82163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:39.655081 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4469/8954] 10.222.0.13 () {58 vars in 1224 bytes} [Mon Oct 31 16:02:39 2022] DELETE /identity/v3/users/373c26ed93ee442083a438bfba3a3e54 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 16:02:39.901857 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:02:39.904061 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:02:39.919936 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cafee-df73-4f8c-98be-85921a7363f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:02:39.965028 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:39.983222 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7bb3a54d28948f4a1c81eb298884942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90ee3928a7cf4c8590e1103847faa6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:02:39.984057 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:02:39.984484 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:02:39.984893 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] PATH_INFO: `/v3/projects/04e60db52ea44f998ab0532de1c4ca5a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:02:39.986464 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e60db52ea44f998ab0532de1c4ca5a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:02:39.989170 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:02:40.130148 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e60db52ea44f998ab0532de1c4ca5a', 'request_id': 'req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:40.214740 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e60db52ea44f998ab0532de1c4ca5a', 'request_id': 'req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:40.221060 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e60db52ea44f998ab0532de1c4ca5a', 'request_id': 'req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:40.232711 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] The token cache is being invalidate because project 04e60db52ea44f998ab0532de1c4ca5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 16:02:40.233003 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:40.233715 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 16:02:40.235331 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4486/8955] 10.222.0.13 () {58 vars in 1233 bytes} [Mon Oct 31 16:02:39 2022] DELETE /identity/v3/projects/04e60db52ea44f998ab0532de1c4ca5a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 16:02:49.650741 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:50.229320 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:17.581936 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:04:17.583428 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:04:17.686529 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e967266-95ab-4559-b69a-6d6766d216e6 admin admin] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:04:17.752386 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:04:17.753000 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:04:17.753280 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:04:17.753551 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:04:17.755344 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.fernet_utils [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:04:17.766915 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:04:17.768543 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:04:17.779162 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4470/8956] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:04:27.774311 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=72 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:31.698517 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:04:31.700485 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:04:31.749328 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf80d7-c7b8-4442-b108-9fc87e7c15a8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:04:31.754577 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:04:31.755202 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:04:31.755481 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:04:31.755753 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:04:31.757470 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 16:04:31.769165 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:04:31.770759 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:04:31.781117 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4487/8957] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:04:41.776350 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:22.571177 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] Authenticating user token {{(pid=82163) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:09:22.601465 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1fd71-81ad-4fc6-8221-20e422ad42c4 service placement] Validating token access rules against request {{(pid=82163) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:09:22.606577 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:09:22.607210 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] REQUEST_METHOD: `GET` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:09:22.607486 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] SCRIPT_NAME: `/identity` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:09:22.607758 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:09:22.617015 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:09:22.618594 n-d-863055-2 devstack@keystone.service[82163]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0507c-f040-43cf-84c7-4e8f60385f15 service placement] RBAC: Authorization granted {{(pid=82163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:09:22.628781 n-d-863055-2 devstack@keystone.service[82163]: [pid: 82163|app: 0|req: 4471/8958] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:09:32.624381 n-d-863055-2 devstack@keystone.service[82163]: DEBUG dbcounter [-] [82163] Writing DB stats keystone:SELECT=13 {{(pid=82163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:37.688664 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 16:09:37.733065 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7404e-6d0b-4dd5-80eb-609a9fe1db9d service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 16:09:37.738806 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e90dc19f58488387296c15062dcb20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '029e4df755db486eae5e5c4db7643bf0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 16:09:37.739432 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 16:09:37.739706 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 16:09:37.739978 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 16:09:37.749847 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 16:09:37.752486 n-d-863055-2 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b70f9-062e-4c4f-8728-46f337baff6c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 16:09:37.762376 n-d-863055-2 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4488/8959] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Oct 31 16:09:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 16:09:47.757943 n-d-863055-2 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}